← Back to Patent Explorer
US6418478B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Pipelined high speed data transfer mechanism

Assignee: Commvault Systems Inc
•
Filing: 1998-03-11
•
Granted: 2002-07-09
•
Expires: 2018-03-11
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract There is disclosed in a communications system having an origination storage device and a destination storage device, a data transfer pipeline apparatus for transferring data in a sequence of N stages, where N is a positive integer greater than 1, from the origination to the destination device. The data transfer apparatus comprises dedicated memory means having a predetermined number of buffers dedicated for carrying data associated with the transfer of data from the origination storage device to the destination device; and master control means for registering and controlling processes associated with the data transfer apparatus for participation in the N stage data transfer sequence. The processes include at least a first stage process for initiating the data transfer and a last Nth stage process for completing data transfer. The first stage process is operative to allocate a buffer from the predetermined number of buffers available within the dedicated memory means for collection, processing, and sending of the data from the origination device to a next stage process. The Nth stage process is operative to receive a buffer allocated to the first stage process from the (N−1)th stage process in the data transfer sequence and to free the buffer upon processing completion and storage in the destination device to permit reallocation of the buffer. The master control means further includes means for monitoring the number of buffers from the pool of buffers allocated or assigned to particular processes in the pipeline, in order to prevent allocation of further buffers to a particular process when the number of buffers currently allocated exceeds a predetermined threshold.

Inventors

  • 👤 Paul Ignatius
  • 👤 Anand Prahlad
  • 👤 Mahesh Tyagarajan

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-10 01:41
CPC Classifications
G; G06; G06F; G06F12/00; G06F12/02; G06F3/00; G06F3/06; G06F3/0601; G06F3/0602; G06F3/061; G06F3/0613; G06F3/0628; G06F3/0655; G06F3/0656; G06F3/0668; G06F3/0671; G06F3/0683; G06F3/0685; G06F9/00; G06F9/06; G06F9/46; G06F9/50; G06F9/5005; G06F9/5027; G06F9/5033; G06F9/54; G06F9/544; H; H04; H04L; H04L69/00; H04L69/04; G06F11/00; G06F11/07; G06F11/14; G06F11/1446; G06F11/1458; G06F11/1464; G06F11/30; G06F11/34; G06F11/3466; G06F11/3495

Claims Analysis

Total Claims: 8
Claim 1
Independent Claim 204 words
A communication system having an origination storage device, a destination storage device, and a data pipeline apparatus for transferring data from the origination storage device to the destination storage device, the data pipeline apparatus comprising: a dedicated memory associated with both the origination storage device and the destination storage device having a pool of buffers dedicated to carrying data from the origination storage device to the destination storage device; a master control module for registering and initiating processes associated with the data transfer apparatus, the processes including: a first stage collection process that allocates a sequence of buffers from the pool of buffers located in the dedicated memory, the sequence of buffers being locked against further allocation until freed by the process to which the sequence of buffers are assigned; at least one restore process that stores the data resident in the sequence of buffers in the destination storage device and frees the sequence of buffers so that they may be reallocated; and a network control module that is responsive to the master control module, the network control module initiating a plurality of network agent processes such that the dedicated memory is shared among each of the processes participating in the data transfer pipeline.
Claim 2
Dependent Claim 204 words
A communication system having an origination storage device, a destination storage device, and a data pipeline apparatus for transferring data from the origination storage device to the destination storage device, the data pipeline apparatus comprising: a dedicated memory associated with both the origination storage device and the destination storage device having a pool of buffers dedicated to carrying data from the origination storage device to the destination storage device; a master control module for registering and initiating processes associated with the data transfer apparatus, the processes including: a first stage collection process that allocates a sequence of buffers from the pool of buffers located in the dedicated memory, the sequence of buffers being locked against further allocation until freed by the process to which the sequence of buffers are assigned; at least one restore process that stores the data resident in the sequence of buffers in the destination storage device and frees the sequence of buffers so that they may be reallocated; and a network control module that is responsive to the master control module, the network control module initiating a plurality of network agent processes such that the dedicated memory is shared among each of the processes participating in the data transfer pipeline.
Claim 3
Dependent Claim 45 words
The communication system of claim 1 further comprising a next stage compression process coupled between the first stage collection process and the plurality of network agent processors for receiving buffers sent from the first stage collection process and compressing the data transferred in said buffers.
Claim 4
Dependent Claim 31 words
The communication system of claim 2 wherein the next stage compression process includes multiple instantiations thereof operating in parallel to receive and process buffer data from the first stage collection process.
Claim 5
Dependent Claim 82 words
The communication system of claim 3 further comprising: a sequence process coupled between the first stage collection process and the multiple instantiations of the next stage compression processes for identifying each buffer received from the first stage collection process with a sequence number; and a re-sequence process coupled between the multiple instantiations of the next stage compression process and the plurality of network agent processes and responsive to the sequence numbers for re-ordering the sequence of buffers according to the sequence numbers.
Claim 6
Independent Claim 193 words
A method for transferring data from an origination storage device to a destination storage device with a data pipeline apparatus comprising: allocating a dedicated memory associated with both the origination storage device and the destination storage device having a pool of buffers dedicated to carrying data from the origination storage device to the destination storage device; configuring a master control module for registering and initiating processes associated with the data transfer apparatus, the processes including: a first stage collection process that allocates a sequence of buffers from the pool of buffers located in the dedicated memory, the sequence of buffers being locked against further allocation until freed by the process to which the sequence of buffers are assigned; at least one restore process that stores the data resident in the sequence of buffers in the destination storage device and frees the sequence of buffers so that they may be reallocated; and providing a network control module that is responsive to the master control module, the network control module initiating a plurality of network agent processes such that the dedicated memory is shared among each of the processes participating in the data transfer pipeline.
Claim 7
Independent Claim 193 words
A method for transferring data from an origination storage device to a destination storage device with a data pipeline apparatus comprising: allocating a dedicated memory associated with both the origination storage device and the destination storage device having a pool of buffers dedicated to carrying data from the origination storage device to the destination storage device; configuring a master control module for registering and initiating processes associated with the data transfer apparatus, the processes including: a first stage collection process that allocates a sequence of buffers from the pool of buffers located in the dedicated memory, the sequence of buffers being locked against further allocation until freed by the process to which the sequence of buffers are assigned; at least one restore process that stores the data resident in the sequence of buffers in the destination storage device and frees the sequence of buffers so that they may be reallocated; and providing a network control module that is responsive to the master control module, the network control module initiating a plurality of network agent processes such that the dedicated memory is shared among each of the processes participating in the data transfer pipeline.
Claim 8
Dependent Claim 59 words
The method of claim 5 further comprising initiating network agent processes coupled between the first stage collection process and the at least one restore stage process for transferring the data buffers across a network when the first stage collection process is resident on a first computer and the at least one restore process is resident on a second computer.

References Cited (Backward Citations)

US5093912A Cited
US5311509A Cited
US5956519A Cited
US5699361A Cited
US5860104A Cited
US5901327A Cited
US5761734A Cited
US6009274A Cited
EP0862304A2 Cited
WO1998039707A1 Cited
US6012090A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2005-07-08 2006-01-07 2006-07-09 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2009-07-08 2010-01-07 2010-07-09 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2013-07-08 2014-01-07 2014-07-09 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag