US7546364B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Replication of remote copy data for internet protocol (IP) transmission
Assignee: EMC Corp
•
Filing: 2002-05-16
•
Granted: 2009-06-09
•
Expires: 2022-05-16
Abstract
Abstract Consistent updates are made automatically over a wide-area IP network, concurrently with read-only access to the remote copies. A replication control protocol (RCP) is layered over TCP/IP providing the capability for a remote site to replicate and rebroadcast blocks of the remote copy data to specified groups of destinations, as configured in a routing table. A volume multicast layer over RCP provides for multicasting to specified volume extents of the blocks. The blocks are copied at the logical level, so that it does not matter what physical structure is used for storing the remote copies. Save volumes buffer the remote copy data transmitted between the primary or secondary file system volume and the IP network, in order to ensure independence between the replication process, the IP transport method, and the primary file system being replicated.
Inventors
- 👤 Suchitra Raman
- 👤 Philippe Armangau
- 👤 Milena Bergant
- 👤 Raymond A. Angelone
- 👤 Jean-Pierre Bono
- 👤 Uresh Vahalia
- 👤 Uday K. Gupta
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-03 18:06
CPC Classifications
H; H04; H04L; H04L67/00; H04L67/01; H04L67/10; H04L67/1095; H04L67/1097; H04L69/00; H04L69/30; H04L69/32; H04L69/322; H04L69/329
Claims Analysis
Total Claims: 20
Claim 1
Independent Claim
398 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer manages a primary file system in the data storage of the storage system including the primary data mover computer, each secondary data mover computer manages a secondary file system in the data storage of the data storage system including said each secondary data mover computer, and each secondary file system is maintained as a remote copy of the primary file system; and which includes operating a replication service that transmits modifications of the primary file system to the secondary data mover computers, and then creating a new secondary file system by copying the primary file system to the new secondary file system concurrent with the operation of the replication service, and after the primary file system has been copied to the new secondary file system, updating the new secondary file system with modifications transmitted by the replication service from the primary file system; wherein the replication service transmits modifications from the primary file system to a save volume during the copying of the primary file system to the new secondary file system, and upon completion of the copying of the primary file system to the new secondary file system, the modifications are copied from the save volume to the new secondary file system; and wherein the new secondary file system is at a remote site and the save volume is at the remote site, and the method includes transmitting at least a portion of the modifications of the primary file system to the save volume concurrently with the copying of the primary file system to the new secondary file system.
Claim 2
Dependent Claim
398 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer manages a primary file system in the data storage of the storage system including the primary data mover computer, each secondary data mover computer manages a secondary file system in the data storage of the data storage system including said each secondary data mover computer, and each secondary file system is maintained as a remote copy of the primary file system; and which includes operating a replication service that transmits modifications of the primary file system to the secondary data mover computers, and then creating a new secondary file system by copying the primary file system to the new secondary file system concurrent with the operation of the replication service, and after the primary file system has been copied to the new secondary file system, updating the new secondary file system with modifications transmitted by the replication service from the primary file system; wherein the replication service transmits modifications from the primary file system to a save volume during the copying of the primary file system to the new secondary file system, and upon completion of the copying of the primary file system to the new secondary file system, the modifications are copied from the save volume to the new secondary file system; and wherein the new secondary file system is at a remote site and the save volume is at the remote site, and the method includes transmitting at least a portion of the modifications of the primary file system to the save volume concurrently with the copying of the primary file system to the new secondary file system.
Claim 3
Dependent Claim
229 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer manages a primary file system in the data storage of the storage system including the primary data mover computer, each secondary data mover computer manages a secondary file system in the data storage of the data storage system including said each secondary data mover computer, and each secondary file system is maintained as a remote copy of the primary file system; and wherein the remote copy is a copy by extent, so that there is not a remote copy of data blocks that are not used in the primary file system.
Claim 4
Dependent Claim
229 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer manages a primary file system in the data storage of the storage system including the primary data mover computer, each secondary data mover computer manages a secondary file system in the data storage of the data storage system including said each secondary data mover computer, and each secondary file system is maintained as a remote copy of the primary file system; and wherein the remote copy is a copy by extent, so that there is not a remote copy of data blocks that are not used in the primary file system.
Claim 5
Dependent Claim
40 words
The method as claimed in claim 2 , wherein the data blocks are remote copied at a logical level, so that it does not matter what physical structure is used for storing the data blocks in the secondary file systems.
Claim 6
Dependent Claim
69 words
The method as claimed in claim 2 , wherein the primary data mover computer repetitively identifies a next valid block in a volume of the primary file system and identifies a number of valid contiguous blocks following the next valid block in the volume of the primary file system and transmits the next valid block and the number of valid contiguous blocks to said each secondary data mover computer.
Claim 7
Dependent Claim
172 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein only one TCP port to the IP network is used in the forwarder data mover computer for receiving and transmitting the remote copy data to and from the network, and the one TCP port is shared with HTTP connections.
Claim 8
Dependent Claim
172 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein only one TCP port to the IP network is used in the forwarder data mover computer for receiving and transmitting the remote copy data to and from the network, and the one TCP port is shared with HTTP connections.
Claim 9
Dependent Claim
224 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein a TCP port to the IP network is used in the forwarder data mover computer for receiving the remote copy data from the network, the TCP port is shared with HTTP connections, a level 5 filter in the forwarder data mover computer passes IP packets of HTTP connections from the TCP port to an HTTP collector service in the forwarder data mover computer, and the level 5 filter passes IP packets of the remote copy data from the TCP port to a replication collector service in the forwarder data mover computer.
Claim 10
Dependent Claim
224 words
In a data processing system having a plurality of host computers linked by an Internet Protocol (IP) network to a plurality of data storage systems, each of the data storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, a method of distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers, wherein the method comprises: the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein a TCP port to the IP network is used in the forwarder data mover computer for receiving the remote copy data from the network, the TCP port is shared with HTTP connections, a level 5 filter in the forwarder data mover computer passes IP packets of HTTP connections from the TCP port to an HTTP collector service in the forwarder data mover computer, and the level 5 filter passes IP packets of the remote copy data from the TCP port to a replication collector service in the forwarder data mover computer.
Claim 11
Dependent Claim
404 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer includes means for managing a primary file system in the data storage of the storage system including the primary data mover computer, and each secondary data mover computer includes means for managing a secondary file system in the data storage of the data storage system including said each secondary data mover computer by maintaining each secondary file system as a remote copy of the primary file system; which includes a replication service for transmitting modifications of the primary file system to the secondary data mover computers, and means for creating a new secondary file system by copying the primary file system to the new secondary file system concurrent with the operation of the replication service, and after the primary file system has been copied to the new secondary file system, updating the new secondary file system with modifications transmitted by the replication service from the primary file system; wherein the replication service transmits modifications from the primary file system to a save volume during the copying of the primary file system to the new secondary file system, and upon completion of the copying of the primary file system to the new secondary file system, the modifications are copied from the save volume to the new secondary file system; and wherein the new secondary file system is at a remote site and the save volume is at the remote site, and the replication service transmits at least a portion of the modifications of the primary file system to the save volume concurrently with the copying of the primary file system to the new secondary file system.
Claim 12
Dependent Claim
404 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer includes means for managing a primary file system in the data storage of the storage system including the primary data mover computer, and each secondary data mover computer includes means for managing a secondary file system in the data storage of the data storage system including said each secondary data mover computer by maintaining each secondary file system as a remote copy of the primary file system; which includes a replication service for transmitting modifications of the primary file system to the secondary data mover computers, and means for creating a new secondary file system by copying the primary file system to the new secondary file system concurrent with the operation of the replication service, and after the primary file system has been copied to the new secondary file system, updating the new secondary file system with modifications transmitted by the replication service from the primary file system; wherein the replication service transmits modifications from the primary file system to a save volume during the copying of the primary file system to the new secondary file system, and upon completion of the copying of the primary file system to the new secondary file system, the modifications are copied from the save volume to the new secondary file system; and wherein the new secondary file system is at a remote site and the save volume is at the remote site, and the replication service transmits at least a portion of the modifications of the primary file system to the save volume concurrently with the copying of the primary file system to the new secondary file system.
Claim 13
Dependent Claim
235 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer includes means for managing a primary file system in the data storage of the storage system including the primary data mover computer, and each secondary data mover computer includes means for managing a secondary file system in the data storage of the data storage system including said each secondary data mover computer by maintaining each secondary file system as a remote copy of the primary file system; wherein the remote copy is a copy by extent, so that there is not a remote copy of data blocks that are not used in the primary file system.
Claim 14
Dependent Claim
235 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the primary data mover computer includes means for managing a primary file system in the data storage of the storage system including the primary data mover computer, and each secondary data mover computer includes means for managing a secondary file system in the data storage of the data storage system including said each secondary data mover computer by maintaining each secondary file system as a remote copy of the primary file system; wherein the remote copy is a copy by extent, so that there is not a remote copy of data blocks that are not used in the primary file system.
Claim 15
Dependent Claim
42 words
The data processing system as claimed in claim 8 , wherein the data blocks are remote copied at a logical level, so that it does not matter what physical structure is used for storing the data blocks in the secondary file systems.
Claim 16
Dependent Claim
74 words
The data processing system as claimed in claim 8 , wherein the primary data mover computer is programmed to repetitively identify a next valid block in a volume of the primary file system and identify a number of valid contiguous blocks following the next valid block in the volume of the primary file system and transmit the next valid block and the number of valid contiguous blocks to said each secondary data mover computer.
Claim 17
Dependent Claim
169 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the forwarder data mover computer includes only one TCP port to the IP network for receiving and transmitting the remote copy data to and from the network, the one TCP port also servicing HTTP connections.
Claim 18
Dependent Claim
169 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the forwarder data mover computer includes only one TCP port to the IP network for receiving and transmitting the remote copy data to and from the network, the one TCP port also servicing HTTP connections.
Claim 19
Dependent Claim
218 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the forwarder data mover computer further includes an HTTP collector service, a replication collector service, a TCP port to the IP network for receiving IP packets of the remote copy data from the network and for receiving IP packets of HTTP connections, and a level 5 filter for passing the IP packets of the HTTP connections from the TCP port to the HTTP collector service and passing the IP packets of the remote copy data from the TCP port to the replication collector service.
Claim 20
Dependent Claim
218 words
A data processing system comprising: a plurality of data storage systems linked by an Internet Protocol (IP) network for access by a plurality of host computers, each of the storage systems having data storage and at least one data mover computer for moving data between the data storage and the IP network, the data mover computers including means for distributing remote copy data over the IP network from a primary one of the data mover computers to a plurality of secondary ones of the data mover computers by the primary data mover computer sending the remote copy data over the IP network to at least one forwarder data mover computer, and the forwarder data mover computer routing the remote copy data over the IP network to the plurality of secondary data mover computers; wherein the forwarder data mover computer further includes an HTTP collector service, a replication collector service, a TCP port to the IP network for receiving IP packets of the remote copy data from the network and for receiving IP packets of HTTP connections, and a level 5 filter for passing the IP packets of the HTTP connections from the TCP port to the HTTP collector service and passing the IP packets of the remote copy data from the TCP port to the replication collector service.
References Cited (Backward Citations)
US4755928A
Cited
US4686620A
Cited
US5175852A
Cited
US5175837A
Cited
US5276860A
Cited
US5276867A
Cited
US5218695A
Cited
US5596706A
Cited
US5379418A
Cited
US5155845A
Cited
US5341493A
Cited
US5255270A
Cited
US5301286A
Cited
US5276871A
Cited
US5367698A
Cited
US5701516A
Cited
US5487160A
Cited
US6502205B1
Cited
US5742792A
Cited
US5819292A
Cited
US5535381A
Cited
US5611069A
Cited
US5615329A
Cited
EP0672985A1
Cited
EP0674263A1
Cited
US5434994A
Cited
US5909483A
Cited
US5590320A
Cited
US5835953A
Cited
US5758149A
Cited
US5594863A
Cited
US6108748A
Cited
US5680640A
Cited
US5870746A
Cited
US5974563A
Cited
US6029175A
Cited
US5852715A
Cited
US6035412A
Cited
US6052797A
Cited
US5901327A
Cited
US5673382A
Cited
US6101497A
Cited
US6092066A
Cited
US5857208A
Cited
US6078929A
Cited
US5893140A
Cited
US5829047A
Cited
US5835954A
Cited
US5923878A
Cited
US5873116A
Cited
US5875478A
Cited
US6081875A
Cited
US6578120B1
Cited
US5978951A
Cited
US6192408B1
Cited
US6076148A
Cited
US6016501A
Cited
US6324654B1
Cited
US6088796A
Cited
US6353878B1
Cited
US6401239B1
Cited
US6732124B1
Cited
US6434681B1
Cited
US6564229B1
Cited
US6938039B1
Cited
US6823336B1
Cited
US6694447B1
Cited
US20020163910A1
Cited
US6496908B1
Cited
US7010553B2
Cited
US20040030951A1
Cited
US20060242182A1
Cited
US20070033236A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2012-06-08 | 2012-12-08 | 2013-06-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2016-06-08 | 2016-12-08 | 2017-06-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2020-06-08 | 2020-12-08 | 2021-06-09 | $7700.00 | Window Closed / Lapsed |