US11947472B2
Active / In Force
US
⏱️ 15.6 years remaining
Composable infrastructure enabled by heterogeneous architecture, delivered by CXL based cached switch SoC
Assignee: Avago Technologies International Sales Pte Ltd
•
Filing: 2022-06-28
•
Granted: 2024-04-02
•
Expires: 2042-06-28
Abstract
Abstract Described herein are systems, methods, and products utilizing a cache coherent switch on chip. The cache coherent switch on chip may utilize Compute Express Link (CXL) interconnect open standard and allow for multi-host access and the sharing of resources. The cache coherent switch on chip provides for resource sharing between components while independent of a system processor, removing the system processor as a bottleneck. Cache coherent switch on chip may further allow for cache coherency between various different components. Thus, for example, memories, accelerators, and/or other components within the disclose systems may each maintain caches, and the systems and techniques described herein allow for cache coherency between the different components of the system with minimal latency.
Inventors
- 👤 Shreyas Shah
- 👤 George Apostol, Jr.
- 👤 Nagarajan Subramaniyan
- 👤 Jack Regula
- 👤 Jeffrey S. Earl
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-08 06:59
CPC Classifications
G; G06; G06F; G06F12/00; G06F12/02; G06F12/08; G06F12/0802; G06F12/0866; G06F12/0868; G06F12/06; G06F12/0646; G06F12/0806; G06F12/0813; G06F12/0815; G06F12/0837; G06F12/0862; G06F12/14; G06F12/1458; G06F12/1466; G06F13/00; G06F13/14; G06F13/16; G06F13/1605; G06F13/1642; G06F13/1668; G06F13/1673; G06F13/38; G06F13/40; G06F13/4004; G06F13/4022; G06F13/42; G06F13/4204; G06F13/4221; G06F13/4282; G06F13/4295; G06F2212/00; G06F2212/10; G06F2212/1016; G06F2213/00; G06F2213/0026; G06N; G06N20/00
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
127 words
A cache coherent switch on chip comprising: a plurality of ports, each port configured to communicatively couple to an associated component of a plurality of components and configured to support a Compute Express Link (CXL) protocol; switched fabric circuitry, communicatively coupled to the plurality of ports and comprising: switched fabric circuitry configured in a mesh network comprising a plurality of nodes; and a microprocessor, communicatively coupled to the switched fabric circuitry and comprising: a fabric manager, configured to allocate and/or deallocate resources to one or more of the plurality of ports and; wherein the cache coherent switch on chip is configured to share resources between the plurality of components utilizing the CXL protocol over a CXL interface while bypassing a central processing unit to share the resources.
Claim 2
Dependent Claim
127 words
A cache coherent switch on chip comprising: a plurality of ports, each port configured to communicatively couple to an associated component of a plurality of components and configured to support a Compute Express Link (CXL) protocol; switched fabric circuitry, communicatively coupled to the plurality of ports and comprising: switched fabric circuitry configured in a mesh network comprising a plurality of nodes; and a microprocessor, communicatively coupled to the switched fabric circuitry and comprising: a fabric manager, configured to allocate and/or deallocate resources to one or more of the plurality of ports and; wherein the cache coherent switch on chip is configured to share resources between the plurality of components utilizing the CXL protocol over a CXL interface while bypassing a central processing unit to share the resources.
Claim 3
Dependent Claim
53 words
The cache coherent switch on chip of claim 1 , wherein the cache coherent switch on chip further comprises: a plurality of virtual hierarchies, wherein the fabric manager is configured to: determine that a first component has been coupled to a first port; and assign the first component to a first virtual hierarchy.
Claim 4
Dependent Claim
91 words
The cache coherent switch on chip of claim 2 , wherein the first port comprises a plurality of virtual PCI-to-PCI bridges (vPPB) and a first PCI-to-PCI bridge (PPB), wherein the first component is associated with a PPB, and wherein the fabric manager is further configured to: determine an attribute associated with the first component, wherein the assigning the first component to the first virtual hierarchy is based on the attribute; assign the first component to a first vPPB based on the attribute; and bind the first vPPB to the first PPB.
Claim 5
Dependent Claim
52 words
The cache coherent switch on chip of claim 1 , wherein the plurality of ports comprises an upstream port, a first downstream port, and a second downstream port, wherein the fabric manager is further configured to: receive a signal from the upstream port; and direct the signal to the first downstream port.
Claim 6
Dependent Claim
21 words
The cache coherent switch on chip of claim 1 , wherein the fabric manager is implemented within firmware of the microprocessor.
Claim 7
Dependent Claim
46 words
The cache coherent switch on chip of claim 1 , wherein the processor is configured to: detect, via the switched fabric circuitry, that a component has been hot-inserted; and assign, with the fabric manager, the hot-inserted component to a first port of the plurality of ports.
Claim 8
Dependent Claim
53 words
The cache coherent switch on chip of claim 6 , wherein the first component is associated with a PCI-to-PCI bridge (PPB), and wherein the assigning the hot-inserted component to the first port comprises: assigning the hot-inserted component to a first virtual hierarchy; and binding a PPB to a first virtual PCI-to-PCI bridge (vPPB).
Claim 9
Dependent Claim
36 words
The cache coherent switch on chip of claim 6 , wherein the processor is further configured to: perform diagnostics on the component, wherein the assigning the component to the first port is based on the diagnostics.
Claim 10
Dependent Claim
65 words
The cache coherent switch on chip of claim 1 , wherein the plurality of ports is communicatively coupled to a plurality of devices, each of the plurality of devices comprising a device cache, and wherein the microprocessor is configured to: determine, based on the plurality of devices, a cache priority for the plurality of devices; and manipulate the device caches according to the cache priority.
Claim 11
Dependent Claim
27 words
The cache coherent switch on chip of claim 9 , wherein the manipulating the device caches comprises one or more of fetching, reading, or writing cache data.
Claim 12
Dependent Claim
86 words
The cache coherent switch on chip of claim 9 , wherein the microprocessor is further configured to: cache first data with at least one of the device caches; receive a request for the first data, the request comprising tag RAM; perform, through the tag RAM, a look-up for the first data of all of the plurality of device caches; determine, based on the look-up, the cache location of the first data within the plurality of device caches; access the first data; and provide the first data.
Claim 13
Dependent Claim
63 words
The cache coherent switch on chip of claim 1 , further comprising: a machine learning memory prefetcher, configured to predict addresses of access to memory coupled to one or more of the plurality of ports and prefetch data from the memory, wherein the prediction is based on an identity of applications communicatively coupled to the one or more of the plurality of ports.
Claim 14
Dependent Claim
31 words
The cache coherent switch on chip of claim 1 , wherein the fabric manager is configured to communicate with a management software entity and receive instructions from the management software entity.
Claim 15
Dependent Claim
28 words
The cache coherent switch on chip of claim 1 , wherein the associated component is one of a memory, an accelerator, an application specific integrated circuit, and/or storage.
Claim 16
Dependent Claim
15 words
The cache coherent switch on chip of claim 1 , further comprising: the associated component.
Claim 17
Independent Claim
155 words
A system comprising: a first server device comprising: a first memory device; and a first cache coherent switch on chip, communicatively coupled to the first memory device, wherein the first cache coherent switch on chip comprises: a plurality of ports, each port configured to communicatively couple to an associated component of a plurality of components and configured to support a Compute Express Link (CXL) protocol; switched fabric circuitry, communicatively coupled to the plurality of ports and comprising: switched fabric circuitry configured in a mesh network comprising a plurality of nodes; and a microprocessor, communicatively coupled to the switched fabric circuitry and comprising: a fabric manager, configured to allocate and/or deallocate resources to one or more of the plurality of ports; wherein the cache coherent switch on chip is configured to share resources between the plurality of components utilizing the CXL protocol over a CXL interface while bypassing a central processing unit to share the resources.
Claim 18
Independent Claim
155 words
A system comprising: a first server device comprising: a first memory device; and a first cache coherent switch on chip, communicatively coupled to the first memory device, wherein the first cache coherent switch on chip comprises: a plurality of ports, each port configured to communicatively couple to an associated component of a plurality of components and configured to support a Compute Express Link (CXL) protocol; switched fabric circuitry, communicatively coupled to the plurality of ports and comprising: switched fabric circuitry configured in a mesh network comprising a plurality of nodes; and a microprocessor, communicatively coupled to the switched fabric circuitry and comprising: a fabric manager, configured to allocate and/or deallocate resources to one or more of the plurality of ports; wherein the cache coherent switch on chip is configured to share resources between the plurality of components utilizing the CXL protocol over a CXL interface while bypassing a central processing unit to share the resources.
Claim 19
Dependent Claim
101 words
The system of claim 16 , wherein the first cache coherent switch on chip further comprises a Random Access Memory (RAM) module, and wherein the system further comprises: a DDR module communicatively coupled to the first cache coherent switch on chip via at least a first port of the plurality of ports; persistent memory communicatively coupled to the first cache coherent switch on chip via at least a second port of the plurality of ports; and a solid state drive communicatively coupled to the first cache coherent switch on chip via at least a third port of the plurality of ports.
Claim 20
Dependent Claim
18 words
The system of claim 17 , wherein the DDR module is external memory communicatively coupled via switch fabric.
Claim 21
Dependent Claim
20 words
The system of claim 17 , wherein the DDR module comprises DDR4 or DDR5 Synchronous Dynamic Random Access Memory (SDRAM).
Claim 22
Dependent Claim
40 words
The system of claim 16 , further comprising: a second server device, communicatively coupled to the first server device via a data connection, the second server device comprising: a second memory device; and a second cache coherent switch on chip.
References Cited (Backward Citations)
US20150169452A1
Cited
US20160299860A1
Cited
US20160381176A1
Cited
US20200341930A1
Cited
US20220124038A1
Cited
US20210011755A1
Cited
US20200192798A1
Cited
US20210132999A1
Cited
US20210320866A1
Cited
US11388268B1
Cited
US20210311739A1
Cited
US20210311646A1
Cited
US20210318976A1
Cited
US20210382838A1
Cited
US11573898B2
Cited
US20220147476A1
Cited
US20210240655A1
Cited
US20210075633A1
Cited
US20220164288A1
Cited
US20210117244A1
Cited
US20220350767A1
Cited
US20220398207A1
Cited
US20220405212A1
Cited
US20230017583A1
Cited
US20230012822A1
Cited
US20230017643A1
Cited
US20230409302A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2027-04-02 | 2027-10-02 | 2028-04-02 | $2000.00 | Pending Window |
| 7.5 Years (Year 8) | 2031-04-02 | 2031-10-02 | 2032-04-02 | $3760.00 | Pending Window |
| 11.5 Years (Year 12) | 2035-04-02 | 2035-10-02 | 2036-04-02 | $7700.00 | Pending Window |