US5455924A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus and method for partial execution blocking of instructions following a data cache miss
Assignee: Intel Corp
•
Filing: 1993-02-09
•
Granted: 1995-10-03
•
Expires: 2013-02-09
Abstract
Abstract A partially blocking data cache having improved microprocessor performance while maintaining data consistency between external memory and cache memory. The data cache of the present invention is used in a computer system and is partially blocking in that this cache will block the execution of any store instructions subsequent to an outstanding load instruction that missed the cache. The present invention offers increased microprocessor efficiency by allowing execution of subsequent load instructions while less than a predetermined number of preceding load instructions are still outstanding. The present invention utilizes a counter within the data cache unit to track the number of outstanding load misses. The present invention provides increased performance without undue or overly complex modifications to existing caching systems. The present invention operates advantageously within a computer system having a relatively large number of registers associated with the microprocessor such that store instructions represent a relatively small number of the instructions executed by the microprocessor.
Inventors
- 👤 Sunil R. Shenoy
- 👤 James W. Wong
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 07:24
CPC Classifications
G; G06; G06F; G06F9/00; G06F9/06; G06F9/30; G06F9/38; G06F9/3836; G06F12/00; G06F12/02; G06F12/08; G06F12/0802; G06F12/0844; G06F12/0855; G06F12/0859
Claims Analysis
Total Claims: 70
Claim 1
Independent Claim
139 words
A cache memory apparatus for use with a microprocessor that processes a plurality of instructions having associated data, said apparatus comprising: cache memory means for providing high speed memory cache operations with said microprocessor; miss indicating means for generating a miss indication associated with each instruction of said plurality of instructions having an associated data address which is not accessible by said cache memory means, said each instruction called a cache miss instruction; and selecting means for temporarily blocking said microprocessor from processing a first instruction type of said plurality of instructions that follows said miss indication from said miss indicating means, said selecting means also for allowing processing of a second instruction type of said plurality of instructions that follows said miss indication from said miss indicating means, said selecting means communicatively coupled to said miss indicating means.
Claim 2
Dependent Claim
139 words
A cache memory apparatus for use with a microprocessor that processes a plurality of instructions having associated data, said apparatus comprising: cache memory means for providing high speed memory cache operations with said microprocessor; miss indicating means for generating a miss indication associated with each instruction of said plurality of instructions having an associated data address which is not accessible by said cache memory means, said each instruction called a cache miss instruction; and selecting means for temporarily blocking said microprocessor from processing a first instruction type of said plurality of instructions that follows said miss indication from said miss indicating means, said selecting means also for allowing processing of a second instruction type of said plurality of instructions that follows said miss indication from said miss indicating means, said selecting means communicatively coupled to said miss indicating means.
Claim 3
Dependent Claim
19 words
A cache memory apparatus as described in claim 1 wherein said first instruction type is a store instruction type.
Claim 4
Dependent Claim
19 words
A cache memory apparatus as described in claim 2 wherein said second instruction type is a load instruction type.
Claim 5
Dependent Claim
43 words
A cache memory apparatus as described in claim 1 further comprising: external memory means for storage and retrieval of information compatible with said cache memory means; and cache miss processing means for processing each cache miss instruction by accessing said external memory means.
Claim 6
Dependent Claim
28 words
A cache memory apparatus as described in claim 4 further comprising means for signaling whether said cache miss processing means is required to process any cache miss instruction.
Claim 7
Dependent Claim
54 words
A cache memory apparatus as described in claim 5 wherein said means for signaling comprises counting means for incrementing on each of said miss indication generated by said miss indication means and said counting means for decrementing upon execution completion of each of said cache miss instruction processed by said cache miss processing means.
Claim 8
Dependent Claim
37 words
A cache memory apparatus as described in claim 4 wherein said selecting means temporarily blocks said microprocessor from executing said first instruction type while said cache miss processing means is required to process any cache miss instruction
Claim 9
Dependent Claim
59 words
A cache memory apparatus as described in claim 1 further comprising: external memory means for storage and retrieval of information compatible with said cache memory means; and cache miss processing means for processing said each cache miss instruction by accessing said external memory means, said cache miss processing means further comprising a queue for storing pending cache miss instructions.
Claim 10
Dependent Claim
67 words
A cache memory apparatus as described in claim 8 wherein said first instruction type is a load instruction and wherein said selecting means blocks said microprocessor from processing said load instruction if said queue is full and wherein said second instruction type is also a load instruction and said selecting means does not block said microprocessor from processing said load instruction if said queue is not full.
Claim 11
Dependent Claim
34 words
A cache memory apparatus as described in claim 6 wherein said cache memory means comprises a data cache memory array of approximately 1k bytes and wherein said counting means is a two bit counter.
Claim 12
Dependent Claim
118 words
A cache apparatus for use with a microprocessor, said microprocessor processing a plurality of instructions each having associated data, said apparatus comprising: cache memory means for high speed data storage and retrieval for said microprocessor; first processing means for executing cache miss instructions each having an associated data address that is not accessible by said cache memory means; and stalling means for temporarily preventing said microprocessor from executing a first instruction type while one or more of said cache miss instructions are pending before said first processing means, said stalling means also for allowing said microprocessor to execute a second instruction type while one or more of said cache miss instructions are pending before said first processing means.
Claim 13
Dependent Claim
118 words
A cache apparatus for use with a microprocessor, said microprocessor processing a plurality of instructions each having associated data, said apparatus comprising: cache memory means for high speed data storage and retrieval for said microprocessor; first processing means for executing cache miss instructions each having an associated data address that is not accessible by said cache memory means; and stalling means for temporarily preventing said microprocessor from executing a first instruction type while one or more of said cache miss instructions are pending before said first processing means, said stalling means also for allowing said microprocessor to execute a second instruction type while one or more of said cache miss instructions are pending before said first processing means.
Claim 14
Dependent Claim
46 words
A cache apparatus as described in claim 11 further comprising storage means for indicating if any of said cache miss instructions are pending before said first processing means, said storage means communicatively coupled to said stalling means and also communicatively coupled to said first processing means.
Claim 15
Dependent Claim
17 words
A cache apparatus as described in claim 11 wherein said first instruction type is a store instruction.
Claim 16
Dependent Claim
17 words
A cache apparatus as described in claim 11 wherein said second instruction type is a load instruction.
Claim 17
Dependent Claim
27 words
A cache apparatus as described in claim 11 wherein said first instruction type is a store instruction and wherein said second instruction type is a load instruction.
Claim 18
Dependent Claim
38 words
A cache apparatus as described in claim 13 wherein said stalling means temporarily prevents said microprocessor from executing said store instruction until said storage means indicates that no cache miss instructions are pending before said first processing means.
Claim 19
Dependent Claim
39 words
A cache apparatus as described in claim 15 wherein said stalling means temporarily prevents said microprocessor from executing said store instruction until said storage means indicates that no cache miss load instructions are pending before said first processing means.
Claim 20
Dependent Claim
44 words
A cache apparatus as described in claim 15 wherein said stalling means temporarily prevents said microprocessor from executing said load instruction until said storage means indicates that less than a maximum number of cache miss load instructions are pending before said first processing means.
Claim 21
Dependent Claim
46 words
A cache apparatus as described in claim 12 wherein said first processing means comprises completion means for indicating to said storage means that a cache miss instruction is completely processed by said first processing means and is therefore no longer pending before said first processing means.
Claim 22
Dependent Claim
46 words
A cache apparatus as described in claim 12 further comprising: miss indicating means for generating a miss indication associated with each microprocessor instruction having an associated data address which is not accessible by said cache memory means, said miss indicating means coupled to said storage means.
Claim 23
Dependent Claim
46 words
A cache apparatus as described in claim 19 further comprising: miss indicating means for generating a miss indication associated with each microprocessor instruction having an associated data address which is not accessible by said cache memory means, said miss indicating means coupled to said storage means.
Claim 24
Dependent Claim
19 words
A cache apparatus as described in claim 18 wherein said maximum number of cache miss load instructions is three.
Claim 25
Dependent Claim
24 words
A cache apparatus as described in claim 12 wherein said storage means is a logical counter having an increment input and a decrement input.
Claim 26
Dependent Claim
93 words
A cache apparatus as described in claim 21 wherein: said cache memory means is a logical memory array; said storage means is a logical counter having an increment input and a decrement input; said miss indicating means increments said logical counter upon each miss indication, said miss indicating means coupled to said increment input of said logical counter; and wherein said completion means decrements said logical counter upon each cache miss instruction that is completely processed by said first processing means, said completion means coupled to said decrement input of said logical counter.
Claim 27
Dependent Claim
126 words
A cache apparatus for use with a microprocessor, said microprocessor processing a plurality of instructions each having associated data, said apparatus comprising: cache memory army for providing high speed memory cache operations with said microprocessor; first processing means for executing preceding cache miss load instructions each having an associated data address that is not accessible by said cache memory array; and stalling means for temporarily preventing said microprocessor from executing a subsequent store instruction while one or more of said preceding cache miss load instructions are pending before said first processing means, said stalling means also for allowing said microprocessor to execute a subsequent load instruction while less than a predetermined number of said preceding cache miss load instructions are pending before said first processing means.
Claim 28
Dependent Claim
126 words
A cache apparatus for use with a microprocessor, said microprocessor processing a plurality of instructions each having associated data, said apparatus comprising: cache memory army for providing high speed memory cache operations with said microprocessor; first processing means for executing preceding cache miss load instructions each having an associated data address that is not accessible by said cache memory array; and stalling means for temporarily preventing said microprocessor from executing a subsequent store instruction while one or more of said preceding cache miss load instructions are pending before said first processing means, said stalling means also for allowing said microprocessor to execute a subsequent load instruction while less than a predetermined number of said preceding cache miss load instructions are pending before said first processing means.
Claim 29
Dependent Claim
73 words
A cache apparatus as described in claim 25 further comprising: storage means for indicating if any of said preceding cache miss load instructions are pending before said first processing means, said storage means communicatively coupled to said stalling means and also communicatively coupled to said first processing means; and miss indicating means for generating a miss indication associated with each cache miss load instruction, said miss indicating means coupled to said storage means.
Claim 30
Dependent Claim
47 words
A cache apparatus as described in claim 26 wherein said first processing means comprises completion means for indicating to said storage means that a cache miss load instruction is completely processed by said first processing means and is therefore no longer pending before said first processing means.
Claim 31
Dependent Claim
84 words
A cache apparatus as described in claim 27 wherein: said storage means is a logical counter having an increment input and a decrement input; said miss indicating means increments said logical counter upon each miss indication, said miss indicating means coupled to said increment input of said logical counter; and said completion means decrements said logical counter upon each cache miss load instruction that is completely processed by said first processing means, said completion means coupled to said decrement input of said logical counter.
Claim 32
Dependent Claim
146 words
A cache apparatus for use with a microprocessor, said microprocessor processing a plurality of instructions each having associated data, said apparatus comprising: cache memory array for high speed memory operations with said microprocessor; bus control logic executing cache miss instructions each having an associated data address that is not accessible by said cache memory array, said bus control logic further comprising a queue for containing any of said cache miss instructions that are pending before said bus control logic; and gating logic asserting a stall signal to temporarily prevent said microprocessor from executing a first instruction type while one or more of said cache miss instructions are pending before said bus control logic, said gating logic deasserting said stall signal to allow said microprocessor to execute a second instruction type while one or more of said cache miss instructions are pending before said bus control logic.
Claim 33
Dependent Claim
146 words
A cache apparatus for use with a microprocessor, said microprocessor processing a plurality of instructions each having associated data, said apparatus comprising: cache memory array for high speed memory operations with said microprocessor; bus control logic executing cache miss instructions each having an associated data address that is not accessible by said cache memory array, said bus control logic further comprising a queue for containing any of said cache miss instructions that are pending before said bus control logic; and gating logic asserting a stall signal to temporarily prevent said microprocessor from executing a first instruction type while one or more of said cache miss instructions are pending before said bus control logic, said gating logic deasserting said stall signal to allow said microprocessor to execute a second instruction type while one or more of said cache miss instructions are pending before said bus control logic.
Claim 34
Dependent Claim
48 words
A cache apparatus as described in claim 29 further comprising a logical counter for indicating the number of said cache miss instructions that are pending before said bus control logic, said logical counter communicatively coupled to said gating logic and also communicatively coupled to said bus control logic.
Claim 35
Dependent Claim
17 words
A cache apparatus as described in claim 29 wherein said first instruction type is a store instruction.
Claim 36
Dependent Claim
17 words
A cache apparatus as described in claim 31 wherein said second instruction type is a load instruction.
Claim 37
Dependent Claim
38 words
A cache apparatus as described in claim 32 wherein said gating logic temporarily prevents said microprocessor from executing said store instruction until said logical counter indicates that no cache miss instructions are pending before said bus control logic.
Claim 38
Dependent Claim
44 words
A cache apparatus as described in claim 32 wherein said gating logic temporarily prevents said microprocessor from executing said load instruction until said logical counter indicates that less than a maximum number of cache miss load instructions are pending before said bus control logic.
Claim 39
Dependent Claim
42 words
A cache apparatus as described in claim 32 wherein said bus control logic asserts a digital fill signal indicating to said logical counter that a cache miss instruction is completely processed by said bus control logic and is therefore no longer pending.
Claim 40
Dependent Claim
43 words
A cache apparatus as described in claim 35 further comprising: comparator logic asserting a miss signal associated with each microprocessor instruction having an associated data address which is not accessible by said cache memory array, said comparator logic coupled to said logic counter.
Claim 41
Dependent Claim
20 words
A cache apparatus as described in claim 32 wherein said logical counter includes an increment input and a decrement input.
Claim 42
Dependent Claim
83 words
A cache apparatus as described in claim 36 wherein: said logical counter includes an increment input and a decrement input; said miss signal of said comparator logic increments said logical counter upon each miss indication, said miss signal communicatively coupled to said increment input of said logical counter; and said digital fill signal of said bus control logic decrements said logical counter upon completion of each pending cache miss instruction, said digital fill signal communicatively coupled to decrement input of said logical counter.
Claim 43
Independent Claim
124 words
A method for partial execution blocking a microprocessor by a cache unit, said microprocessor for processing a plurality of instructions each having associated data, said method comprising the steps of: providing a cache memory array for providing high speed memory cache operations with said microprocessor; performing a first execution step by executing cache miss instructions each having an associated data address that is not accessible by said cache memory array; temporarily preventing said microprocessor from executing a first instruction type while one or more of said cache miss instructions are pending before said first execution step; and allowing said microprocessor to execute a second instruction type while less than a predetermined number of said cache miss instructions am pending before said first execution step.
Claim 44
Independent Claim
124 words
A method for partial execution blocking a microprocessor by a cache unit, said microprocessor for processing a plurality of instructions each having associated data, said method comprising the steps of: providing a cache memory array for providing high speed memory cache operations with said microprocessor; performing a first execution step by executing cache miss instructions each having an associated data address that is not accessible by said cache memory array; temporarily preventing said microprocessor from executing a first instruction type while one or more of said cache miss instructions are pending before said first execution step; and allowing said microprocessor to execute a second instruction type while less than a predetermined number of said cache miss instructions am pending before said first execution step.
Claim 45
Dependent Claim
28 words
A method as described in claim 39 further comprising the step of indicating a number of said cache miss instructions that are pending before said first execution step.
Claim 46
Dependent Claim
16 words
A method as described in claim 40 wherein said first instruction type is a store instruction.
Claim 47
Dependent Claim
16 words
A method as described in claim 41 wherein said second instruction type is a load instruction.
Claim 48
Dependent Claim
40 words
A method as described in claim 42 wherein said step of temporarily preventing said microprocessor from executing said store instruction operates until said step of indicating indicates that no cache miss load instructions are pending before said first execution step.
Claim 49
Dependent Claim
43 words
A method as described in claim 42 wherein said step of allowing said microprocessor to execute a second instruction type operates until said step of indicating indicates that a maximum number of cache miss load instructions are pending before said first execution step.
Claim 50
Dependent Claim
52 words
A method as described in claim 40 further comprising the step of asserting a signal each time a cache miss instruction is completely processed by said first execution step so that said step of indicating may update said number of said cache miss instructions that are pending before said first execution step.
Claim 51
Dependent Claim
59 words
A method as described in claim 40 further comprising the step of: generating a miss indication signal associated with each microprocessor instruction having an associated data address which is not accessible by said cache memory array so that said step of indicating may update said number of said cache miss instructions that are pending before said first execution step.
Claim 52
Dependent Claim
59 words
A method as described in claim 46 further comprising the step of: generating a miss indication signal associated with each microprocessor instruction having an associated data address which is not accessible by said cache memory array so that said step of indicating may update said number of said cache miss instructions that are pending before said first execution step.
Claim 53
Dependent Claim
18 words
A method as described in claim 47 wherein said step of indicating is implemented via a logical counter.
Claim 54
Dependent Claim
188 words
A computer system comprising: a) a bus for providing a common communication pathway; a processor for executing a plurality of instructions each having associated data, said processor coupled to said bus; memory storage unit for storage and retrieval of said data, said memory storage unit coupled to said bus; a display for display of said data; a data input device for inputting data to said computer system; and b) a cache unit for interfacing cache memory with said processor, said cache unit comprising: a cache memory array for providing high speed memory cache operations with said processor; bus control logic for executing cache miss instructions each having an associated data address that is not accessible by said cache memory array, said bus control logic coupled to said bus; and stalling circuitry for temporarily preventing said processor from executing a first instruction type while one or more of said cache miss instructions are pending before said bus control logic, said stalling circuitry also for allowing said processor to execute a second instruction type while one or more of said cache miss instructions are pending before said bus control logic.
Claim 55
Dependent Claim
188 words
A computer system comprising: a) a bus for providing a common communication pathway; a processor for executing a plurality of instructions each having associated data, said processor coupled to said bus; memory storage unit for storage and retrieval of said data, said memory storage unit coupled to said bus; a display for display of said data; a data input device for inputting data to said computer system; and b) a cache unit for interfacing cache memory with said processor, said cache unit comprising: a cache memory array for providing high speed memory cache operations with said processor; bus control logic for executing cache miss instructions each having an associated data address that is not accessible by said cache memory array, said bus control logic coupled to said bus; and stalling circuitry for temporarily preventing said processor from executing a first instruction type while one or more of said cache miss instructions are pending before said bus control logic, said stalling circuitry also for allowing said processor to execute a second instruction type while one or more of said cache miss instructions are pending before said bus control logic.
Claim 56
Dependent Claim
51 words
A computer system including a cache unit as described in claim 49 further comprising a storage device for indicating if any of said cache miss instructions are pending before said bus control logic, said storage device communicatively coupled to said stalling circuitry and also communicatively coupled to said bus control logic.
Claim 57
Dependent Claim
21 words
A computer system including a cache unit as described in claim 49 wherein said first instruction type is a store instruction.
Claim 58
Dependent Claim
21 words
A computer system including a cache unit as described in claim 49 wherein said second instruction type is a load instruction.
Claim 59
Dependent Claim
31 words
A computer system including a cache unit as described in claim 49 wherein said first instruction type is a store instruction and wherein said second instruction type is a load instruction.
Claim 60
Dependent Claim
42 words
A computer system including a cache unit as described in claim 51 wherein said stalling circuitry temporarily prevents said processor from executing said store instruction until said storage device indicates that no cache miss instructions are pending before said bus control logic.
Claim 61
Dependent Claim
43 words
A computer system including a cache unit as described in claim 53 wherein said stalling circuitry temporarily prevents said processor from executing said store instruction until said storage device indicates that no cache miss load instructions are pending before said bus control logic.
Claim 62
Dependent Claim
48 words
A computer system including a cache unit as described in claim 53 wherein said stalling circuitry temporarily prevents said processor from executing said load instruction until said storage device indicates that less than a maximum number of cache miss load instructions are pending before said bus control logic.
Claim 63
Dependent Claim
50 words
A computer system including a cache unit as described in claim 50 wherein said bus control logic comprises completion circuitry for indicating to said storage device that a cache miss instruction is completely processed by said bus control logic and is therefore no longer pending before said bus control logic.
Claim 64
Dependent Claim
49 words
A computer system including a cache unit as described in claim 50 further comprising: miss indicating circuitry for generating a miss indication associated with each instruction having an associated data address which is not accessible by said cache memory array, said miss indicating circuitry coupled to said storage device.
Claim 65
Dependent Claim
49 words
A computer system including a cache unit as described in claim 57 further comprising: miss indicating circuitry for generating a miss indication associated with each instruction having an associated data address which is not accessible by said cache memory army, said miss indicating circuitry coupled to said storage device.
Claim 66
Dependent Claim
23 words
A computer system including a cache unit as described in claim 56 wherein said maximum number of cache miss load instructions is three.
Claim 67
Dependent Claim
28 words
A computer system including a cache unit as described in claim 50 wherein said storage device is a logical counter having an increment input and a decrement input.
Claim 68
Dependent Claim
93 words
A computer system including a cache unit as described in claim 59 wherein: said storage device is a logical counter having an increment input and a decrement input; said miss indicating circuitry includes circuitry to increment said logical counter upon each miss indication, said miss indicating circuitry coupled to said increment input of said logical counter; and said completion circuitry includes circuitry to decrement said logical counter upon each cache miss instruction that is completely processed by said bus control logic, said completion circuitry coupled to said decrement input of said logical counter.
Claim 69
Dependent Claim
150 words
A cache logic apparatus for interfacing a processor and a cache memory array of said cache logic apparatus, said processor sequentially processing a plurality of instructions each having associated data, said apparatus comprising: a cache memory array for providing high speed memory cache operations with said microprocessor, said cache memory army communicatively coupled with said microprocessor; first processing logic for sequentially executing preceding cache miss load instructions each having an associated data address that is not accessible by said cache memory array; and stalling circuitry for temporarily preventing said processor from executing a subsequent store instruction while one or more of said preceding cache miss load instructions are pending before said first processing logic but not yet completely processed by said first processing logic, said stalling circuitry also for allowing other of said plurality of instructions to execute, said other of said plurality of instructions being other than store instructions.
Claim 70
Dependent Claim
150 words
A cache logic apparatus for interfacing a processor and a cache memory array of said cache logic apparatus, said processor sequentially processing a plurality of instructions each having associated data, said apparatus comprising: a cache memory array for providing high speed memory cache operations with said microprocessor, said cache memory army communicatively coupled with said microprocessor; first processing logic for sequentially executing preceding cache miss load instructions each having an associated data address that is not accessible by said cache memory array; and stalling circuitry for temporarily preventing said processor from executing a subsequent store instruction while one or more of said preceding cache miss load instructions are pending before said first processing logic but not yet completely processed by said first processing logic, said stalling circuitry also for allowing other of said plurality of instructions to execute, said other of said plurality of instructions being other than store instructions.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-10-02 | 1999-04-03 | 1999-10-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-10-02 | 2003-04-03 | 2003-10-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-10-02 | 2007-04-03 | 2007-10-03 | $7700.00 | Window Closed / Lapsed |