Patent US2547689A successfully refreshed from Google Patents.
Patent US5982937A successfully refreshed from Google Patents.
US5982937A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus and method for hybrid compression of raster data
Assignee: Electronics for Imaging Inc
•
Filing: 1996-12-24
•
Granted: 1999-11-09
•
Expires: 2016-12-24
Abstract
Abstract From a raster page, patches of connected pixels of the same color are identified. Patches of at least a predetermined sized, typically corresponding to text or line art objects, are subjected to a lossless compression. Patches below the predetermined size, typically corresponding to image or photo objects, are substantially subjected to a lossy compression. The patch predetermined size controls the mix of lossless and lossy compression procedures. Optimum compression is achieved by maximizing the lossless compression while attaining a targeted compression ratio. Various features include efficient recognition and encoding of patches, refined treatment of the boundaries between the lossless- and the lossy-compressed pixels, adaptive compression ratio control, and fail-safe compression provisions.
Inventors
- 👤 Yigal Accad
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 12:27
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/41; G; G06; G06T; G06T9/00
Claims Analysis
Total Claims: 64
Claim 1
Independent Claim
189 words
An apparatus for hybrid compression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: a first storage for buffering subarrays of the array of pixels; a patch recognizer operating on individual subarrays and recognizing patches of connected pixels of the same color therein, each patch having a determinable number of pixels; a patch type discriminator separating individual patches into either a first type patch or a second type patch, depending respectively on whether or not the number of pixels in a patch is at least of a predetermined number; a first compressor employing a first encoding procedure to encode pixels of the first type patches into encoded data of a first type; and a second compressor employing a second encoding procedure to encode pixels of the second type patches into encoded data of a second type, thereby allowing the encoded data of the first and second types to be stored in a storage in compressed form, and to be decodeable substantially by inverting the respective encoding procedures to obtain reconstructed pixels of said array.
Claim 2
Independent Claim
189 words
An apparatus for hybrid compression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: a first storage for buffering subarrays of the array of pixels; a patch recognizer operating on individual subarrays and recognizing patches of connected pixels of the same color therein, each patch having a determinable number of pixels; a patch type discriminator separating individual patches into either a first type patch or a second type patch, depending respectively on whether or not the number of pixels in a patch is at least of a predetermined number; a first compressor employing a first encoding procedure to encode pixels of the first type patches into encoded data of a first type; and a second compressor employing a second encoding procedure to encode pixels of the second type patches into encoded data of a second type, thereby allowing the encoded data of the first and second types to be stored in a storage in compressed form, and to be decodeable substantially by inverting the respective encoding procedures to obtain reconstructed pixels of said array.
Claim 3
Dependent Claim
30 words
An apparatus for hybrid compression of raster data as in claim 1, wherein: said first encoding procedure is a lossless encoding; and said second encoding procedure is a lossy encoding.
Claim 4
Dependent Claim
21 words
An apparatus for hybrid compression of raster data as in claim 1, wherein said first encoding procedure includes a run-length encoding.
Claim 5
Dependent Claim
21 words
An apparatus for hybrid compression of raster data as in claim 1, wherein said second encoding procedure includes a transform encoding.
Claim 6
Dependent Claim
111 words
An apparatus for hybrid compression of raster data as in claim 1, further comprising: an adaptive controller that monitors a compression ratio attained by said apparatus at predetermined instants, said compression ratio being given by the number of bits required to store the portion of raster data that has been subject to encoding to date divided by the number of bits required to store the corresponding encoded raster data, said adaptive controller, in a given instant responsive to a comparison between a compression ratio monitored and a targeted compression ratio, adaptively adjusting one or more compression parameters affecting the compression of said second compression procedure for meeting the targeted compression ratio.
Claim 7
Dependent Claim
119 words
An apparatus for hybrid compression of raster data as in claim 1, wherein said apparatus is responsive to a set of compression parameters for attaining a given compression ratio, said compression ratio being given by the number of bits required to store the raster data divided by the number of bits required to store the encoded raster data, said apparatus further comprising: a recompression controller, responsive to an indication that a currently attained compression ratio not meeting a targeted compression ratio, for allowing the encoded raster data to be decoded to the raster data, and allowing said apparatus to recompress the raster data with another set of compression parameters that produces a higher compression ratio than said currently attained.
Claim 8
Dependent Claim
31 words
An apparatus for hybrid compression of raster data as in claim 6, wherein the set of compression parameters includes the predetermined number associated with the number of pixels in a patch.
Claim 9
Dependent Claim
53 words
An apparatus for hybrid compression of raster data as in claim 1, wherein: said first encoding procedure includes a run-length encoding; and said second encoding procedure includes a transform encoding that operates on a plurality of blocks to form transform encoded data, each block being a predefined matrix of pixels of the array.
Claim 10
Dependent Claim
42 words
An apparatus for hybrid compression of raster data as in claim 8, wherein the transform encoding is a JPEG encoding that operates on a plurality of blocks to form JPEG encoded data, each block being an 8×8 pixel block of the array.
Claim 11
Dependent Claim
63 words
An apparatus for hybrid compression of raster data as in claim 8, wherein said patch type discriminator further includes an in-block counter that determines whether or not it is true that a block contains at least a predetermined threshold number of pixels of the second type patches, and if not true, reclassifies and separates these pixels as belonging to the first type patches.
Claim 12
Dependent Claim
50 words
An apparatus for hybrid compression of raster data as in claim 8, wherein for a block that is partially filled with pixels of the second type patches, said block's complement pixels individually have a color value substantially given by averaging the color values of said pixels partially filling the block.
Claim 13
Dependent Claim
91 words
An apparatus for hybrid compression of raster data as in claim 8, wherein: said patch type discriminator also generates position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 14
Dependent Claim
91 words
An apparatus for hybrid compression of raster data as in claim 9, wherein: said patch type discriminator also generates position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 15
Independent Claim
62 words
An apparatus for hybrid compression of raster data as in any one of claims 1 to 13, wherein said apparatus employs a first pass of said first compressor to serve also as said patch recognizer such that said first pass of said first compressor recognizes patches of connected pixels of the same color and also encodes first type patches during the recognition.
Claim 16
Independent Claim
200 words
An apparatus for hybrid compression and decompression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: a first storage for buffering subarrays of the array of pixels; a patch recognizer operating on individual subarrays and recognizing patches of connected pixels of the same color therein, each patch having a determinable number of pixels; a patch type discriminator separating individual patches into either a first type patch or a second type patch, depending respectively on whether or not the number of pixels in a patch is at least of a predetermined number; a first compressor employing a first encoding procedure to encode pixels of the first type patches into encoded data of a first type; and a second compressor employing a second encoding procedure to encode pixels of the second type patches into encoded data of a second type; a second storage for storing the encoded data of the first and second types; and first and second decompressors coupled to said second storage for respectively decoding the encoded data of the first and second types into corresponding pixels of said array to reconstruct the raster data.
Claim 17
Independent Claim
200 words
An apparatus for hybrid compression and decompression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: a first storage for buffering subarrays of the array of pixels; a patch recognizer operating on individual subarrays and recognizing patches of connected pixels of the same color therein, each patch having a determinable number of pixels; a patch type discriminator separating individual patches into either a first type patch or a second type patch, depending respectively on whether or not the number of pixels in a patch is at least of a predetermined number; a first compressor employing a first encoding procedure to encode pixels of the first type patches into encoded data of a first type; and a second compressor employing a second encoding procedure to encode pixels of the second type patches into encoded data of a second type; a second storage for storing the encoded data of the first and second types; and first and second decompressors coupled to said second storage for respectively decoding the encoded data of the first and second types into corresponding pixels of said array to reconstruct the raster data.
Claim 18
Dependent Claim
96 words
An apparatus for hybrid compression and decompression of raster data as in claim 15, wherein: said first decompressor decodes encoded data of the first type into reconstructed pixels of a first type and position tags associated with pixels of a second type; and said second decompressor decodes encoded data of a second type into reconstructed pixels of the second type, such that those reconstructed pixels of the first type and those reconstructed pixels of the second type having an associated position tag are decoded into their respective positions in the array to reconstruct the raster data.
Claim 19
Dependent Claim
32 words
An apparatus for hybrid compression and decompression of raster data as in claim 15, wherein: said first encoding procedure is a lossless encoding; and said second encoding procedure is a lossy encoding.
Claim 20
Dependent Claim
23 words
An apparatus for hybrid compression and decompression of raster data as in claim 15, wherein said first encoding procedure includes a run-length encoding.
Claim 21
Dependent Claim
23 words
An apparatus for hybrid compression and decompression of raster data as in claim 15, wherein said second encoding procedure includes a transform encoding.
Claim 22
Dependent Claim
113 words
An apparatus for hybrid compression and decompression of raster data as in claim 15, further comprising: an adaptive controller that monitors a compression ratio attained by said apparatus at predetermined instants, said compression ratio being given by the number of bits required to store the portion of raster data that has been subject to encoding to date divided by the number of bits required to store the corresponding encoded raster data, said adaptive controller, in a given instant responsive to a comparison between a compression ratio monitored and a targeted compression ratio, adaptively adjusting one or more compression parameters affecting the compression of said second compression procedure for meeting the targeted compression ratio.
Claim 23
Dependent Claim
121 words
An apparatus for hybrid compression and decompression of raster data as in claim 15, wherein said apparatus is responsive to a set of compression parameters for attaining a given compression ratio, said compression ratio being given by the number of bits required to store the raster data divided by the number of bits required to store the encoded raster data, said apparatus further comprising: a recompression controller, responsive to an indication that a currently attained compression ratio not meeting a targeted compression ratio, for allowing the encoded raster data to be decoded to the raster data, and allowing said apparatus to recompress the raster data with another set of compression parameters that produces a higher compression ratio than said currently attained.
Claim 24
Dependent Claim
33 words
An apparatus for hybrid compression and decompression of raster data as in claim 21, wherein the set of compression parameters includes the predetermined number associated with the number of pixels in a patch.
Claim 25
Dependent Claim
55 words
An apparatus for hybrid compression and decompression of raster data as in claim 15, wherein: said first encoding procedure includes a run-length encoding; and said second encoding procedure includes a transform encoding that operates on a plurality of blocks to form transform encoded data, each block being a predefined matrix of pixels of the array.
Claim 26
Dependent Claim
44 words
An apparatus for hybrid compression and decompression of raster data as in claim 23, wherein the transform encoding is a JPEG encoding that operates on a plurality of blocks to form JPEG encoded data, each block being an 8×8 pixel block of the array.
Claim 27
Dependent Claim
65 words
An apparatus for hybrid compression and decompression of raster data as in claim 23, wherein said patch type discriminator further includes an in-block counter that determines whether or not it is true that a block contains at least a predetermined threshold number of pixels of the second type patches, and if not true, reclassifies and separates these pixels as belonging to the first type patches.
Claim 28
Dependent Claim
52 words
An apparatus for hybrid compression and decompression of raster data as in claim 23, wherein for a block that is partially filled with pixels of the second type patches, said block's complement pixels individually have a color value substantially given by averaging the color values of said pixels partially filling the block.
Claim 29
Dependent Claim
93 words
An apparatus for hybrid compression and decompression of raster data as in claim 23, wherein: said patch type discriminator also generates position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 30
Dependent Claim
93 words
An apparatus for hybrid compression and decompression of raster data as in claim 24, wherein: said patch type discriminator also generates position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 31
Independent Claim
64 words
An apparatus for hybrid compression and decompression of raster data as in any one of claims 15 to 28, wherein said apparatus employs a first pass of said first compressor to serve also as said patch recognizer such that said first pass of said first compressor recognizes patches of connected pixels of the same color and also encodes first type patches during the recognition.
Claim 32
Independent Claim
107 words
A method for hybrid compression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: identifying patches of connected pixels of the same color; discriminating whether each patch has a size that belongs to a first or second type, wherein a patch of said first type contains pixels of at least a predetermined number and a patch of said second type contains pixels less than said predetermined number; encoding patches belonging to said first type by a first compression procedure; and encoding patches belonging to said second type by a second compression procedure.
Claim 33
Independent Claim
107 words
A method for hybrid compression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: identifying patches of connected pixels of the same color; discriminating whether each patch has a size that belongs to a first or second type, wherein a patch of said first type contains pixels of at least a predetermined number and a patch of said second type contains pixels less than said predetermined number; encoding patches belonging to said first type by a first compression procedure; and encoding patches belonging to said second type by a second compression procedure.
Claim 34
Dependent Claim
30 words
A method for hybrid compression of raster data as in claim 30, wherein: said first encoding procedure is a lossless encoding; and said second encoding procedure is a lossy encoding.
Claim 35
Dependent Claim
21 words
A method for hybrid compression of raster data as in claim 30, wherein said first encoding procedure includes a run-length encoding.
Claim 36
Dependent Claim
20 words
A method for hybrid compression of raster data as in claim 30, wherein second encoding procedure includes a transform encoding.
Claim 37
Dependent Claim
38 words
A method for hybrid compression of raster data as in claim 30, wherein said predetermined number is such that the raster page is compressed preferentially by said first compression procedure while attaining at least a targeted compression ratio.
Claim 38
Dependent Claim
104 words
A method for hybrid compression of raster data as in claim 30, further comprising: monitoring a compression ratio attained by said method at predetermined instants, said compression ratio being given by the number of bits required to store the portion of raster data that has been subject to encoding to date divided by the number of bits required to store the corresponding encoded raster data, responsive to a comparison between a compression ratio monitored and a targeted compression ratio in a given instant, adaptively adjusting one or more compression parameters affecting the compression of said second compression procedure for meeting the targeted compression ratio.
Claim 39
Dependent Claim
108 words
A method for hybrid compression of raster data as in claim 30, wherein said method is responsive to a set of compression parameters for attaining a given compression ratio, said compression ratio being given by the number of bits required to store the raster data divided by the number of bits required to store the encoded raster data, said method further comprising: responsive to an indication that a currently attained compression ratio not meeting a targeted compression ratio, decoding the encoded raster data to the raster data, and recompressing the raster data with another set of compression parameters that produces a higher compression ratio than said currently attained.
Claim 40
Dependent Claim
31 words
A method for hybrid compression of raster data as in claim 36, wherein the set of compression parameters includes the predetermined number associated with the number of pixels in a patch.
Claim 41
Dependent Claim
53 words
A method for hybrid compression of raster data as in claim 30, wherein: said first encoding procedure includes a run-length encoding; and said second encoding procedure includes a transform encoding that operates on a plurality of blocks to form transform encoded data, each block being a predefined matrix of pixels of the array.
Claim 42
Dependent Claim
42 words
A method for hybrid compression of raster data as in claim 38, wherein the transform encoding is a JPEG encoding that operates on a plurality of blocks to form JPEG encoded data, each block being an 8×8 pixel block of the array.
Claim 43
Dependent Claim
59 words
A method for hybrid compression of raster data as in claim 38, wherein said patch discriminating step further includes determining whether or not it is true that a block contains at least a predetermined threshold number of pixels of the second type patches, and if not true, reclassifying and separating these pixels as belonging to the first type patches.
Claim 44
Dependent Claim
50 words
A method for hybrid compression of raster data as in claim 38, wherein for a block that is partially filled with pixels of the second type patches, said block's complement pixels individually have a color value substantially given by averaging the color values of said pixels partially filling the block.
Claim 45
Dependent Claim
91 words
A method for hybrid compression of raster data as in claim 38, wherein: said patch discriminating step includes generating position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 46
Dependent Claim
91 words
A method for hybrid compression of raster data as in claim 39, wherein: said patch discriminating step includes generating position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 47
Independent Claim
51 words
A method for hybrid compression of raster data as in any one of claims 30 to 43, wherein said method employs a first pass of said first compressing procedure to identify patches of connected pixels of the same color and also to encode first type patches during the identifying of patches.
Claim 48
Dependent Claim
115 words
A method for hybrid compression of raster data as in claim 30, further comprising: providing first and second layers of raster data that individually have a corresponding array of pixels as the raster data; assigning to said first layer pixels from patches belonging to said first type and associated position tags corresponding to pixels from patches belonging to said second type; assigning to said second layer pixels from patches belonging to said second type to said second layer; and forming a representation of the raster data by superposition of first and second layers of raster data; and applying said first compression procedure to said first layer and said second compression procedure to said second layer.
Claim 49
Independent Claim
179 words
A method for hybrid compression and decompression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: buffering subarrays of the array of pixels in a first storage; identifying in individual subarrays patches of connected pixels of the same color, each patch having a determinable number of pixels; discriminating and separating individual patches into either a first type patch or a second type patch, depending respectively on whether or not the number of pixels in a patch is at least of a predetermined number; employing a first encoding procedure to encode pixels of the first type patches into encoded data of a first type; and employing a second encoding procedure to encode pixels of the second type patches into encoded data of a second type; storing the encoded data of the first and second types in a second storage; and decoding the encoded data of the first and second types in the second storage into corresponding pixels of said array to reconstruct the raster data.
Claim 50
Independent Claim
179 words
A method for hybrid compression and decompression of raster data, said raster data being an array of pixels with each pixel representing a color at a position in the array, comprising: buffering subarrays of the array of pixels in a first storage; identifying in individual subarrays patches of connected pixels of the same color, each patch having a determinable number of pixels; discriminating and separating individual patches into either a first type patch or a second type patch, depending respectively on whether or not the number of pixels in a patch is at least of a predetermined number; employing a first encoding procedure to encode pixels of the first type patches into encoded data of a first type; and employing a second encoding procedure to encode pixels of the second type patches into encoded data of a second type; storing the encoded data of the first and second types in a second storage; and decoding the encoded data of the first and second types in the second storage into corresponding pixels of said array to reconstruct the raster data.
Claim 51
Dependent Claim
94 words
A method for hybrid compression and decompression of raster data as in claim 46, wherein: the encoded data of the first type is decoded into reconstructed pixels of a first type and position tags associated with pixels of a second type; and the encoded data of a second type is decoded into reconstructed pixels of the second type, such that those reconstructed pixels of the first type and those reconstructed pixels of the second type having an associated position tag are decoded into their respective positions in the array to reconstruct the raster data.
Claim 52
Dependent Claim
32 words
A method for hybrid compression and decompression of raster data as in claim 46, wherein: said first encoding procedure is a lossless encoding; and said second encoding procedure is a lossy encoding.
Claim 53
Dependent Claim
23 words
A method for hybrid compression and decompression of raster data as in claim 46, wherein said first encoding procedure includes a run-length encoding.
Claim 54
Dependent Claim
23 words
A method for hybrid compression and decompression of raster data as in claim 46, wherein said second encoding procedure includes a transform encoding.
Claim 55
Dependent Claim
106 words
A method for hybrid compression and decompression of raster data as in claim 46, further comprising: monitoring a compression ratio attained by said method at predetermined instants, said compression ratio being given by the number of bits required to store the portion of raster data that has been subject to encoding to date divided by the number of bits required to store the corresponding encoded raster data, responsive to a comparison between a compression ratio monitored and a targeted compression ratio in a given instant, adaptively adjusting one or more compression parameters affecting the compression of said second compression procedure for meeting the targeted compression ratio.
Claim 56
Dependent Claim
110 words
A method for hybrid compression and decompression of raster data as in claim 46, wherein said method is responsive to a set of compression parameters for attaining a given compression ratio, said compression ratio being given by the number of bits required to store the raster data divided by the number of bits required to store the encoded raster data, said method further comprising: responsive to an indication that a currently attained compression ratio not meeting a targeted compression ratio, decoding the encoded raster data to the raster data, and recompressing the raster data with another set of compression parameters that produces a higher compression ratio than said currently attained.
Claim 57
Dependent Claim
33 words
A method for hybrid compression and decompression of raster data as in claim 52, wherein the set of compression parameters includes the predetermined number associated with the number of pixels in a patch.
Claim 58
Dependent Claim
55 words
A method for hybrid compression and decompression of raster data as in claim 46, wherein: said first encoding procedure includes a run-length encoding; and said second encoding procedure includes a transform encoding that operates on a plurality of blocks to form transform encoded data, each block being a predefined matrix of pixels of the array.
Claim 59
Dependent Claim
44 words
A method for hybrid compression and decompression of raster data as in claim 54, wherein the transform encoding is a JPEG encoding that operates on a plurality of blocks to form JPEG encoded data, each block being an 8×8 pixel block of the array.
Claim 60
Dependent Claim
61 words
A method for hybrid compression and decompression of raster data as in claim 54, wherein said patch discriminating step further includes determining whether or not it is true that a block contains at least a predetermined threshold number of pixels of the second type patches, and if not true, reclassifying and separating these pixels as belonging to the first type patches.
Claim 61
Dependent Claim
52 words
A method for hybrid compression and decompression of raster data as in claim 54, wherein for a block that is partially filled with pixels of the second type patches, said block's complement pixels individually have a color value substantially given by averaging the color values of said pixels partially filling the block.
Claim 62
Dependent Claim
93 words
A method for hybrid compression and decompression of raster data as in claim 54, wherein: said patch discriminating step includes generating position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 63
Dependent Claim
93 words
A method for hybrid compression and decompression of raster data as in claim 55, wherein: said patch discriminating step includes generating position tags associated with pixels of the second type patches, said position tags being directed to said first compressor to be encoded by the first encoding procedure; and such that when the encoded data of the first and second type are decoded into reconstructed pixels, the raster data is reconstructed from those reconstructed pixels of the first type patches and those reconstructed pixels of the second type patches having associated position tags.
Claim 64
Independent Claim
53 words
A method for hybrid compression and decompression of raster data as in any one of claims 46 to 59, wherein said method employs a first pass of said first compressing procedure to identify patches of connected pixels of the same color and also to encode first type patches during the identifying of patches.
References Cited (Backward Citations)
EP0286286A1
Cited
US5151949A
Cited
US5796864A
Cited
US5479587A
Cited
JPH06153172A
Cited
EP0597571A2
Cited
EP0691784A2
Cited
EP0712088A2
Cited
WO1996015620A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-11-08 | 2003-05-10 | 2003-11-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-11-08 | 2007-05-10 | 2007-11-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-11-08 | 2011-05-10 | 2011-11-09 | $7700.00 | Window Closed / Lapsed |