US5991444A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for performing mosaic based image compression
Assignee: Sarnoff Corp
•
Filing: 1997-06-25
•
Granted: 1999-11-23
•
Expires: 2017-06-25
Abstract
Abstract A system for automatically generating a mosaic from a plurality of input images. The system sequentially executes an image alignment process, an editing process, and a combining process such that, from a sequence of images, the system automatically produces a seamless mosaic for various applications. Illustrative applications for the mosaic include: (1) a mosaic based display system including an image printing system, (2) a surveillance system and (3) a mosaic based compression system. The mosaic based display system permits a system user to display, manipulate and alter a mosaic. The mosaic based compression system exploits the temporal and spatial redundancy in image sequences and efficiently compresses the image information. The compression system can be used for compressing image information for storage in a storage device or can be used for compressing image information for transmission through a band-limited transmission channel. The surveillance system combines the mosaic construction system, the compression system and the display system into a comprehensive system for remote motion detection.
Inventors
- 👤 Peter J. Burt
- 👤 Michal Irani
- 👤 Stephen Charles Hsu
- 👤 Padmanabhan Anandan
- 👤 Michael W. Hansen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:44
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/20; G06T; G06T3/00; G06T3/40; G06T3/4038; G06T11/00; G06V10/24; H; H04; H04N; H04N19/00; H04N19/20; H04N19/23; H04N19/50; H04N19/503; H04N19/60; H04N19/61; H04N19/63; H04N9/00; H04N9/79; H04N9/80; H04N9/804; H04N9/8042; H04N9/8047; G06V10/10; G06V10/16; H04N19/30; H04N5/00; H04N5/76; H04N5/78; H04N5/781; H04N5/84; H04N5/85
Claims Analysis
Total Claims: 32
Claim 1
Independent Claim
123 words
A data storage system for compressing image information for storage in a storage device, said system comprising: means for dividing a series of images into a plurality of subsequences of images; a batch sequencer, connected to said dividing means, for batch sequencing each of said subsequences of images to align each image in each of said subsequences with a reference coordinate system and to combine each aligned image with other aligned images in each of said subsequences to generate a static mosaic, transformation parameters and residuals; a coder, connected to said batch sequencing means, for coding said static mosaic, said alignment parameters and said residuals; storage means, connected to said coder, for storing said coded static mosaic, coded transformation parameters and coded residuals.
Claim 2
Dependent Claim
123 words
A data storage system for compressing image information for storage in a storage device, said system comprising: means for dividing a series of images into a plurality of subsequences of images; a batch sequencer, connected to said dividing means, for batch sequencing each of said subsequences of images to align each image in each of said subsequences with a reference coordinate system and to combine each aligned image with other aligned images in each of said subsequences to generate a static mosaic, transformation parameters and residuals; a coder, connected to said batch sequencing means, for coding said static mosaic, said alignment parameters and said residuals; storage means, connected to said coder, for storing said coded static mosaic, coded transformation parameters and coded residuals.
Claim 3
Dependent Claim
70 words
The system of claim 1 wherein said coder further comprises: a residual analyzer for comparing an image from the mosaic to an image from said subsequence of images and generating residuals in response to said comparison; a significance analyzer for selecting particular residuals for coding; a transformation parameters coder for coding the transformation parameters; a mosaic coder for coding the mosaic; and a residuals coder for coding the selected residuals.
Claim 4
Dependent Claim
33 words
The system of claim 1 further comprising a decoder for retrieving and decoding said coded mosaic, said coded transformation parameters and said coded residuals to reconstruct said images in said subsequence of images.
Claim 5
Dependent Claim
128 words
A communication system for compressing image information for transmission, said mosaic based compression system comprising: means for aligning an input image to a predicted mosaic; means for combining said aligned input image with said predicted mosaic to create a reference mosaic; a residual analyzer, connected to said combining means, for comparing said input image to said reference mosaic and generating residuals in response to said comparison; a significance analyzer, connected to said residual analyzer, for selecting particular residuals for coding; a codec, connected to said significance analyzer, for coding said selected residuals; a transmitter, coupled to said codec, for transmitting said coded residuals through transmission channel; and a receiver, coupled to said transmission channel, for receiving said coded residuals and constructing a received mosaic containing said input image.
Claim 6
Dependent Claim
128 words
A communication system for compressing image information for transmission, said mosaic based compression system comprising: means for aligning an input image to a predicted mosaic; means for combining said aligned input image with said predicted mosaic to create a reference mosaic; a residual analyzer, connected to said combining means, for comparing said input image to said reference mosaic and generating residuals in response to said comparison; a significance analyzer, connected to said residual analyzer, for selecting particular residuals for coding; a codec, connected to said significance analyzer, for coding said selected residuals; a transmitter, coupled to said codec, for transmitting said coded residuals through transmission channel; and a receiver, coupled to said transmission channel, for receiving said coded residuals and constructing a received mosaic containing said input image.
Claim 7
Dependent Claim
27 words
The mosaic based compression system of claim 4 further comprising: a decoder, connected to said codec, for decoding said coded selected residuals and creating said predicted mosaic.
Claim 8
Dependent Claim
83 words
A mosaic based compression system for compressing image information within a series of images, said system comprising: an image processor for aligning each image of said series of images with a reference coordinate system and for combining each aligned image with other aligned images to generate a mosaic and transformation parameters; a coder, connected to said image processor, for coding said mosaic and said transformation parameters to produce data that is a compressed representation of image information contained in said series of images.
Claim 9
Dependent Claim
83 words
A mosaic based compression system for compressing image information within a series of images, said system comprising: an image processor for aligning each image of said series of images with a reference coordinate system and for combining each aligned image with other aligned images to generate a mosaic and transformation parameters; a coder, connected to said image processor, for coding said mosaic and said transformation parameters to produce data that is a compressed representation of image information contained in said series of images.
Claim 10
Dependent Claim
73 words
The mosaic based compression system of claim 6 wherein said coder further comprises: a residual analyzer for comparing an image from the mosaic to an image from said subsequence of images and generating residuals in response to said comparison; a significance analyzer for selecting particular residuals for coding; a transformation parameters coder for coding the transformation parameters; a mosaic coder for coding the mosaic; and a residuals coder for coding the selected residuals.
Claim 11
Dependent Claim
36 words
The mosaic based compression system of claim 7 further comprising a decoder for retrieving and decoding said coded mosaic, said coded transformation parameters and said coded residuals to reconstruct said images in said sequence of images.
Claim 12
Dependent Claim
25 words
The mosaic based compression system of claim 6 wherein said coder does not code any residuals to form a compressed image sequence that is time-invariant.
Claim 13
Dependent Claim
15 words
The mosaic based compression system of claim 6 wherein said mosaic is a static mosaic.
Claim 14
Dependent Claim
15 words
The mosaic based compression system of claim 6 wherein said mosaic is a dynamic mosaic.
Claim 15
Dependent Claim
32 words
The mosaic based compression system of claim 6 wherein said mosaic is selected from one of a plurality of mosaics, where each mosaic in said plurality of mosaics represents a scene layer.
Claim 16
Dependent Claim
29 words
The mosaic based compression system of claim 12 wherein a scene layer represents a planar region of an imaged scene containing objects at a particular depth within the scene.
Claim 17
Dependent Claim
42 words
The mosaic based compression system of claim 13 wherein at least one scene layer contains background information that is used to form a static mosaic and at least one scene layer contains foreground information that is used to form a dynamic mosaic.
Claim 18
Dependent Claim
26 words
The mosaic based compression system of claim 6 wherein said image processor produces residual parallax motion information and said coder codes said residual parallax motion information.
Claim 19
Dependent Claim
113 words
A mosaic based compression system for compressing image information using a dynamic mosaic, said mosaic based compression system comprising: an image processor for aligning an input image to a predicted mosaic and for combining said aligned input image with said predicted mosaic to create a reference mosaic; a residual analyzer, connected to said image processor, for comparing said input image to said reference mosaic and generating residuals in response to said comparison; a significance analyzer, connected to said residual analyzer, for selecting particular residuals for coding; a codec, connected to said significance analyzer, for coding said selected residuals to form data containing compressed image information from said input image and said predicted mosaic.
Claim 20
Dependent Claim
113 words
A mosaic based compression system for compressing image information using a dynamic mosaic, said mosaic based compression system comprising: an image processor for aligning an input image to a predicted mosaic and for combining said aligned input image with said predicted mosaic to create a reference mosaic; a residual analyzer, connected to said image processor, for comparing said input image to said reference mosaic and generating residuals in response to said comparison; a significance analyzer, connected to said residual analyzer, for selecting particular residuals for coding; a codec, connected to said significance analyzer, for coding said selected residuals to form data containing compressed image information from said input image and said predicted mosaic.
Claim 21
Dependent Claim
27 words
The mosaic based compression system of claim 16 further comprising: a decoder, connected to said codec, for decoding said coded selected residuals and creating said predicted mosaic.
Claim 22
Dependent Claim
44 words
The mosaic based compression system of claim 16 wherein said image processor further comprises: means for producing a temporal pyramid for said input image and said predicted mosaic; and means for aligning said input image and said predicted mosaic on a pyramid level-by-level basis.
Claim 23
Dependent Claim
15 words
The mosaic based compression system of claim 18 wherein only residuals between levels are coded.
Claim 24
Dependent Claim
32 words
The mosaic based compression system of claim 16 wherein said mosaic is selected from one of a plurality of mosaics, where each mosaic in said plurality of mosaics represents a scene layer.
Claim 25
Dependent Claim
29 words
The mosaic based compression system of claim 20 wherein a scene layer represents a planar region of an imaged scene containing objects at a particular depth within the scene.
Claim 26
Dependent Claim
42 words
The mosaic based compression system of claim 21 wherein at least one scene layer contains background information that is used to form a static mosaic and at least one scene layer contains foreground information that is used to form a dynamic mosaic.
Claim 27
Dependent Claim
26 words
The mosaic based compression system of claim 16 wherein said image processor produces residual parallax motion information and said coder codes said residual parallax motion information.
Claim 28
Dependent Claim
45 words
The mosaic based compression system of claim 16 further comprising: means for storing each original image that is used to form said predicted mosaic; and means for selectively recalling each original image to use to form said predicted mosaic for aligning with said input image.
Claim 29
Dependent Claim
82 words
The mosaic based compression system of claim 16 further comprising: means for storing each original image that is used to form said predicted mosaic; and means for tiling said mosaic into a plurality of tiles; means for selecting original image information from said original image corresponding to each tile whenever said input image corresponds to a particular tile; means for selectively recalling original image information corresponding to said tile to use to form said predicted mosaic for aligning with said input image.
Claim 30
Independent Claim
67 words
A method of compressing image information within a series of images comprising the steps of: aligning each image within said series of images with a reference coordinate system; combining each aligned image with other aligned images to generate a mosaic and transformation parameters; coding said mosaic and said transformation parameters to produce data that is a compressed representation of image information contained in said series of images.
Claim 31
Independent Claim
67 words
A method of compressing image information within a series of images comprising the steps of: aligning each image within said series of images with a reference coordinate system; combining each aligned image with other aligned images to generate a mosaic and transformation parameters; coding said mosaic and said transformation parameters to produce data that is a compressed representation of image information contained in said series of images.
Claim 32
Dependent Claim
53 words
The method of claim 26 wherein said coding step further comprises the steps of: comparing an image from the mosaic to an image from said subsequence of images and generating residuals in response to said comparison; selecting particular residuals for coding; coding the transformation parameters; coding the mosaic; and coding the selected residuals.
References Cited (Backward Citations)
US4835532A
Cited
US5040067A
Cited
US5034986A
Cited
US5416606A
Cited
US5140416A
Cited
US5258837A
Cited
US5187754A
Cited
US5657402A
Cited
US5339104A
Cited
US5325449A
Cited
US5262856A
Cited
US5633683A
Cited
US5649032A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-11-22 | 2003-05-24 | 2003-11-23 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-11-22 | 2007-05-24 | 2007-11-23 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-11-22 | 2011-05-24 | 2011-11-23 | $7700.00 | Window Closed / Lapsed |