US6078619A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Object-oriented video system
Assignee: University of Bath
•
Filing: 1999-03-10
•
Granted: 2000-06-20
•
Expires: 2019-03-10
Abstract
Abstract An object-oriented video system is implemented as a two layer object model in a software-only video compressor. Quadtree decomposition on an error metric between the input and transmitted images directs the coder towards a foreground layer of active image fragments. A rate buffering system limits the bandwidth by transmitting only the foreground blocks which most improve the image and are above some error threshold. A high fidelity background layer is identified and communicated to the decoder, which can be used to redraw background fragments as foreground objects move across them. Blocks can be coded by various methods, such as fractal transforms or truncated DCTs. The system can be implemented in RISC processors without the need for dedicated hardware. It is suitable for low bit rate applications with slowly varying backgrounds, such as personal video communications over packet networks, or closed circuit TV surveillance.
Inventors
- 👤 Donald Martin Monro
- 👤 Jeremy Andrew Nicholls
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 13:41
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/85; H04N19/88; H04N19/10; H04N19/102; H04N19/132; H04N19/134; H04N19/146; H04N19/152; H04N19/169; H04N19/17; H04N19/176; H04N19/18; H04N19/20; H04N19/23; H04N19/30; H04N19/37; H04N19/50; H04N19/503; H04N19/507; H04N19/59; H04N19/90; H04N19/96; H04N19/99
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
153 words
A coder for an object-oriented video system, the coder comprising (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background store, within which is built up, over a plurality of input images a potential background, and (ii) an accepted background store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) A block coder arranged to code and classify blocks of the image and to produce an output date stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object.
Claim 2
Dependent Claim
153 words
A coder for an object-oriented video system, the coder comprising (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background store, within which is built up, over a plurality of input images a potential background, and (ii) an accepted background store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) A block coder arranged to code and classify blocks of the image and to produce an output date stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object.
Claim 3
Dependent Claim
26 words
A coder as claimed in claim 1 in which those blocks in the output data stream that relate to the foreground object are flagged as such.
Claim 4
Dependent Claim
26 words
A coder as claimed in claim 1 in which those blocks in the output data stream that relate to the background object are flagged as such.
Claim 5
Dependent Claim
30 words
A coder as claimed in claim 1 in which the output data stream is arranged to include background object blocks and foreground object blocks in a predefined order and sequence.
Claim 6
Dependent Claim
44 words
A coder as claimed in claim 1 in which the moving image is partitioned into a plurality of input blocks which are compared, block by block, with corresponding blocks in similar partitions of the stored accepted background object and the stored potential background object.
Claim 7
Dependent Claim
51 words
A coder as claimed in claim 5 in which each block in the accepted background object is overwritten by the corresponding block in the potential background object when the potential background object block is repeatedly found to be more similar to the corresponding input block than to the accepted background block.
Claim 8
Dependent Claim
47 words
A coder as claimed in claim 1 in which each block in the output data stream is identified as one of three types: (a) a newly-sent block from the background object; (b) a previously-sent block from the background object; and (c) a block from the foreground object.
Claim 9
Dependent Claim
28 words
A coder as claimed in claim 7 in which block types (a) and (c) have associated with them data representative of the image fragment covered by the block.
Claim 10
Dependent Claim
39 words
A coder as claimed in claim 7 or claim 8 in which block type (b) has associated with it an instruction, comprehensible to a compatible decoder, to redraw the image fragment covered by the block from the known background.
Claim 11
Dependent Claim
22 words
A coder as claimed in claim 1, wherein the coder is, arranged to maintain the background object according to its Y-luminance values.
Claim 12
Dependent Claim
39 words
A coder as claimed in claim 1 in which the stored accepted background object is representative of image fragments which have previously been coded and placed in the output stream as blocks identified as relating to the background object.
Claim 13
Dependent Claim
27 words
A coder as claimed in claim 1, further including update means for forcing a re-send of selected portions of the moving image, whether or not previously sent.
Claim 14
Dependent Claim
24 words
A coder as claimed in claim 12 in which the update means repeatedly re-sends the selected portions of the moving image in pseudo-random order.
Claim 15
Dependent Claim
26 words
A coder as claimed in claim 12 or claim 13 in which the update means re-sends the selected portions of the image at a variable frequency.
Claim 16
Dependent Claim
33 words
A coder as claimed in claim 14 in which the variable frequency of the update means is adjustable, based on the actual or expected noise to which the output data stream is subject.
Claim 17
Dependent Claim
19 words
A coder as claimed in claim 1, wherein the coder is implemented by means of a programmed computer processor.
Claim 18
Dependent Claim
171 words
An object-oriented video system comprising: (1) A coder having; (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background object store, within which is built up, over a plurality of input images, a potential background, and (ii) an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; (c) A block coder arranged to code and sort blocks of the image and to produce an output data stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object; and (2) A decoder adapted to receive the output data stream and to create a video signal therefrom.
Claim 19
Dependent Claim
171 words
An object-oriented video system comprising: (1) A coder having; (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background object store, within which is built up, over a plurality of input images, a potential background, and (ii) an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; (c) A block coder arranged to code and sort blocks of the image and to produce an output data stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object; and (2) A decoder adapted to receive the output data stream and to create a video signal therefrom.
Claim 20
Dependent Claim
27 words
A system as claimed in claim 17 in which the decoder includes memory means for storing the background object insofar as it is known to the decoder.
Claim 21
Dependent Claim
39 words
A system as claimed in claim 18 in which the decoder includes background-reuse means arranged to incorporate within the video signal a fragment of the stored background object on receipt of an instruction to do so from the coder.
Claim 22
Dependent Claim
26 words
A system as claimed in claim 19, further including a video camera, adapted to provide the sequence of input images, the camera having a camera body.
Claim 23
Dependent Claim
16 words
A system as claimed in claim 20 in which the coder resides inside the camera body.
Claim 24
Dependent Claim
16 words
A system as claimed in claim 17 in which the coder comprises a programmed digital computer.
Claim 25
Independent Claim
130 words
A method of operating a video system comprising: (a) receiving a sequence of input images, together defining a moving image; (b) separating out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, including maintaining a potential background object store, within which is built up, over a plurality of input images, a potential background, and an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) coding and sorting blocks of the image and producing an output datastream for storage or onward transmission, each coded block within the datastream being identified as relating either to the foreground or to the background object.
Claim 26
Independent Claim
130 words
A method of operating a video system comprising: (a) receiving a sequence of input images, together defining a moving image; (b) separating out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, including maintaining a potential background object store, within which is built up, over a plurality of input images, a potential background, and an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) coding and sorting blocks of the image and producing an output datastream for storage or onward transmission, each coded block within the datastream being identified as relating either to the foreground or to the background object.
Claim 27
Dependent Claim
17 words
A method as claimed in claim 23, further including a computer storage medium holding a computer program.
Claim 28
Dependent Claim
14 words
A method as claimed in claim 26, wherein the medium comprises a computer disk.
Claim 29
Dependent Claim
24 words
A coder as claimed in claim 1 in which the block coder is arranged to sort as well as classsify blocks of the image.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-06-20 | 2003-12-20 | 2004-06-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-06-20 | 2007-12-20 | 2008-06-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-06-20 | 2011-12-20 | 2012-06-20 | $7700.00 | Window Closed / Lapsed |