Patent US6078619A successfully refreshed from Google Patents.
← Back to Patent Explorer
US6078619A Expired / Lapsed US ⏱️ 0.0 years remaining

Object-oriented video system

Assignee: University of Bath
•
Filing: 1999-03-10
•
Granted: 2000-06-20
•
Expires: 2019-03-10
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An object-oriented video system is implemented as a two layer object model in a software-only video compressor. Quadtree decomposition on an error metric between the input and transmitted images directs the coder towards a foreground layer of active image fragments. A rate buffering system limits the bandwidth by transmitting only the foreground blocks which most improve the image and are above some error threshold. A high fidelity background layer is identified and communicated to the decoder, which can be used to redraw background fragments as foreground objects move across them. Blocks can be coded by various methods, such as fractal transforms or truncated DCTs. The system can be implemented in RISC processors without the need for dedicated hardware. It is suitable for low bit rate applications with slowly varying backgrounds, such as personal video communications over packet networks, or closed circuit TV surveillance.

Inventors

  • 👤 Donald Martin Monro
  • 👤 Jeremy Andrew Nicholls

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-25 07:08
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/85; H04N19/88; H04N19/10; H04N19/102; H04N19/132; H04N19/134; H04N19/146; H04N19/152; H04N19/169; H04N19/17; H04N19/176; H04N19/18; H04N19/20; H04N19/23; H04N19/30; H04N19/37; H04N19/50; H04N19/503; H04N19/507; H04N19/59; H04N19/90; H04N19/96; H04N19/99

Claims Analysis

Total Claims: 29
Claim 1
Independent Claim 153 words
A coder for an object-oriented video system, the coder comprising (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background store, within which is built up, over a plurality of input images a potential background, and (ii) an accepted background store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) A block coder arranged to code and classify blocks of the image and to produce an output date stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object.
Claim 2
Dependent Claim 153 words
A coder for an object-oriented video system, the coder comprising (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background store, within which is built up, over a plurality of input images a potential background, and (ii) an accepted background store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) A block coder arranged to code and classify blocks of the image and to produce an output date stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object.
Claim 3
Dependent Claim 26 words
A coder as claimed in claim 1 in which those blocks in the output data stream that relate to the foreground object are flagged as such.
Claim 4
Dependent Claim 26 words
A coder as claimed in claim 1 in which those blocks in the output data stream that relate to the background object are flagged as such.
Claim 5
Dependent Claim 30 words
A coder as claimed in claim 1 in which the output data stream is arranged to include background object blocks and foreground object blocks in a predefined order and sequence.
Claim 6
Dependent Claim 44 words
A coder as claimed in claim 1 in which the moving image is partitioned into a plurality of input blocks which are compared, block by block, with corresponding blocks in similar partitions of the stored accepted background object and the stored potential background object.
Claim 7
Dependent Claim 51 words
A coder as claimed in claim 5 in which each block in the accepted background object is overwritten by the corresponding block in the potential background object when the potential background object block is repeatedly found to be more similar to the corresponding input block than to the accepted background block.
Claim 8
Dependent Claim 47 words
A coder as claimed in claim 1 in which each block in the output data stream is identified as one of three types: (a) a newly-sent block from the background object; (b) a previously-sent block from the background object; and (c) a block from the foreground object.
Claim 9
Dependent Claim 28 words
A coder as claimed in claim 7 in which block types (a) and (c) have associated with them data representative of the image fragment covered by the block.
Claim 10
Dependent Claim 39 words
A coder as claimed in claim 7 or claim 8 in which block type (b) has associated with it an instruction, comprehensible to a compatible decoder, to redraw the image fragment covered by the block from the known background.
Claim 11
Dependent Claim 22 words
A coder as claimed in claim 1, wherein the coder is, arranged to maintain the background object according to its Y-luminance values.
Claim 12
Dependent Claim 39 words
A coder as claimed in claim 1 in which the stored accepted background object is representative of image fragments which have previously been coded and placed in the output stream as blocks identified as relating to the background object.
Claim 13
Dependent Claim 27 words
A coder as claimed in claim 1, further including update means for forcing a re-send of selected portions of the moving image, whether or not previously sent.
Claim 14
Dependent Claim 24 words
A coder as claimed in claim 12 in which the update means repeatedly re-sends the selected portions of the moving image in pseudo-random order.
Claim 15
Dependent Claim 26 words
A coder as claimed in claim 12 or claim 13 in which the update means re-sends the selected portions of the image at a variable frequency.
Claim 16
Dependent Claim 33 words
A coder as claimed in claim 14 in which the variable frequency of the update means is adjustable, based on the actual or expected noise to which the output data stream is subject.
Claim 17
Dependent Claim 19 words
A coder as claimed in claim 1, wherein the coder is implemented by means of a programmed computer processor.
Claim 18
Dependent Claim 171 words
An object-oriented video system comprising: (1) A coder having; (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background object store, within which is built up, over a plurality of input images, a potential background, and (ii) an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; (c) A block coder arranged to code and sort blocks of the image and to produce an output data stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object; and (2) A decoder adapted to receive the output data stream and to create a video signal therefrom.
Claim 19
Dependent Claim 171 words
An object-oriented video system comprising: (1) A coder having; (a) Input image means for receiving a sequence of input images, together defining a moving image, for coding; (b) An object separator arranged to separate out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, the object separator utilizing (i) a potential background object store, within which is built up, over a plurality of input images, a potential background, and (ii) an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; (c) A block coder arranged to code and sort blocks of the image and to produce an output data stream for storage or onward transmission, each coded block within the data stream being identified as relating either to the foreground or to the background object; and (2) A decoder adapted to receive the output data stream and to create a video signal therefrom.
Claim 20
Dependent Claim 27 words
A system as claimed in claim 17 in which the decoder includes memory means for storing the background object insofar as it is known to the decoder.
Claim 21
Dependent Claim 39 words
A system as claimed in claim 18 in which the decoder includes background-reuse means arranged to incorporate within the video signal a fragment of the stored background object on receipt of an instruction to do so from the coder.
Claim 22
Dependent Claim 26 words
A system as claimed in claim 19, further including a video camera, adapted to provide the sequence of input images, the camera having a camera body.
Claim 23
Dependent Claim 16 words
A system as claimed in claim 20 in which the coder resides inside the camera body.
Claim 24
Dependent Claim 16 words
A system as claimed in claim 17 in which the coder comprises a programmed digital computer.
Claim 25
Independent Claim 130 words
A method of operating a video system comprising: (a) receiving a sequence of input images, together defining a moving image; (b) separating out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, including maintaining a potential background object store, within which is built up, over a plurality of input images, a potential background, and an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) coding and sorting blocks of the image and producing an output datastream for storage or onward transmission, each coded block within the datastream being identified as relating either to the foreground or to the background object.
Claim 26
Independent Claim 130 words
A method of operating a video system comprising: (a) receiving a sequence of input images, together defining a moving image; (b) separating out from the moving image a foreground object and a background object, the background object being relatively motionless with respect to the foreground object, including maintaining a potential background object store, within which is built up, over a plurality of input images, a potential background, and an accepted background object store within which is stored at least some parts of the potential background which have persisted for a desired period; and (c) coding and sorting blocks of the image and producing an output datastream for storage or onward transmission, each coded block within the datastream being identified as relating either to the foreground or to the background object.
Claim 27
Dependent Claim 17 words
A method as claimed in claim 23, further including a computer storage medium holding a computer program.
Claim 28
Dependent Claim 14 words
A method as claimed in claim 26, wherein the medium comprises a computer disk.
Claim 29
Dependent Claim 24 words
A coder as claimed in claim 1 in which the block coder is arranged to sort as well as classsify blocks of the image.

References Cited (Backward Citations)

WO1988009101A1 Cited
US5268967A Cited
US5915044A Cited
US5764803A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-06-20 2003-12-20 2004-06-20 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-06-20 2007-12-20 2008-06-20 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-06-20 2011-12-20 2012-06-20 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag