US6173013B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for encoding enhancement and base layer image signals using a predicted image signal
Assignee: Sony Corp
•
Filing: 1997-11-06
•
Granted: 2001-01-09
•
Expires: 2017-11-06
Abstract
Abstract The invention provides an encoding apparatus capable of encoding an image signal in a scalable fashion and also provides a decoding apparatus corresponding to the encoding apparatus. In particular, the invention provides an image signal encoding apparatus for encoding a plurality of image signals, wherein at least one of the plurality of image signals is an image signal representing a moving image object, and the plurality of image signals are encoded together with a signal used to combine the image signal representing the moving image object with other image signals. The encoded signal is decoded by the decoding apparatus according to the invention. The invention is characterized in that the apparatus includes: an image supplier for supplying a base layer image signal and an enhancement layer image signal scalably representing the image signal of the moving image object; an enhancement layer encoder for encoding the enhancement layer image signal thereby generating an encoded enhancement layer signal; and a base layer encoder for encoding the base layer image signal thereby generating an encoded base layer signal. In the above encoding process, a reference image signal used to calculate a motion vector of the enhancement layer image signal to be encoded is generated by replacing the values of pixels outside the image object of the enhancement layer image signal with the values of predetermined pixels of the base layer image signal.
Inventors
- 👤 Teruhiko Suzuki
- 👤 Yoichi Yagasaki
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:56
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/20; H04N19/29; H04N19/30; H04N19/33; H04N19/50; H04N19/503; H04N19/51; H04N19/563
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
249 words
An image signal encoding apparatus for encoding a plurality of image signals, at least one of said plurality of image signals being an image signal representing a moving image object, said at least one of the plurality of image signals including a signal used to combine it with at least one other image signal of said plurality of image signals, said apparatus comprising: an image supplier for supplying a base layer image signal and an enhancement layer image signal scalably representing said image signal representing a moving image object; an enhancement layer encoder for encoding said enhancement layer image signal thereby generating an encoded enhancement layer signal; and a base layer encoder for encoding said base layer image signal thereby generating an encoded base layer signal; wherein said enhancement layer encoder comprises: a generator for generating a reference image signal used to calculate a motion vector of the enhancement layer image signal to be encoded, said reference image signal being generated by replacing the values of pixels outside said image object of the enhancement layer image signal with the values of predetermined pixels at corresponding locations of the base layer image signal; a detector for detecting the motion vector of said enhancement layer image signal to be encoded using said reference image signal; and an encoder for encoding said enhancement layer image signal using a predicted image signal of said enhancement layer image signal, said predicted image signal being generated by performing motion compensation using said detected motion vector.
Claim 2
Dependent Claim
249 words
An image signal encoding apparatus for encoding a plurality of image signals, at least one of said plurality of image signals being an image signal representing a moving image object, said at least one of the plurality of image signals including a signal used to combine it with at least one other image signal of said plurality of image signals, said apparatus comprising: an image supplier for supplying a base layer image signal and an enhancement layer image signal scalably representing said image signal representing a moving image object; an enhancement layer encoder for encoding said enhancement layer image signal thereby generating an encoded enhancement layer signal; and a base layer encoder for encoding said base layer image signal thereby generating an encoded base layer signal; wherein said enhancement layer encoder comprises: a generator for generating a reference image signal used to calculate a motion vector of the enhancement layer image signal to be encoded, said reference image signal being generated by replacing the values of pixels outside said image object of the enhancement layer image signal with the values of predetermined pixels at corresponding locations of the base layer image signal; a detector for detecting the motion vector of said enhancement layer image signal to be encoded using said reference image signal; and an encoder for encoding said enhancement layer image signal using a predicted image signal of said enhancement layer image signal, said predicted image signal being generated by performing motion compensation using said detected motion vector.
Claim 3
Dependent Claim
72 words
An image signal encoding apparatus according to claim 1 , wherein said generator replaces the values of pixels outside said image object of the enhancement layer image signal with the values of pixels at corresponding locations of a base layer image signal which is time coincident with said reference image signal thereby generating said reference image signal used to calculate the motion vector of the enhancement layer image signal to be encoded.
Claim 4
Dependent Claim
74 words
An image signal encoding apparatus according to claim 1 , wherein said generator replaces the values of pixels outside said image object of the enhancement layer image signal with the values of pixels at corresponding locations of a base layer image signal which is time coincident with said image signal to be encoded thereby generating said reference image signal used to calculate the motion vector of the enhancement layer image signal to be encoded.
Claim 5
Dependent Claim
24 words
An image signal encoding apparatus according to claim 1 , wherein said enhancement layer encoder generates a flag indicating an image to be replaced.
Claim 6
Dependent Claim
46 words
An image signal encoding apparatus according to claim 1 , wherein said image supplier includes a layered signal generator for generating said enhancement layer image signal and said base layer image signal represented in a scalable fashion from said image signal representing a moving image object.
Claim 7
Dependent Claim
142 words
An image signal encoding apparatus according to claim 1 , wherein: said generator has a first replacement mode and a second replacement mode; in said first replacement mode, said generator replaces the values of pixels outside said image object of the enhancement layer image signal with the values of predetermined pixels of the base layer image signal thereby generating the reference image signal used to calculate the motion vector of the enhancement layer image signal to be encoded; in said second replacement mode, said generator replaces the values of pixels outside said image object of the enhancement layer image signal with values obtained by extrapolating pixel values inside said image object thereby generating the reference image signal used to calculate the motion vector of the enhancement layer image signal to be encoded; and said generator generates a flag indicating a replacement mode.
Claim 8
Dependent Claim
63 words
An image signal encoding apparatus according to claim 1 , wherein said image supplier further supplies a flag indicating the size of said enhancement layer image signal, a flag indicating the position thereof with respect to an absolute position, a flag indicating the size of said base layer image signal, and a flag indicating the position thereof with respect to the absolute position.
Claim 9
Dependent Claim
38 words
An image signal encoding apparatus according to claim 7 , wherein said image supplier further supplies a flag indicating the ratio of the resolution of said enhancement layer image signal to that of said base layer image signal.
Claim 10
Dependent Claim
231 words
An image signal encoding apparatus according to claim 1 , wherein: said enhancement layer image signal is a first enhancement layer image signal, said image supplier further supplies a second enhancement layer image signal which is higher in layer than said enhancement layer image signal, said first and second enhancement layer image signals representing differently scaled versions of said image signal representing a moving image object; and said apparatus further comprises a second enhancement layer encoder for encoding said second enhancement layer image signal thereby generating a second encoded enhancement layer signal, said second enhancement layer encoder comprising: a generator for generating a second reference image signal used to calculate a motion vector of the second enhancement layer image signal to be encoded, said second reference image signal being generated by replacing the values of pixels outside said image object of said second enhancement layer image signal with the values of predetermined pixels of the first enhancement layer image signal; a detector for detecting the motion vector of said second enhancement layer image signal to be encoded using said second reference image signal; and a second encoder for encoding said second enhancement layer image signal using a second predicted image signal of said second enhancement layer image signal, said second predicted image signal being generated by performing motion compensation using said detected motion vector of the second enhancement layer image signal.
Claim 11
Dependent Claim
237 words
An image signal encoding method for encoding a plurality of image signals, at least one of said plurality of image signals being an image signal representing a moving image object, said at least one of the plurality of image signals including a signal used to combine it with at least one other image signal of said plurality of image signals, said method comprising the steps of: supplying a base layer image signal and an enhancement layer image signal scalably representing said image signal representing a moving image object; encoding said enhancement layer image signal thereby generating an encoded enhancement layer signal; and encoding said base layer image signal thereby generating an encoded base layer signal; wherein said step of encoding said enhancement layer image signal comprises the steps of: generating a reference image signal used to calculate a motion vector of the enhancement layer image signal to be encoded, said reference image signal being generated by replacing the values of pixels outside said image object of the enhancement layer image signal with the values of predetermined pixels at corresponding locations of the base layer image signal; detecting the motion vector of said enhancement layer image signal to be encoded using said reference image signal; and encoding said enhancement layer image signal using a predicted image signal of said enhancement layer image signal, said predicted image signal being generated by performing motion compensation using said detected motion vector.
Claim 12
Dependent Claim
237 words
An image signal encoding method for encoding a plurality of image signals, at least one of said plurality of image signals being an image signal representing a moving image object, said at least one of the plurality of image signals including a signal used to combine it with at least one other image signal of said plurality of image signals, said method comprising the steps of: supplying a base layer image signal and an enhancement layer image signal scalably representing said image signal representing a moving image object; encoding said enhancement layer image signal thereby generating an encoded enhancement layer signal; and encoding said base layer image signal thereby generating an encoded base layer signal; wherein said step of encoding said enhancement layer image signal comprises the steps of: generating a reference image signal used to calculate a motion vector of the enhancement layer image signal to be encoded, said reference image signal being generated by replacing the values of pixels outside said image object of the enhancement layer image signal with the values of predetermined pixels at corresponding locations of the base layer image signal; detecting the motion vector of said enhancement layer image signal to be encoded using said reference image signal; and encoding said enhancement layer image signal using a predicted image signal of said enhancement layer image signal, said predicted image signal being generated by performing motion compensation using said detected motion vector.
Claim 13
Dependent Claim
210 words
The image signal encoding method of claim 10 , wherein said enhancement layer signal is a first enhancement layer signal, and said method further comprises the steps of: supplying a second enhancement layer image signal which is higher in layer than said first enhancement layer image signal, said first and second enhancement layer image signals representing differently scaled versions of said image signal representing a moving image object; encoding said second enhancement layer image signal thereby generating a second encoded enhancement layer signal, by: generating a second reference image signal used to calculate a motion vector of the second enhancement image signal, said second reference image signal being generated by replacing the values of pixels outside said image object of said second enhancement layer image signal with the values of predetermined pixels of the first enhancement layer image signal; detecting the motion vector of said second enhancement layer image signal to be encoded using said second reference image signal; encoding said second enhancement layer image signal using a second predicted image signal of said second enhancement layer image signal, said second predicted image signal being generated by performing motion compensation using said detected motion vector of said second enhancement layer image signal; and transmitting said encoded second layer image signal.
Claim 14
Dependent Claim
272 words
An image signal transmission method for encoding a plurality of image signals, at least one of said plurality of image signals being an image signal representing a moving image object, said at least one of the plurality of image signals including a signal used to combine it with at least one other image signal of said plurality of image signals, said method comprising the steps of: supplying a base layer image signal and an enhancement layer image signal scalably representing said image signal representing a moving image object; encoding said enhancement layer image signal thereby generating an encoded enhancement layer signal; and encoding said base layer image signal thereby generating an encoded base layer signal; wherein said step of encoding said enhancement layer image signal comprises the steps of: generating a reference image signal used to calculate a motion vector of the enhancement layer image signal to be encoded, said reference image signal being generated by replacing the values of pixels outside said image object of the enhancement layer image signal with the values of predetermined pixels at corresponding locations of the base layer image signal; detecting the motion vector of said enhancement layer image signal to be encoded using said reference image signal; encoding said enhancement layer image signal using a predicted image signal of said enhancement layer image signal, said predicted image signal being generated by performing motion compensation using said detected motion vector; and generating a flag indicating an image to be replaced; said method further comprising the step of transmitting said encoded enhancement layer image signal, said encoded base layer image signal, said motion vector, and said flag.
Claim 15
Dependent Claim
272 words
An image signal transmission method for encoding a plurality of image signals, at least one of said plurality of image signals being an image signal representing a moving image object, said at least one of the plurality of image signals including a signal used to combine it with at least one other image signal of said plurality of image signals, said method comprising the steps of: supplying a base layer image signal and an enhancement layer image signal scalably representing said image signal representing a moving image object; encoding said enhancement layer image signal thereby generating an encoded enhancement layer signal; and encoding said base layer image signal thereby generating an encoded base layer signal; wherein said step of encoding said enhancement layer image signal comprises the steps of: generating a reference image signal used to calculate a motion vector of the enhancement layer image signal to be encoded, said reference image signal being generated by replacing the values of pixels outside said image object of the enhancement layer image signal with the values of predetermined pixels at corresponding locations of the base layer image signal; detecting the motion vector of said enhancement layer image signal to be encoded using said reference image signal; encoding said enhancement layer image signal using a predicted image signal of said enhancement layer image signal, said predicted image signal being generated by performing motion compensation using said detected motion vector; and generating a flag indicating an image to be replaced; said method further comprising the step of transmitting said encoded enhancement layer image signal, said encoded base layer image signal, said motion vector, and said flag.
Claim 16
Dependent Claim
203 words
The image signal transmission method of claim 12 , wherein said enhancement layer signal is a first enhancement layer signal, and said method further comprises the steps of: supplying a second enhancement layer image signal which is higher in layer than said first enhancement layer image signal, said first and second enhancement layer image signals representing differently scaled versions of said image signal representing a moving image object; encoding said second enhancement layer image signal thereby generating a second encoded enhancement layer signal, by: generating a second reference image signal used to calculate a motion vector of the second enhancement image signal, said second reference image signal being generated by replacing the values of pixels outside said image object of said second enhancement layer image signal with the values of predetermined pixels of the first enhancement layer image signal; detecting the motion vector of said second enhancement layer image signal to be encoded using said second reference image signal; and encoding said second enhancement layer image signal using a second predicted image signal of said second enhancement layer image signal, said second predicted image signal being generated by performing motion compensation using said detected motion vector of said second enhancement layer image signal.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-01-09 | 2004-07-10 | 2005-01-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-01-09 | 2008-07-10 | 2009-01-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-01-09 | 2012-07-10 | 2013-01-09 | $7700.00 | Window Closed / Lapsed |