Patent US6549669B1 successfully refreshed from Google Patents.
US6549669B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Predictive audio and video encoding with smooth scene switching capability
Assignee: Telefonaktiebolaget LM Ericsson AB
•
Filing: 1999-04-27
•
Granted: 2003-04-15
•
Expires: 2019-04-27
Abstract
Abstract In predictive video and audio encoding/decoding, a stimulus change at the encoder is smoothly accommodated by causing a video codec to exchange image data with a cache memory, and by homing an audio codec.
Inventors
- 👤 Jim Sundqvist
- 👤 Henrik Bergquist
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 14:58
CPC Classifications
H; H04; H04N; H04N9/00; H04N9/79; H04N9/80; H04N9/804; H04N9/8042; G; G10; G10L; G10L19/00; H04N19/00; H04N19/10; H04N19/134; H04N19/142; H04N19/44; H04N19/42; H04N19/423; H04N19/50; H04N19/597; H04N9/806; H04N9/8063
Claims Analysis
Total Claims: 54
Claim 1
Independent Claim
142 words
A video decoding method, comprising; providing input image data; providing difference information indicative of a difference between images captured by a video transmitter apparatus; deciding whether to output predicted image data produced as a function of the input image data and the difference information, or to output other image data produced independently of the difference information and the input image data, wherein said deciding step includes determining whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, deciding to output the predicted image data if the input video stimulus has not been changed, and deciding to output the other image data if the input video stimulus has been changed; and outputting one of the predicted image data and the other image data as decided in said deciding step.
Claim 2
Dependent Claim
142 words
A video decoding method, comprising; providing input image data; providing difference information indicative of a difference between images captured by a video transmitter apparatus; deciding whether to output predicted image data produced as a function of the input image data and the difference information, or to output other image data produced independently of the difference information and the input image data, wherein said deciding step includes determining whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, deciding to output the predicted image data if the input video stimulus has not been changed, and deciding to output the other image data if the input video stimulus has been changed; and outputting one of the predicted image data and the other image data as decided in said deciding step.
Claim 3
Dependent Claim
59 words
The method of claim 1 , wherein said step of outputting the other image data includes outputting previously predicted image data which corresponds to the second video stimulus and was previously predicted as a function of previous input image data and previous difference information at an earlier time when the second video stimulus was previously the input video stimulus.
Claim 4
Dependent Claim
47 words
The method of claim 2 , including detecting that the input video stimulus has changed from the second video stimulus to another video stimulus, and storing said previously predicted image data in response to detection of the change from the second video stimulus to another video stimulus.
Claim 5
Dependent Claim
31 words
The method of claim 1 , wherein said step of determining an input video stimulus change includes examining a frame header of a frame in which the difference information is provided.
Claim 6
Dependent Claim
31 words
The method of claim 1 , wherein said step of determining an input video stimulus change includes monitoring Internet Protocol (IP) traffic in a plurality of IP applications operating in parallel.
Claim 7
Dependent Claim
28 words
The method of claim 1 , wherein said step of determining an input video stimulus change includes monitoring sources of Internet Protocol (IP) traffic in an IP application.
Claim 8
Dependent Claim
43 words
The method of claim 1 , including, if the input video stimulus has been changed, storing previously predicted image data which corresponds to the first video stimulus and was previously predicted as a function of previous input image data and previous difference information.
Claim 9
Dependent Claim
144 words
A video decoding method, comprising: providing difference information indicative of a difference between images captured by a video transmitter apparatus; providing output image data as a function of the difference information and input image data; deciding whether to update the input image data in response to the output image data, or independently of the output image data, wherein said deciding step includes determining whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, deciding to update the input image data in response to the output image data if the input video stimulus has not been changed, and deciding to update the input image data independently of the output image data if the input video stimulus has been changed; and updating the input image data as decided in said deciding step.
Claim 10
Dependent Claim
144 words
A video decoding method, comprising: providing difference information indicative of a difference between images captured by a video transmitter apparatus; providing output image data as a function of the difference information and input image data; deciding whether to update the input image data in response to the output image data, or independently of the output image data, wherein said deciding step includes determining whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, deciding to update the input image data in response to the output image data if the input video stimulus has not been changed, and deciding to update the input image data independently of the output image data if the input video stimulus has been changed; and updating the input image data as decided in said deciding step.
Claim 11
Dependent Claim
60 words
The method of claim 8 , wherein said step of updating the input image data independently includes providing previous output image data which corresponds to the second video stimulus and was previously provided as a function of previous difference information and previous input image data at an earlier time when the second video stimulus was previously the input video stimulus.
Claim 12
Dependent Claim
47 words
The method of claim 9 , including detecting that the input video stimulus has changed from the second video stimulus to another video stimulus, and storing said previous output image data in response to detection of the change from the second video stimulus to another video stimulus.
Claim 13
Dependent Claim
31 words
The method of claim 8 , wherein said step of determining an input video stimulus change includes examining a frame header of a frame in which the difference information is provided.
Claim 14
Dependent Claim
31 words
The method of claim 8 , wherein said step of determining an input video stimulus change includes monitoring Internet Protocol (IP) traffic in a plurality of IP applications operating in parallel.
Claim 15
Dependent Claim
28 words
The method of claim 8 , wherein said step of determining an input video stimulus change includes monitoring sources of Internet Protocol (IP) traffic in an IP application.
Claim 16
Dependent Claim
20 words
The method of claim 8 , including storing the output image data if the input video stimulus has been changed.
Claim 17
Dependent Claim
71 words
An audio decoding method, comprising: determining whether an input sound stimulus received by an audio transmitter apparatus has changed from a first sound stimulus to a second sound stimulus; setting a current state of a digital filter to a predetermined state in response to detection of a change in the sound stimulus input received by the audio transmitter; and using the digital filter in said predetermined state to perform audio decoding.
Claim 18
Dependent Claim
71 words
An audio decoding method, comprising: determining whether an input sound stimulus received by an audio transmitter apparatus has changed from a first sound stimulus to a second sound stimulus; setting a current state of a digital filter to a predetermined state in response to detection of a change in the sound stimulus input received by the audio transmitter; and using the digital filter in said predetermined state to perform audio decoding.
Claim 19
Dependent Claim
31 words
The method of claim 15 , wherein said step of determining an input sound stimulus change includes examining a frame header of a frame in which the audio data is provided.
Claim 20
Dependent Claim
31 words
The method of claim 15 , wherein said step of determining an input sound stimulus change includes monitoring Internet Protocol (IP) traffic in a plurality of IP applications operating in parallel.
Claim 21
Dependent Claim
28 words
The method of claim 15 , wherein said step of determining an input sound stimulus change includes monitoring sources of Internet Protocol (IP) traffic in an IP application.
Claim 22
Dependent Claim
133 words
A video encoding method, comprising: receiving first image data corresponding to a first image in a sequence of images, thereafter receiving second image data corresponding to a second image in the sequence of images, and thereafter receiving third image data corresponding to a third image in the sequence of images; in response to the first and second image data, providing first difference information indicative of a difference between the first and second images; deciding whether to provide second difference information indicative of a difference between the second and third images, or instead to provide third difference information indicative of a difference between the third image and a further image other than the second image; and providing one of the second difference information and the third difference information as decided in said deciding step.
Claim 23
Dependent Claim
133 words
A video encoding method, comprising: receiving first image data corresponding to a first image in a sequence of images, thereafter receiving second image data corresponding to a second image in the sequence of images, and thereafter receiving third image data corresponding to a third image in the sequence of images; in response to the first and second image data, providing first difference information indicative of a difference between the first and second images; deciding whether to provide second difference information indicative of a difference between the second and third images, or instead to provide third difference information indicative of a difference between the third image and a further image other than the second image; and providing one of the second difference information and the third difference information as decided in said deciding step.
Claim 24
Dependent Claim
62 words
The method of claim 19 , wherein said deciding step includes determining whether an input video stimulus has been changed from a first video stimulus to a second video stimulus, deciding to output the second difference information if the input video stimulus has not been changed, and deciding to output the third difference information if the input video stimulus has been changed.
Claim 25
Dependent Claim
50 words
The method of claim 20 , wherein said step of providing third difference information includes providing further image data which corresponds to said further image and to the second video stimulus, and which was previously received at a time when the second video stimulus was previously the input video stimulus.
Claim 26
Dependent Claim
46 words
The method of claim 20 , including detecting that the input video stimulus has changed from the second video stimulus to another video stimulus, and storing said further image data in response to detection of the change from the second video stimulus to another video stimulus.
Claim 27
Dependent Claim
20 words
The method of claim 20 , including storing the second image data if the input video stimulus has been changed.
Claim 28
Dependent Claim
188 words
A video decoding apparatus, comprising: an output for providing output image data, a decode unit having an input for receiving input image data and difference information indicative of a difference between images captured by a video transmitter apparatus, said decode unit operable for producing predicted image data as a function of said input image data and said difference information; a scene change detector for detecting whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, wherein the scene change detector also provides an indication of whether the input video stimulus has so changed, said selector responsive to said indication to select said predicted image data if the input video stimulus has not been changed, and to select said other image data if the input video stimulus has been changed; and a selector coupled to said scene change detector and coupled between said decode unit and said output for selectively providing to said output one of said predicted image data and other image data produced independently of said input image data and said difference information.
Claim 29
Dependent Claim
188 words
A video decoding apparatus, comprising: an output for providing output image data, a decode unit having an input for receiving input image data and difference information indicative of a difference between images captured by a video transmitter apparatus, said decode unit operable for producing predicted image data as a function of said input image data and said difference information; a scene change detector for detecting whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, wherein the scene change detector also provides an indication of whether the input video stimulus has so changed, said selector responsive to said indication to select said predicted image data if the input video stimulus has not been changed, and to select said other image data if the input video stimulus has been changed; and a selector coupled to said scene change detector and coupled between said decode unit and said output for selectively providing to said output one of said predicted image data and other image data produced independently of said input image data and said difference information.
Claim 30
Dependent Claim
58 words
The apparatus of claim 24 , wherein said other image data includes previous predicted image data which corresponds to the second video stimulus and was previously provided by said decode unit as a function of previous input image data and previous difference information at an earlier time when the second video stimulus was previously the input video stimulus.
Claim 31
Dependent Claim
40 words
The apparatus of claim 24 , wherein said scene change detector includes a frame buffer and a frame header analyzer coupled to said frame buffer for examining a frame header of a frame in which said difference information is provided.
Claim 32
Dependent Claim
39 words
The apparatus of claim 24 , wherein said scene change detector includes a plurality of Internet Protocol (IP) applications operating in parallel, and a traffic analyzer coupled to said IP applications for monitoring IP traffic in said IP applications.
Claim 33
Dependent Claim
36 words
The apparatus of claim 24 , wherein said scene change detector includes an Internet Protocol (IP) application and a source analyzer coupled to said IP application for monitoring sources of IP traffic in said IP application.
Claim 34
Dependent Claim
67 words
The apparatus of claim 24 , including an image data storage apparatus coupled to said scene change detector and responsive to said indication that the input video stimulus has changed for storing in said storage apparatus previously predicted image data which corresponds to the first video stimulus and was previously produced by said decode unit as a function of previous input image data and previous difference information.
Claim 35
Dependent Claim
37 words
The apparatus of claim 24 , including an image data storage apparatus for storing therein said other image data, said selector having a data input coupled to said storage apparatus to receive therefrom said other image data.
Claim 36
Dependent Claim
209 words
A video decoding apparatus, comprising: an output for providing output image data; a decode unit having an input for receiving input image data and for receiving difference information indicative of a difference between images captured by a video transmitter apparatus, said decode unit responsive to said input image data and said difference information for providing said output image data as a function of said difference information and said input image data; a scene change detector for detecting whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, wherein the scene change detector also provides an indication of whether the input video stimulus has so changed, said selector responsive to said indication to select said output image data if the input video stimulus has not been changed, and to select said other image data if the input video stimulus has been changed; and a selector coupled to said scene change detector and coupled between said output and said decode unit input for selecting one of said output image data and other image data produced independently of said output image data, and providing the selected image data to said decode input to update said input image data.
Claim 37
Dependent Claim
209 words
A video decoding apparatus, comprising: an output for providing output image data; a decode unit having an input for receiving input image data and for receiving difference information indicative of a difference between images captured by a video transmitter apparatus, said decode unit responsive to said input image data and said difference information for providing said output image data as a function of said difference information and said input image data; a scene change detector for detecting whether an input video stimulus seen by the video transmitter apparatus has been changed from a first video stimulus to a second video stimulus, wherein the scene change detector also provides an indication of whether the input video stimulus has so changed, said selector responsive to said indication to select said output image data if the input video stimulus has not been changed, and to select said other image data if the input video stimulus has been changed; and a selector coupled to said scene change detector and coupled between said output and said decode unit input for selecting one of said output image data and other image data produced independently of said output image data, and providing the selected image data to said decode input to update said input image data.
Claim 38
Dependent Claim
58 words
The apparatus of claim 31 , wherein said other image data includes previous output image data which corresponds to the second video stimulus and was previously provided by said decode unit as a function of previous input image data and previous difference information at an earlier time when the second video stimulus was previously the input video stimulus.
Claim 39
Dependent Claim
40 words
The apparatus of claim 31 , wherein said scene change detector includes a frame buffer and a frame header analyzer coupled to said frame buffer for examining a frame header of a frame in which said difference information is provided.
Claim 40
Dependent Claim
39 words
The apparatus of claim 31 , wherein said scene change detector includes a plurality of Internet Protocol (IP) applications operating in parallel, and a traffic analyzer coupled to said IP applications for monitoring IP traffic in said IP applications.
Claim 41
Dependent Claim
36 words
The apparatus of claim 31 , wherein said scene change detector includes an Internet Protocol (IP) application and a source analyzer coupled to said IP application for monitoring sources of IP traffic in said IP application.
Claim 42
Dependent Claim
67 words
The apparatus of claim 31 , including an image data storage apparatus coupled to said scene change detector and responsive to said indication that the input video stimulus has changed for storing in said storage apparatus previous output image data which corresponds to the first video stimulus and was previously produced by said decode unit as a function of previous input image data and previous difference information.
Claim 43
Dependent Claim
37 words
The apparatus of claim 31 , including an image data storage apparatus for storing therein said other image data, said selector having a data input coupled to said storage apparatus to receive therefrom said other image data.
Claim 44
Dependent Claim
141 words
An audio decoding apparatus, comprising: a change detector for determining whether an input sound stimulus received by an audio transmitter apparatus has changed from a first sound stimulus to a second sound stimulus, said change detector including an output for indicating whether the input sound stimulus has changed; a decode unit having an audio input for receiving audio data from the audio transmitter apparatus, a control input coupled to said change detector output, and a digital filter coupled to said audio input and said control input; and said decode unit responsive to an indication at said control input that the input sound stimulus has changed for setting a current state of said digital filter to a predetermined state, and said decode unit operable for using said digital filter in said predetermined state to perform audio decoding based on said audio data.
Claim 45
Dependent Claim
141 words
An audio decoding apparatus, comprising: a change detector for determining whether an input sound stimulus received by an audio transmitter apparatus has changed from a first sound stimulus to a second sound stimulus, said change detector including an output for indicating whether the input sound stimulus has changed; a decode unit having an audio input for receiving audio data from the audio transmitter apparatus, a control input coupled to said change detector output, and a digital filter coupled to said audio input and said control input; and said decode unit responsive to an indication at said control input that the input sound stimulus has changed for setting a current state of said digital filter to a predetermined state, and said decode unit operable for using said digital filter in said predetermined state to perform audio decoding based on said audio data.
Claim 46
Dependent Claim
39 words
The apparatus of claim 38 , wherein said change detector includes a frame buffer and a frame header analyzer coupled to said frame buffer for examining a frame header of a frame in which said audio data is provided.
Claim 47
Dependent Claim
38 words
The apparatus of claim 38 , wherein said change detector includes a plurality of Internet Protocol (IP) applications operating in parallel, and a traffic analyzer coupled to said IP applications for monitoring IP traffic in said IP applications.
Claim 48
Dependent Claim
35 words
The apparatus of claim 38 , wherein said change detector includes an Internet Protocol (IP) application and a source analyzer coupled to said IP application for monitoring sources of IP traffic in said IP application.
Claim 49
Dependent Claim
205 words
A video encoding apparatus, comprising: a first input for sequentially receiving first image data corresponding to a first image in a sequence of images, second image data corresponding to a second image in the sequence of images, and third image data corresponding to a third image in the sequence of images; a second input coupled to said first input for sequentially receiving therefrom said first, second and third image data; an encode unit coupled to said first and second inputs and operable in response to image data received at said first and second inputs for providing difference information indicative of a difference between images respectively corresponding to said image data received at said first and second inputs, said encode unit operable when said first and second image data are respectively present at said second and first data inputs for providing first difference information indicative of a difference between said first and second images; and a selector coupled between said first and second inputs and operable when said second image data is present at said first input for selecting one of said second image data and further image data other than said second image data, and for providing the selected image data to said second input.
Claim 50
Dependent Claim
205 words
A video encoding apparatus, comprising: a first input for sequentially receiving first image data corresponding to a first image in a sequence of images, second image data corresponding to a second image in the sequence of images, and third image data corresponding to a third image in the sequence of images; a second input coupled to said first input for sequentially receiving therefrom said first, second and third image data; an encode unit coupled to said first and second inputs and operable in response to image data received at said first and second inputs for providing difference information indicative of a difference between images respectively corresponding to said image data received at said first and second inputs, said encode unit operable when said first and second image data are respectively present at said second and first data inputs for providing first difference information indicative of a difference between said first and second images; and a selector coupled between said first and second inputs and operable when said second image data is present at said first input for selecting one of said second image data and further image data other than said second image data, and for providing the selected image data to said second input.
Claim 51
Dependent Claim
80 words
The apparatus of claim 42 , wherein said selector includes a control input for receiving an indication of whether an input video stimulus from which said sequence of images is produced has been changed from a first video stimulus to a second video stimulus, said selector responsive to said indication for selecting said second image data if the input video stimulus has not been changed, and for selecting said further image data if the input video stimulus has been changed.
Claim 52
Dependent Claim
45 words
The apparatus of claim 43 , wherein said further image data includes previous image data which corresponds to the second video stimulus and which was previously received at said first input at a time when the second video stimulus was previously the input video stimulus.
Claim 53
Dependent Claim
86 words
The apparatus of claim 43 , including an image data storage apparatus having a data input coupled to said first input, said storage apparatus including a control input for receiving an indication that the input video stimulus has changed from the first video stimulus to the second video stimulus, said storage apparatus operable when said second image data is present at said first input for storing said second image data in said storage apparatus in response to said indication that the input video stimulus has changed.
Claim 54
Dependent Claim
37 words
The apparatus of claim 42 , including an image data storage apparatus for storing therein said further image data, said selector having a data input coupled to said storage apparatus to receive therefrom said further image data.
References Cited (Backward Citations)
US4716453A
Cited
EP0590974A2
Cited
EP0606675A2
Cited
US5684954A
Cited
US5416520A
Cited
US5790179A
Cited
US5446491A
Cited
US5602592A
Cited
US5859932A
Cited
US5841475A
Cited
US5850207A
Cited
WO1997028652A2
Cited
US5933536A
Cited
US5923783A
Cited
WO1998032281A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-04-14 | 2006-10-14 | 2007-04-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-04-14 | 2010-10-14 | 2011-04-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-04-14 | 2014-10-14 | 2015-04-15 | $7700.00 | Window Closed / Lapsed |