EP0397206A2
Expired / Lapsed
EP
⏱️ 0.0 years remaining
Adaptive interframe prediction coded video communications system
Assignee: NEC Corp
•
Filing: 1990-05-11
•
Granted: —
•
Expires: 2010-05-11
Abstract
Abstract At the transmit end of a video communications system, a first motion vector is derived from successive frames during a frame transmit mode and a second motion vector is derived during or immediately following a frame discard mode. An interframe predicted error signal is generated which is representative of the difference between each input frame and a motion-compensated, previous frame during the frame transmit mode, the difference being zero during the frame discard mode. The predicted error signal and the vectors are transmitted to the receive end of the system. In a first embodiment, the second motion vector is derived at the transmit end from frames spaced apart by a discarded frame, and at the receive end, original frames are recovered from the predicted error signal as well as from the first and second motion vectors, and the second motion vector is down-scaled and evaluated whether it is valid or not. During frame discard mode, motion compensation is performed on the recovered frame using the down-scaled vector in response to a valid evaluation, but no compensation is performed if invalid evaluation is made. In a second embodiment, the second motion vector is derived at the transmit end from successive frames using a larger block size than that used in the first motion vector. At the receive end, the first motion vector as well as the error signal are used in recovering original frames. During the frame discard mode, the second vector is simply used for motion compensation.
Inventors
- 👤 Toshiyuki Tanoi
Bibliographic Details
Application Number
—
Jurisdiction
EP
Data Source
google_patents
Last Synchronized
2026-10-25 11:45
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/577; H04N19/10; H04N19/102; H04N19/124; H04N19/132; H04N19/587
Claims Analysis
Total Claims: 35
Claim 1
Independent Claim
346 words
A digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising: a motion vector detector operable during said frame transmit mode for deriving a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which was discarded during said frame discard mode; a coding circuit for locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first and second motion vectors, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; transmit means for transmitting said predicted error signal and said first and second motion vectors through a transmission medium; receive means for receiving said predicted error signal and said first and second motion vectors through said transmission medium; a decoding circuit for recovering original frames from the received predicted error signal and the received first and second motion vectors; variable delay means coupled to said decoding circuit; means for down-scaling the received second motion vector; decision means for making a first or second decision if the received second motion vector is valid or invalid, respectively, for motion compensation to be effected during said frame discard mode; and means for causing said variable delay means to introduce no delays to frames recovered by said decoding circut during said frame transmit mode, and responsive to said first decision for causing said variable delay means to introduce a delay corresponding to the down-scaled motion vector to a frame recovered by said decoding circuit during said frame discard mode and responsive to said second decision for causing said variable delay means to introduce no delay to the frame recovered during said frame discard mode.
Claim 2
Dependent Claim
346 words
A digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising: a motion vector detector operable during said frame transmit mode for deriving a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which was discarded during said frame discard mode; a coding circuit for locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first and second motion vectors, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; transmit means for transmitting said predicted error signal and said first and second motion vectors through a transmission medium; receive means for receiving said predicted error signal and said first and second motion vectors through said transmission medium; a decoding circuit for recovering original frames from the received predicted error signal and the received first and second motion vectors; variable delay means coupled to said decoding circuit; means for down-scaling the received second motion vector; decision means for making a first or second decision if the received second motion vector is valid or invalid, respectively, for motion compensation to be effected during said frame discard mode; and means for causing said variable delay means to introduce no delays to frames recovered by said decoding circut during said frame transmit mode, and responsive to said first decision for causing said variable delay means to introduce a delay corresponding to the down-scaled motion vector to a frame recovered by said decoding circuit during said frame discard mode and responsive to said second decision for causing said variable delay means to introduce no delay to the frame recovered during said frame discard mode.
Claim 3
Dependent Claim
25 words
A digital video communications system as claimed in claim 1, wherein said down-scaling means halves horizontal and vertical components of the received second motion vector.
Claim 4
Dependent Claim
48 words
A digital video communications system as claimed in claim 1 or 2, wherein said decision means makes said first decision if the predicted error signal which is received immediately following a discarded frame is below said threshold or said second decision if said signal is above said threshold.
Claim 5
Dependent Claim
61 words
A digital video communications system as claimed in claim 3, wherein said decision means calculates absolute values of the predicted error signal of a frame period following said discarded frame and gives a sum of said absolute values, and makes said first decision if said sum is below said threshold or said second decision if said sum is above said threshold.
Claim 6
Dependent Claim
33 words
A digital video communications system as claimed in any of claims 1 to 4, further comprising a spatial lowpass filter for lowpass-filtering said current frame before being applied to said motion vector detector.
Claim 7
Dependent Claim
291 words
A decoding apparatus for a digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, wherein a coding apparatus derives a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which is discarded during said frame discard mode, and generates an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between the current frame and a motion-compensated, previous frame during said frame transmit mode and is representative of zero difference during said frame discard mode, wherein said first and second motion vectors and said error signal are transmitted through a transmission medium and received by the decoding apparatus, comprising: a decoding circuit for recovering original frames from the received predicted error signal and the received first and second motion vectors; variable delay means coupled to said decoding circuit; means for down-scaling the received second motion vector; decision means for making a first or second decision if the received second motion vector is valid or invalid, respectively, for motion compensation to be effected during said frame discard mode; and means for causing said variable delay means to introduce no delays to frames recovered by said decoding circut during said frame transmit mode, and responsive to said first decision for causing said variable delay means to introduce a delay corresponding to the down-scaled second motion vector to a frame recovered by said decoding circuit during said frame discard mode and responsive to said second decision for causing said variable delay means to introduce no delay to the frame recovered during said frame discard mode.
Claim 8
Dependent Claim
291 words
A decoding apparatus for a digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, wherein a coding apparatus derives a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which is discarded during said frame discard mode, and generates an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between the current frame and a motion-compensated, previous frame during said frame transmit mode and is representative of zero difference during said frame discard mode, wherein said first and second motion vectors and said error signal are transmitted through a transmission medium and received by the decoding apparatus, comprising: a decoding circuit for recovering original frames from the received predicted error signal and the received first and second motion vectors; variable delay means coupled to said decoding circuit; means for down-scaling the received second motion vector; decision means for making a first or second decision if the received second motion vector is valid or invalid, respectively, for motion compensation to be effected during said frame discard mode; and means for causing said variable delay means to introduce no delays to frames recovered by said decoding circut during said frame transmit mode, and responsive to said first decision for causing said variable delay means to introduce a delay corresponding to the down-scaled second motion vector to a frame recovered by said decoding circuit during said frame discard mode and responsive to said second decision for causing said variable delay means to introduce no delay to the frame recovered during said frame discard mode.
Claim 9
Dependent Claim
23 words
A decoding apparatus as claimed in claim 6, wherein said down-scaling means halves horizontal and vertical components of the received second motion vector.
Claim 10
Dependent Claim
47 words
A decoding apparatus as claimed in claim 6 or 7, wherein said decision means makes said first decision if the predicted error signal which is received immediately following a discarded frame is below a prescribed threshold or said second decision if said signal is above said threshold.
Claim 11
Dependent Claim
59 words
A decoding apparatus as claimed in claim 8, wherein said decision means calculates absolute values of the predicted error signal of a frame period following said discarded frame and gives a sum of said absolute values, and makes said first decision if said sum is below said threshold or said second decision if said sum is above said threshold.
Claim 12
Dependent Claim
31 words
A decoding apparatus as claimed in any of claims 6 to 9, further comprising a spatial lowpass filter for lowpass-filtering said current frames before being applied to said motion vector detector.
Claim 13
Dependent Claim
287 words
A digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising: a first motion vector detector for providing block matching between successive input frames with a smaller block size during said frame transmit mode and producing a first motion vector; a second motion vector detector for providing block matching between successive input frames with a larger block size during said frame discard mode and producing a second motion vector; a coding circuit for locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first motion vector, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; transmit means for transmitting said predicted error signal and said first and second motion vectors signal through a transmission medium; receive means for receiving said predicted error signal and said first and second motion vectors through said transmission medium; a decoding circuit for recovering original frames from the received predicted error signal and the received first motion vector; variable delay means coupled to said decoding circuit; and means for causing said variable delay means to introduce no delays to frames recovered by said decoding circuit during said frame transmit mode and for causing said variable delay means to introduce a delay corresponding to the received second motion vector to a frame recovered by said decoding circuit during said frame discard mode.
Claim 14
Dependent Claim
287 words
A digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising: a first motion vector detector for providing block matching between successive input frames with a smaller block size during said frame transmit mode and producing a first motion vector; a second motion vector detector for providing block matching between successive input frames with a larger block size during said frame discard mode and producing a second motion vector; a coding circuit for locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first motion vector, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; transmit means for transmitting said predicted error signal and said first and second motion vectors signal through a transmission medium; receive means for receiving said predicted error signal and said first and second motion vectors through said transmission medium; a decoding circuit for recovering original frames from the received predicted error signal and the received first motion vector; variable delay means coupled to said decoding circuit; and means for causing said variable delay means to introduce no delays to frames recovered by said decoding circuit during said frame transmit mode and for causing said variable delay means to introduce a delay corresponding to the received second motion vector to a frame recovered by said decoding circuit during said frame discard mode.
Claim 15
Dependent Claim
32 words
A digital video communications system as claimed in claim 11, further comprising a spatial lowpass filter for lowpass-filtering said current frames before being applied to said first and second motion vector detectors.
Claim 16
Dependent Claim
190 words
A coding apparatus for a digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising: a first motion vector detector for providing block matching between successive input frames with a smaller block size during said frame transmit mode and producing a first motion vector; a second motion vector detector for providing block matching between successive input frames with a larger block size during said frame discard mode and producing a second motion vector; a coding circuit for locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first motion vector, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; and transmit means for transmitting said predicted error signal and said first and second motion vectors through a transmission medium.
Claim 17
Dependent Claim
190 words
A coding apparatus for a digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising: a first motion vector detector for providing block matching between successive input frames with a smaller block size during said frame transmit mode and producing a first motion vector; a second motion vector detector for providing block matching between successive input frames with a larger block size during said frame discard mode and producing a second motion vector; a coding circuit for locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first motion vector, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; and transmit means for transmitting said predicted error signal and said first and second motion vectors through a transmission medium.
Claim 18
Dependent Claim
32 words
A digital video communications system as claimed in claim 13, further comprising a spatial lowpass filter for lowpass-filtering said current frames before being applied to said first and second motion vector detectors.
Claim 19
Independent Claim
302 words
A method for use in a digital video communications system which operates in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising the steps of: a) deriving a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which is discarded; b) locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first and second motion vectors, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; c) transmitting said predicted error signal and said first and second motion vectors through a transmission medium; d) receiving said predicted error signal and said first and second motion vectors through said transmission medium; e) recovering original frames from the received predicted error signal and the received first and second motion vectors; f) down-scaling the received second motion vector; g) making a first or second decision if the received second motion vector is valid or invalid, respectively, for motion compensation to be effected during said frame discard mode; and h) introducing a delay corresponding to the down-scaled motion vector to the frame which is recovered by the step (e) during said frame discard mode if said first decision is made by the step (g), introducing no delays to the last-mentioned frame if said second decision is made, and introducing no delays to frames which are recovered by the step (e) during said frame transmit mode.
Claim 20
Independent Claim
302 words
A method for use in a digital video communications system which operates in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising the steps of: a) deriving a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which is discarded; b) locally recovering a previous input frame during said frame transmit mode, repeating the recovered frame during said frame discard mode, motion-compensating for the locally recovered frame with said first and second motion vectors, and generating an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between said current input frame and said motion-compensated frame during said frame transmit mode and is representative of a zero difference during said frame discard mode; c) transmitting said predicted error signal and said first and second motion vectors through a transmission medium; d) receiving said predicted error signal and said first and second motion vectors through said transmission medium; e) recovering original frames from the received predicted error signal and the received first and second motion vectors; f) down-scaling the received second motion vector; g) making a first or second decision if the received second motion vector is valid or invalid, respectively, for motion compensation to be effected during said frame discard mode; and h) introducing a delay corresponding to the down-scaled motion vector to the frame which is recovered by the step (e) during said frame discard mode if said first decision is made by the step (g), introducing no delays to the last-mentioned frame if said second decision is made, and introducing no delays to frames which are recovered by the step (e) during said frame transmit mode.
Claim 21
Dependent Claim
22 words
A method as claimed in claim 15, wherein the step (g) halves horizontal and vertical components of the received second motion vector.
Claim 22
Dependent Claim
46 words
A method as claimed in claim 15 or 16, wherein the step (h) makes said first decision if the predicted error signal which is received immediately following a discarded frame is below a prescribed threshold or said second decision if said signal is above said threshold.
Claim 23
Dependent Claim
66 words
A method as claimed in claim 17, wherein the step (h) calculates absolute values of the predicted error signal of a frame period following said discarded frame and gives a sum of said absolute values and compares the sum against said threshold for making said first decision if said sum is below said threshold or making said second decision if said sum is above said threshold.
Claim 24
Independent Claim
30 words
A method as claimed in any one of claims 15 to 18, further comprising the step of lowpass-filtering said input frames on a spatial domain prior to the step (a).
Claim 25
Dependent Claim
296 words
A decoding method for use in the receive end of a digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, wherein the transmit end of the system derives a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which is discarded during said frame discard mode, and generates an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between the current frame and a motion-compensated, previous frame during said frame transmit mode and is representative of zero difference during said frame discard mode, wherein said first and second motion vectors and said error signal are transmitted through a transmission medium and received by the receive end, wherein said first and second motion vectors and said error signal are transmitted through a transmission medium and received by said receive end, comprising the steps of: a) recovering original frames from the received interframe predicted error signal and the received first and second motion vectors; b) down-scaling the received second motion vector; c) making a first or second decision if the received second motion vector is valid of invalid, respectively, for motion compensation to be effected during said frame discard mode; and d) introducing a delay corresponding to the down-scaled motion vector to a frame which is recovered by the step (a) during said frame discard mode if said first decision is made by the step (c), introducing no delays to the last-mentioned frame if said second decision is made, and introducing no delays to a frame which is recovered by the step (a) during said frame transmit mode.
Claim 26
Dependent Claim
296 words
A decoding method for use in the receive end of a digital video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, wherein the transmit end of the system derives a first motion vector from a current input frame and a previous frame and a second motion vector from frames spaced apart by an intermediate frame which is discarded during said frame discard mode, and generates an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of the difference between the current frame and a motion-compensated, previous frame during said frame transmit mode and is representative of zero difference during said frame discard mode, wherein said first and second motion vectors and said error signal are transmitted through a transmission medium and received by the receive end, wherein said first and second motion vectors and said error signal are transmitted through a transmission medium and received by said receive end, comprising the steps of: a) recovering original frames from the received interframe predicted error signal and the received first and second motion vectors; b) down-scaling the received second motion vector; c) making a first or second decision if the received second motion vector is valid of invalid, respectively, for motion compensation to be effected during said frame discard mode; and d) introducing a delay corresponding to the down-scaled motion vector to a frame which is recovered by the step (a) during said frame discard mode if said first decision is made by the step (c), introducing no delays to the last-mentioned frame if said second decision is made, and introducing no delays to a frame which is recovered by the step (a) during said frame transmit mode.
Claim 27
Dependent Claim
23 words
A decoding method as claimed in claim 20, wherein the step (b) halves horizontal and vertical components of the received second motion vector.
Claim 28
Dependent Claim
48 words
A decoding method as claimed in claim 20 or 21, wherein the step (c) makes said first decision if the predicted error signal which is received immediately following a discarded frame is below a prescribed threshold and makes said second decision if said signal is above said threshold.
Claim 29
Dependent Claim
63 words
A decoding method as claimed in claim 22, wherein the step (c) calculates absolute values of the predicted error signal of a frame period following said discarded frame and gives a sum of said absolute values, and wherein said first decision is made if said sum is below said threshold and said second decision is made if said sum is above said threshold.
Claim 30
Dependent Claim
240 words
A coding and decoding method for use in a video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising the steps of: a) providing block matching between successive input frames with a smaller block size during said frame transmit mode and producing a first motion vector, and providing block matching between successive input frames with a larger block size during said frame discard mode and producing a second motion vector; b) delaying said input frames for one frame period, providing motion compensation on the delayed frame with said first motion vector and producing an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of a difference between each of said input frames and the motion-compensated frame during said frame transmit mode and is zero during said frame discard mode; c) transmitting said predicted error signal and said first and second motion vectors through a transmission medium; d) receiving said predicted error signal and said first and second motion vectors through said transmission medium; e) recovering original frames from the received predicted error signal and the received first motion vector; and f) introducing no delays to frames recovered by the step (f) during said frame transmit mode and introducing a delay corresponding to the received second motion vector to a frame recovered by the step (f) during said frame discard mode.
Claim 31
Dependent Claim
240 words
A coding and decoding method for use in a video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising the steps of: a) providing block matching between successive input frames with a smaller block size during said frame transmit mode and producing a first motion vector, and providing block matching between successive input frames with a larger block size during said frame discard mode and producing a second motion vector; b) delaying said input frames for one frame period, providing motion compensation on the delayed frame with said first motion vector and producing an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of a difference between each of said input frames and the motion-compensated frame during said frame transmit mode and is zero during said frame discard mode; c) transmitting said predicted error signal and said first and second motion vectors through a transmission medium; d) receiving said predicted error signal and said first and second motion vectors through said transmission medium; e) recovering original frames from the received predicted error signal and the received first motion vector; and f) introducing no delays to frames recovered by the step (f) during said frame transmit mode and introducing a delay corresponding to the received second motion vector to a frame recovered by the step (f) during said frame discard mode.
Claim 32
Dependent Claim
25 words
A method as claimed in claim 24, further comprising the step of lowpass-filtering said input frames on a spatial domain prior to the step (b).
Claim 33
Dependent Claim
163 words
A coding method for a video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising the steps of: a) providing block matching between successive input frames with a smaller block size and producing a first motion vector during said frame transmit mode, and providing block matching between successive input frames with a larger block size and producing a second motion vector during said frame discard mode; b) delaying said input frames for one frame period, providing motion compensation on the delayed frame with said first motion vector and producing an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of a difference between each of said input frames and the motion-compensated frame during said frame transmit mode and is zero during said frame discard mode; and c) transmitting said predicted error signal and said first and second motion vectors through a transmission medium.
Claim 34
Dependent Claim
163 words
A coding method for a video communications system operating in a frame transmit mode or a frame discard mode depending on a rate of signals being transmitted, comprising the steps of: a) providing block matching between successive input frames with a smaller block size and producing a first motion vector during said frame transmit mode, and providing block matching between successive input frames with a larger block size and producing a second motion vector during said frame discard mode; b) delaying said input frames for one frame period, providing motion compensation on the delayed frame with said first motion vector and producing an interframe predicted error signal containing an initial frame followed by a differential signal which is representative of a difference between each of said input frames and the motion-compensated frame during said frame transmit mode and is zero during said frame discard mode; and c) transmitting said predicted error signal and said first and second motion vectors through a transmission medium.
Claim 35
Dependent Claim
25 words
A method as claimed in claim 26, further comprising the step of lowpass-filtering said input frames on a spatial domain prior to the step (b).
References Cited (Backward Citations)
No citation records indexed.
USPTO Annuity & Maintenance Windows
Maintenance schedule is calculated for granted US utility patents.