Method and apparatus for efficiently communicating image sequences

Claim 2

An image sequence transmission apparatus for transmitting a sequence of images over a channel comprising means for estimating, for successive images of the sequence, a measure of the motion displacement between said successive images, lossy coding means for representing said sequentially generated measures for an image as a coded motion signal representation, means for generating, using said coded motion signal representation, an error reconstruction signal, and means for transmitting over said channel said coded motion signal representation and said error reconstruction signal.

Claim 3

The image sequence transmission apparatus of claim 1 wherein said generating means comprises a motion reconstruction means for generating motion reconstruction signals in response to said coded motion signal representation, and a motion compensation loop means for modifying an input frame in response to said motion reconstruction signals for generating said error reconstruction signal.

Claim 4

The image sequence transmission apparatus of claim 2 wherein said loop means comprises an image frame buffer, having a frame output for successively storing images representative of said input image sequence, a motion compensator means responsive to said motion reconstruction signals and a frame buffer output for constructing an estimated receiver image signal, lossy compression means responsive to a difference between said estimated receiver image signal and a corresponding input image for generating said error reconstruction signal, reconstruction means for constructing an error reconstruction image from said error reconstruction signal, and adder means responsive to said reconstruction means and said estimated receiver image signal for generating an estimated previous receiver image for storage in said frame buffer.

Claim 5

The image sequence transmission apparatus of claim 1 wherein said estimating means comprises a frame buffer for successively storing input images, and a motion estimation means responsive to a stored previous image output of said frame buffer and a present image input for generating said measure of motion displacement.

Claim 6

The image sequence transmission apparatus of claim 1 wherein said estimating means comprises a motion estimation means responsive to an estimated previous receiver image and a present image input for generating said measure of motion displacement.

Claim 7

The image sequence transmission apparatus of claim 1 wherein said lossy coding means comprises a temporal differential pulse-code-modulation means for encoding said generated measures.

Claim 8

The image sequence transmission apparatus of claim 1 wherein said estimating means comprises an iterative, spatial-domain motion estimator having an adaptive, steepest descent error minimization means.

Claim 9

The image sequence transmission apparatus of claim 1 wherein said lossy coding means comprises a transform coding means for encoding said generated measures.

Claim 10

The image sequence transmission apparatus of claim 2 wherein said lossy coding means is a block transform coding means, and wherein said motion reconstruction means comprises a motion field interpolation means for receiving motion vector signals associated with block regions of an image and for assigning to each pixel of a block region, an interpolated motion vector signal value for forming said motion reconstruction signals.

Claim 11

An image sequence communications apparatus, for communicating a sequence of images over a channel, comprising a transmitter including means for estimating, for successive images of the sequence, a measure of the motion displacement between said successive images, lossy coding means for representing said sequentially generated measures for an image as a coded motion signal representation, means for generating, using said coded motion signal representation, an error reconstruction signal, and means for transmitting over said channel said coded motion signal representation and said error reconstruction signal, and a receiver including means for constructing an error image representation from a received error reconstruction signal, means for constructing a motion field measure from a received coded motion signal representation, and means responsive to said receiver error image representation and said receiver motion field measure for generating a receiver reconstructed image sequence.

Claim 12

An image sequence communications apparatus, for communicating a sequence of images over a channel, comprising a transmitter including means for estimating, for successive images of the sequence, a measure of the motion displacement between said successive images, lossy coding means for representing said sequentially generated measures for an image as a coded motion signal representation, means for generating, using said coded motion signal representation, an error reconstruction signal, and means for transmitting over said channel said coded motion signal representation and said error reconstruction signal, and a receiver including means for constructing an error image representation from a received error reconstruction signal, means for constructing a motion field measure from a received coded motion signal representation, and means responsive to said receiver error image representation and said receiver motion field measure for generating a receiver reconstructed image sequence.

Claim 13

The image sequence communications apparatus of claim 10 wherein said receiver generating means comprises a motion field interpolator, a receiver motion compensation loop means responsive to said motion field interpolator and said error constructing means for generating a first image sequence, and a temporal frame interpolator responsive to said motion field interpolator for inserting at least one motion interpolated image between successive images of said first image sequence for generating a second image sequence.

Claim 14

The image sequence communications apparatus of claim 10 wherein said motion field construction means comprises means for employing a temporal differential pulse-code-modulated decoding means for reconstructing said motion field measures for the images.

Claim 15

The image sequence communications apparatus of claim 10 wherein said motion field construction means comprises inverse transform means for reconstructing said motion field measures for the images.

Claim 16

An image sequence transmission apparatus for transmitting a sequence of images over a channel comprising an image frame buffer having a frame output for successively storing images representative of said input image sequence, a motion estimation means responsive to a stored previous image output of said frame buffer and a present image input for generating, for successive images of the sequence, a measure of the motion displacement between said successive images, a block transform coding means for representing said sequentially generated measures for an image as a coded motion signal representation, a motion reconstruction means for generating motion reconstruction signals in response to said coded motion signal representation, said reconstruction means including a motion field interpolation means for receiving motion vector signals associated with block regions of an image and for assigning to each pixel of a block region, an interpolated motion vector signal value for forming said motion reconstruction signals, a motion compensator means responsive to said motion reconstruction signals and a frame buffer output for constructing an estimated receiver image signal, a block transform coding means responsive to a difference between said estimated receiver image signal and a corresponding input image for generating said error reconstruction signal, reconstruction means for constructing an error reconstruction image from said error reconstruction signal, adder means responsive to said reconstruction means and said estimated receiver image signal for generating an estimated previous receiver image for storage in said frame buffer, and means for transmitting over said channel said coded motion signal representation and said error reconstruction signal.

Claim 17

An image sequence transmission apparatus for transmitting a sequence of images over a channel comprising an image frame buffer having a frame output for successively storing images representative of said input image sequence, a motion estimation means responsive to a stored previous image output of said frame buffer and a present image input for generating, for successive images of the sequence, a measure of the motion displacement between said successive images, a block transform coding means for representing said sequentially generated measures for an image as a coded motion signal representation, a motion reconstruction means for generating motion reconstruction signals in response to said coded motion signal representation, said reconstruction means including a motion field interpolation means for receiving motion vector signals associated with block regions of an image and for assigning to each pixel of a block region, an interpolated motion vector signal value for forming said motion reconstruction signals, a motion compensator means responsive to said motion reconstruction signals and a frame buffer output for constructing an estimated receiver image signal, a block transform coding means responsive to a difference between said estimated receiver image signal and a corresponding input image for generating said error reconstruction signal, reconstruction means for constructing an error reconstruction image from said error reconstruction signal, adder means responsive to said reconstruction means and said estimated receiver image signal for generating an estimated previous receiver image for storage in said frame buffer, and means for transmitting over said channel said coded motion signal representation and said error reconstruction signal.

Claim 18

An image sequence transmission method for transmitting a sequence of images over a channel comprising the steps of estimating, for successive images of the sequence, a measure of the motion displacement between said images, representing said sequentially generated measures for an image as a lossy coded motion signal representation, generating, using said coded motion signal representation, an error reconstruction signal, and transmitting over the channel the coded motion signal representation and the error reconstruction signal.

Claim 19

An image sequence transmission method for transmitting a sequence of images over a channel comprising the steps of estimating, for successive images of the sequence, a measure of the motion displacement between said images, representing said sequentially generated measures for an image as a lossy coded motion signal representation, generating, using said coded motion signal representation, an error reconstruction signal, and transmitting over the channel the coded motion signal representation and the error reconstruction signal.

Claim 20

The image transmission method of claim 15 wherein said generating step comprises the steps of generating motion reconstruction signals in response to the coded motion signal representation, and modifying, using a feedback loop, an input frame in response to the motion reconstruction signals for generating the error reconstruction signal.

Claim 21

The image sequence transmission method of claim 16 further comprising the steps of successively storing images representative of the input image sequence, constructing an estimated receiver image signal from the motion reconstruction signal and an immediately previous image of the input, generating the error reconstruction signal from the difference between the estimated receiver image signal and a corresponding input image, constructing an error reconstruction image from the error reconstruction signal, and storing an estimated previous receiver image in response to the error reconstruction signal and the estimated receiver image signal.

Claim 22

The image sequence transmission method of claim 15 wherein the estimating step comprises the steps of successively storing input images, and generating the measure of motion displacement from a stored previous input image and a present image input.

Claim 23

The image sequence transmission method of claim 15 wherein the estimating step comprises the step of generating the measure of motion displacement from an estimated previous receiver image and a present image input.

Claim 24

The image sequence transmission method of claim 15 wherein said measure representing step comprises the step of encoding the generated measures using a temporal differential pulse-code-modulation method.

Claim 25

The image sequence transmission method of claim 15 wherein the estimating step comprises the step of employing an iterative, spatial-domain motion estimation method having an adaptive, steepest descent error minimization criteria.

Claim 26

The image sequence transmission method of claim 15 wherein said measure representing step comprises the step of transform coding said generated measures for an image for forming said coded motion signal representation.

Claim 27

The image sequence transmission method of claim wherein said representing step comprises the step of block transform coding, and said motion reconstruction signal generating step further comprises the steps of receiving motion vector signals associated with block regions of an image, and assigning to each pixel of a block region, an interpolated motion vector signal value for forming said motion reconstruction signals.

Claim 28

An image sequence communications method for communicating a sequence of images over a channel comprising the steps of estimating, for successive images of the sequence, a measure of the motion displacement between said images, representing said sequentially generated measures for an image as a lossy coded motion signal representation, generating, using said coded motion signal representation, an error reconstruction signal, transmitting over said channel said coded motion signal representation and said error reconstruction signal, constructing, at a receiver, an error image representation from a receiver error reconstruction signal, constructing, at the receiver, a motion field measure from a receiver, coded motion signal representation, and generating, at the receiver, a reconstructed image sequence from the receiver error representation and receiver motion field measure.

Claim 29

An image sequence communications method for communicating a sequence of images over a channel comprising the steps of estimating, for successive images of the sequence, a measure of the motion displacement between said images, representing said sequentially generated measures for an image as a lossy coded motion signal representation, generating, using said coded motion signal representation, an error reconstruction signal, transmitting over said channel said coded motion signal representation and said error reconstruction signal, constructing, at a receiver, an error image representation from a receiver error reconstruction signal, constructing, at the receiver, a motion field measure from a receiver, coded motion signal representation, and generating, at the receiver, a reconstructed image sequence from the receiver error representation and receiver motion field measure.

Claim 30

The image sequence communications method of claim 24 wherein said receiver generating step comprises the steps of interpolating the motion field measure, generating a first image sequence from the interpolated motion field measure and the error image representation, and temporally interpolating and inserting at least one motion interpolated image between successive images of the first image sequence for generating a second image sequence in response to the motion field interpolation signals.

Claim 31

The image sequence communications method of claim 25 wherein the motion field construction step comprises the step of employing a temporal differential pulse-code-modulated decoding process for reconstruction the motion field measures for the images.

Claim 32

The image sequence communications method of claim 25 wherein said motion field construction step comprises the step of employing an inverse transform method for reconstructing said motion field measures for the images.

Claim 33

An image sequence transmission method for transmitting a sequence of images over a channel comprising the steps of successively storing input images of the sequence, generating, for successive images of the sequence, a measure of the motion displacement between said images, from a stored previous input image and a present input image, block transform coding said sequentially geanerated measures for an image to obtain a lossy coded motion signal representation, generating motion reconstruction signals in response to the coded motion signal representation, said reconstruction generating step including receiving motion vector signals associated with block regions of an image, and assigning to each pixel of a block region, an interpolated motion vector signal value for forming said motion reconstruction signals, constructing an estimated receiver image signal from the motion reconstruction signal and an immediately previous image of the input, generating the error reconstruction signal from the difference between the estimated receiver image signal and a corresponding input image, constructing an error reconstruction image from the error reconstruction signal, storing an estimated previous receiver image in response to the error reconstruction signal and the estimated receiver image signal, and modifying, using a feedback loop, an input frame in response to the motion reconstruction signals for generating the error reconstruction signal.

Claim 34

An image sequence transmission method for transmitting a sequence of images over a channel comprising the steps of successively storing input images of the sequence, generating, for successive images of the sequence, a measure of the motion displacement between said images, from a stored previous input image and a present input image, block transform coding said sequentially geanerated measures for an image to obtain a lossy coded motion signal representation, generating motion reconstruction signals in response to the coded motion signal representation, said reconstruction generating step including receiving motion vector signals associated with block regions of an image, and assigning to each pixel of a block region, an interpolated motion vector signal value for forming said motion reconstruction signals, constructing an estimated receiver image signal from the motion reconstruction signal and an immediately previous image of the input, generating the error reconstruction signal from the difference between the estimated receiver image signal and a corresponding input image, constructing an error reconstruction image from the error reconstruction signal, storing an estimated previous receiver image in response to the error reconstruction signal and the estimated receiver image signal, and modifying, using a feedback loop, an input frame in response to the motion reconstruction signals for generating the error reconstruction signal.