Patent US4661849A successfully refreshed from Google Patents.
US4661849A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for providing motion estimation signals for communicating image sequences
Assignee: ACCEL CAPITAL (INTERNATIONAL) LP
•
Filing: 1985-06-03
•
Granted: 1987-04-28
•
Expires: 2005-06-03
Abstract
Abstract An image sequence transmission method and apparatus transmit a sequence of successive images over a bandwidth limited channel. The transmitter has a motion estimator for estimating the motion displacement between successive image frames of the sequence. The motion estimator divides each image into nonoverlapping blocks, each block including a plurality of picture elements. The apparatus then successively selects, in accordance with a steepest descent estimation technique, an initial value of a motion vector displacement for each successive block. Thereafter, an iterative process determines using the steepest descent approach, successive values of the motion displacement vector for a block and the iteration process is terminated when an iteration error measure, which is associated with the steepest descent method, is less than a predetermined threshold value. In particular embodiments of the invention, an adaptive approach is used wherein the step size parameter is incremented in accordance with a gradient error used in the steepest descent technique. In addition, methods and apparatus for determining an initial motion vector field value based upon of the motion displacements in adjacent blocks advantageously determine the initial displacement vector for a block.
Inventors
- 👤 Brian L. Hinman
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 21:02
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N19/51; G; G06; G06T; G06T7/00; G06T7/20; G06T7/223; H04N19/56; G06T2207/00; G06T2207/10; G06T2207/10016
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
113 words
In an image sequence transmission method for transmitting a sequence of images over a bandwidth limited channel, a motion estimation method for estimating for successive image frames, a measure of motion displacement between successive images comprising the steps of dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, selecting an initial value of a motion vector displacement for each successive block, iteratively determining, using a steepest descent method, succession values of said motion vector displacement for successive blocks of an image, and terminating said iteration step for a block when an iteration error measure, associated with said steepest descent method, is less than a predetermined threshold value.
Claim 2
Dependent Claim
113 words
In an image sequence transmission method for transmitting a sequence of images over a bandwidth limited channel, a motion estimation method for estimating for successive image frames, a measure of motion displacement between successive images comprising the steps of dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, selecting an initial value of a motion vector displacement for each successive block, iteratively determining, using a steepest descent method, succession values of said motion vector displacement for successive blocks of an image, and terminating said iteration step for a block when an iteration error measure, associated with said steepest descent method, is less than a predetermined threshold value.
Claim 3
Dependent Claim
40 words
The motion estimation method of claim 1 wherein said selecting step comprises the step of generating said initial value of the motion vector displacement for a block from a weighted average of previously determined motion vector displacements for adjacent blocks.
Claim 4
Dependent Claim
42 words
The motion estimation method of claim 2 wherein said selecting step further comprises selecting, for said adjacent blocks, a previous block on the same block scan line and a previous, a corresponding, and a future block on a previous block scan line.
Claim 5
Dependent Claim
42 words
The motion estimation method of claim 3 wherein said weighting factors are respectively 0.3, 0, 0.4 , and 0.3 for said previous block on said same block scan line and said previous, corresponding, and future blocks of the previous block scan line.
Claim 6
Dependent Claim
59 words
The motion estimation method of claim 1 wherein said iteratively determining step comprises the steps of modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, and said terminating step terminates said iteration process when said multiplicative product is less than said predetermined threshold value.
Claim 7
Dependent Claim
55 words
The motion estimation method of claim 1 wherein said iteratively determining step comprises the step of modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, and adaptively modifying an initial incremental step value in accordance with said error gradient value.
Claim 8
Dependent Claim
42 words
The motion estimation method of claim 6 wherein said modifying step comprises multiplying a step value for a previous iteration by a constant having a value dependent upon the error gradients for at least the last two iterations of said determining step.
Claim 9
Dependent Claim
25 words
The motion estimation method of claim 7 wherein said terminating step terminates said iteration process when said error gradient is less than said predetermined threshold.
Claim 10
Dependent Claim
28 words
The motion estimation method of claim 6 further comprising the step of limiting the maximum motion vector displacement to be less than a selected maximum displacement threshold value.
Claim 11
Dependent Claim
31 words
The motion estimation method of claim 6 further comprising the step of limiting the maximum value of the multiplicative product to be less than a selected maximum update threshold step size.
Claim 12
Dependent Claim
164 words
In an image sequence transmission method for transmitting a sequence of images over a bandwidth limited channel, a motion estimation method for estimating for successive image frames, a measure of motion displacement between successive images comprising the steps of dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, generating an initial value of the motion vector displacement for a block from a weighted average of previously determined motion vector displacements for adjacent blocks, iteratively determining, using a steepest descent method, succession values of said motion vector displacement for successive blocks of an image, modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, adaptively modifying an initial step value in accordance with said error gradient value, and terminating said iteration step for a block when a multiplicative product of said initial step value and said error gradient is less than a predetermined threshold value.
Claim 13
Dependent Claim
164 words
In an image sequence transmission method for transmitting a sequence of images over a bandwidth limited channel, a motion estimation method for estimating for successive image frames, a measure of motion displacement between successive images comprising the steps of dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, generating an initial value of the motion vector displacement for a block from a weighted average of previously determined motion vector displacements for adjacent blocks, iteratively determining, using a steepest descent method, succession values of said motion vector displacement for successive blocks of an image, modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, adaptively modifying an initial step value in accordance with said error gradient value, and terminating said iteration step for a block when a multiplicative product of said initial step value and said error gradient is less than a predetermined threshold value.
Claim 14
Dependent Claim
116 words
In an image sequence transmission system for transmitting a sequence of images over a bandwidth limited channel, a motion estimation apparatus for estimating, for successive image frames, a measure of motion displacement between successive images comprising means for dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, means for selecting an initial value of a motion vector displacement for each successive block, means for iteratively determining, using a steepest descent approach, successive values of said motion vector displacement for successive blocks for an image, and means for terminating said iteration for a block when an iteration error measure associated with said steepest descent, is less than a predetermined threshold value.
Claim 15
Dependent Claim
116 words
In an image sequence transmission system for transmitting a sequence of images over a bandwidth limited channel, a motion estimation apparatus for estimating, for successive image frames, a measure of motion displacement between successive images comprising means for dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, means for selecting an initial value of a motion vector displacement for each successive block, means for iteratively determining, using a steepest descent approach, successive values of said motion vector displacement for successive blocks for an image, and means for terminating said iteration for a block when an iteration error measure associated with said steepest descent, is less than a predetermined threshold value.
Claim 16
Dependent Claim
39 words
The motion estimation apparatus of claim 12 wherein said selecting means comprises means for generating said initial value of the motion vector displacement for a block from a weighted average of previously determined motion vector displacements for adjacent blocks.
Claim 17
Dependent Claim
44 words
The motion estimation apparatus of claim 13 wherein said selecting means further comprises means for selecting, for said adjacent blocks, a previous block on the same block scan line and a previous, a corresponding, and a future block on a previous block scan line.
Claim 18
Dependent Claim
41 words
The motion estimation apparatus of claim 14 wherein said weighting factors are respectively 0.3, 0, 0.4, and 0.3 for said previous block on said same block scan line, and said previous, corresponding, and future blocks of the previous block scan line.
Claim 19
Dependent Claim
58 words
The motion estimation apparatus of claim 12 wherein said iteratively determining means comprises means for modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, and said terminating means terminates said iteration means when said multiplicative product is less than said predetermined threshold value.
Claim 20
Dependent Claim
56 words
The motion estimation apparatus of claim 12 further wherein said determining means comprises means for modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, and means for adaptively modifying an initial incremental step value in accordance with said error gradient value.
Claim 21
Dependent Claim
41 words
The motion estimation apparatus of claim 17 wherein said modifying means further comprises means for multiplying a step value for a previous iteration by a constant having a value dependent upon the error gradients of at least the last two iterations.
Claim 22
Dependent Claim
25 words
The motion estimation apparatus of claim 18 wherein said terminating means terminates said iteration means when said error gradient is less than said predetermined threshold.
Claim 23
Dependent Claim
27 words
The motion estimation apparatus of claim 17 further comprising means for limiting the maximum motion vector displacement to be less than a selected maximum displacement threshold value.
Claim 24
Dependent Claim
29 words
The motion estimation apparatus of claim 17 further comprising means for limiting the maximum value of the multiplicative product to be less than a selected update threshold step size.
Claim 25
Dependent Claim
172 words
In an image sequence transmission system for transmitting a sequence of images over a bandwidth limited channel, a motion estimation apparatus for estimating, for successive image frames, a measure of motion displacement between successive images comprising means for dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, means for generating an initial value of the motion vector displacement for a block from a weighted average of previously determined motion vector displacements for adjacent blocks, means for iteratively determining, using a steepest descent approach, successive values of said motion vector displacement for successive blocks for an image, means for modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, means for adaptively modifying an initial step value in accordance with said error gradient value, and means for terminating said iteration for a block when a multiplicative product of the initial step value and said error gradient is less than a predetermined threshold value.
Claim 26
Dependent Claim
172 words
In an image sequence transmission system for transmitting a sequence of images over a bandwidth limited channel, a motion estimation apparatus for estimating, for successive image frames, a measure of motion displacement between successive images comprising means for dividing each said image into non-overlapping blocks, each block having a plurality of picture elements, means for generating an initial value of the motion vector displacement for a block from a weighted average of previously determined motion vector displacements for adjacent blocks, means for iteratively determining, using a steepest descent approach, successive values of said motion vector displacement for successive blocks for an image, means for modifying, for each iteration, a previous motion vector displacement in accordance with a multiplicative product of an incremental step value and an error gradient, means for adaptively modifying an initial step value in accordance with said error gradient value, and means for terminating said iteration for a block when a multiplicative product of the initial step value and said error gradient is less than a predetermined threshold value.
References Cited (Backward Citations)
US3632865A
Cited
US4302775A
Cited
US4394774A
Cited
US4218703A
Cited
US4245248A
Cited
US4237484A
Cited
US4255763A
Cited
US4281344A
Cited
US4485400A
Cited
US4447886A
Cited
US4581638A
Cited
US4591909A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1990-04-27 | 1990-10-27 | 1991-04-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1994-04-27 | 1994-10-27 | 1995-04-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1998-04-27 | 1998-10-27 | 1999-04-28 | $7700.00 | Window Closed / Lapsed |