Patent US5668600A successfully refreshed from Google Patents.
US5668600A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for encoding and decoding a video signal using feature point based motion estimation
Assignee: Quarterhill Inc
•
Filing: 1996-10-28
•
Granted: 1997-09-16
•
Expires: 2016-10-28
Abstract
Abstract An apparatus, for use in an image signal encoding system, encodes a bidirectionally predictive frame (B frame) of a digital video signal to generate an encoded B frame signal. The apparatus selects two groups of pixels from pixels contained in a detected processing regions of a first and a second reference frames as a first and a second sets of feature points, respectively, by using a feature points selection circuit; and then determines a first set of motion vectors between the current and the first reference frames and a second set of motion vectors between the current and the second reference frames through the use of a feature point motion estimation circuit. Thereafter, the apparatus selects a set of motion vectors for the set of feature points from the first and the second sets of motion vectors to thereby generate a selected set of motion vectors and selection information representing the selected set as the encoded B frame.
Inventors
- 👤 Min-Sup Lee
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 18:18
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/577; H04N19/537; H04N19/54
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
256 words
A method, for use in an image signal encoding system, for encoding a bidirectionally predictive frame (B frame) of a digital video signal based on two reconstructed neighboring frames of the B frame by employing a feature point based motion estimation approach to generate an encoded B frame signal, which comprises the steps of: (a) assigning a first reconstructed neighboring frame as a reference frame; (b) detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the reconstructed neighboring frames to generate region information denoting the detected processing region; (c) selecting a number of pixels from pixels contained in the detected processing region of the reference frame as a set of feature points based on the region information; (d) determining a set of motion vectors between the current and the reference frames, each of the set of motion vectors representing a motion for each of the feature points; (e) assigning the set of motion vectors as a first set of motion vectors and assigning a second reconstructed neighboring frame as the reference frame; (f) repeating the steps (c) and (d) to assign the set of motion vectors obtained from the repeated step (d) as a second set of motion vectors; and (g) selecting the set of motion vectors for the set of feature points from the first and the second sets of motion vectors to thereby generate a selected set of motion vectors and selection information representing the selected set as the encoded B frame.
Claim 2
Independent Claim
256 words
A method, for use in an image signal encoding system, for encoding a bidirectionally predictive frame (B frame) of a digital video signal based on two reconstructed neighboring frames of the B frame by employing a feature point based motion estimation approach to generate an encoded B frame signal, which comprises the steps of: (a) assigning a first reconstructed neighboring frame as a reference frame; (b) detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the reconstructed neighboring frames to generate region information denoting the detected processing region; (c) selecting a number of pixels from pixels contained in the detected processing region of the reference frame as a set of feature points based on the region information; (d) determining a set of motion vectors between the current and the reference frames, each of the set of motion vectors representing a motion for each of the feature points; (e) assigning the set of motion vectors as a first set of motion vectors and assigning a second reconstructed neighboring frame as the reference frame; (f) repeating the steps (c) and (d) to assign the set of motion vectors obtained from the repeated step (d) as a second set of motion vectors; and (g) selecting the set of motion vectors for the set of feature points from the first and the second sets of motion vectors to thereby generate a selected set of motion vectors and selection information representing the selected set as the encoded B frame.
Claim 3
Dependent Claim
107 words
The method as recited in claim 1, wherein said step (b) includes the steps of: (b1) subtracting each pixel value of the first reconstructed neighboring frame from each corresponding pixel value of the second reconstructed neighboring frame to generate a frame difference signal containing a plurality of pixel difference values; and (b2) comparing each of the pixel difference values with a predetermined threshold value to generate processing region information, wherein the processing region information represents the detected processing region which corresponds to a region of the frame difference signal containing a number of the pixel difference values, each being greater than or equal to the predetermined threshold.
Claim 4
Dependent Claim
137 words
The method as recited in claim 2, wherein said step(g) includes the steps of: (g1) determining a first group of motion vectors for all pixels contained in the processing region of the B frame based on the first set of motion vectors; (g2) determining a second group of motion vectors for all pixels contained in the processing region of the B frame based on the second set of motion vectors; (g3) producing a first predicted B frame and a second predicted B frame by using the first and the second groups of motion vectors, respectively; and (g4) selecting the set of motion vectors for the set of feature points from the first and the second sets of motion vectors, wherein the selected set of motion vectors generates a more similar predicted B frame to the B frame.
Claim 5
Dependent Claim
119 words
The method as recited in claim 3, wherein said step (g1) includes the steps of: (g11) converting the first set of motion vectors to a first sub-group of motion vectors for quasi-feature point pixels contained in the B frame wherein the quasi-feature point pixels represent a number of pixels of the B frame shifted from the feature point pixels of the first reference frame by the first set of motion vectors; and (g12) extracting a second sub-group of motion vectors for remaining pixels contained in the processing region of the B frame by using the first sub-group of motion vectors to thereby produce the first group of motion vectors including the first and the second sub-groups of motion vectors.
Claim 6
Dependent Claim
119 words
The method as recited in claim 4, wherein said steps (g2) includes the steps of: (g21) converting the second set of motion vectors to a first sub-group of motion vectors for quasi-feature point pixels contained in the B frame wherein the quasi-feature point pixels represent a number of pixels of the B frame shifted from the feature point pixels of the second reference frame by the second set of motion vectors; and (g22) extracting a second sub-group of motion vectors for remaining pixels contained in the processing region of the B frame by using the first sub-group of motion vectors to thereby produce the second group of motion vectors including the first and the second sub-groups of motion vectors.
Claim 7
Dependent Claim
84 words
The method as recited in claim 5, wherein said steps (g12) and (g22) include the steps of: (g221) assigning each of the remaining pixels of the current frame as a target pixel; (g222) selecting one or more quasi-feature point pixels contained in a predetermined region encompassing the target pixel; and (g223) calculating a motion vector for the target pixel by using motion vectors for the selected quasi-feature point pixels to thereby generate the second sub-group of motion vectors for all of the remaining pixels.
Claim 8
Dependent Claim
80 words
The method as recited in claim 6, wherein said step (c) includes the step of selecting the set of feature point pixels from the reference frame by using a grid and edge detection method which selects pixels located on the edge as the feature point pixels, wherein each of the selected pixels is located in a predetermined search range encompassing a corresponding node of the grid and has a maximum value among values of pixels contained the predetermined search range.
Claim 9
Dependent Claim
14 words
The method as recited in claim 7, wherein the grid is a rectangular grid.
Claim 10
Independent Claim
261 words
An apparatus, for use in an image signal encoding system, for encoding a bidirectionally predictive frame (B frame) of a digital video signal based on two reconstructed neighboring frames of the B frame by employing a feature point based motion estimation approach to generate an encoded B frame signal, which comprises the steps of: means for providing a first reconstructed neighboring frame as a first reference frame and providing a second reconstructed neighboring frame as a second reference frame; a detection means for detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the first and second reconstructed neighboring frames to generate region information denoting the detected processing region; a first selection means for selecting two groups of pixels from pixels contained in the detected processing regions of the first and the second reference frames as a first and a second sets of feature points based on the region information, respectively; a motion estimation means for determining a first set of motion vectors between the current and the first reference frames and determining a second set of motion vectors between the current and the second reference frames, each of the of motion vectors representing a motion for each of the feature points; a second selection means for selecting the set of motion vectors for the set of feature points from the first and the second sets of motion vectors to thereby generate a selected set of motion vectors and selection information representing the selected set as the encoded B frame.
Claim 11
Independent Claim
261 words
An apparatus, for use in an image signal encoding system, for encoding a bidirectionally predictive frame (B frame) of a digital video signal based on two reconstructed neighboring frames of the B frame by employing a feature point based motion estimation approach to generate an encoded B frame signal, which comprises the steps of: means for providing a first reconstructed neighboring frame as a first reference frame and providing a second reconstructed neighboring frame as a second reference frame; a detection means for detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the first and second reconstructed neighboring frames to generate region information denoting the detected processing region; a first selection means for selecting two groups of pixels from pixels contained in the detected processing regions of the first and the second reference frames as a first and a second sets of feature points based on the region information, respectively; a motion estimation means for determining a first set of motion vectors between the current and the first reference frames and determining a second set of motion vectors between the current and the second reference frames, each of the of motion vectors representing a motion for each of the feature points; a second selection means for selecting the set of motion vectors for the set of feature points from the first and the second sets of motion vectors to thereby generate a selected set of motion vectors and selection information representing the selected set as the encoded B frame.
Claim 12
Dependent Claim
106 words
The apparatus as recited in claim 9, wherein said detection means includes: means for subtracting each pixel value of the first reconstructed neighboring frame from each corresponding pixel value of the second reconstructed neighboring frame to generate a frame difference signal containing a plurality of pixel difference values; and means for comparing each of the pixel difference values with a predetermined threshold value to generate processing region information, wherein the processing region information represents the detected processing region which corresponds to a region of the frame difference signal containing a number of the pixel difference values, each being greater than or equal to the predetermined threshold.
Claim 13
Dependent Claim
144 words
The apparatus as recited in claim 10, wherein said second selection means includes: first determination means for determining a first group of motion vectors for all pixels contained in the processing region of the B frame based on the first set of motion vectors; second determination means for determining a second group of motion vectors for all pixels contained in the processing region of the B frame based on the second set of motion vectors; means for producing a first predicted B frame and a second predicted B frame by using the first and the second groups of motion vectors, respectively; and means for selecting the set of motion vectors for the set of feature points from the first and the second sets of motion vectors, wherein the selected set of motion vectors generates a more similar predicted B frame to the B frame.
Claim 14
Dependent Claim
119 words
The apparatus as recited in claim 11, wherein said first determination means includes: means for converting the first set of motion vectors to a first sub-group of motion vectors for quasi-feature point pixels contained in the B frame wherein the quasi-feature point pixels represent a number of pixels of the B frame shifted from the feature point pixels of the first reference frame by the first set of motion vectors; and means for extracting a second sub-group of motion vectors for remaining pixels contained in the processing region of the B frame by using the first sub-group of motion vectors to thereby produce the first group of motion vectors including the first and the second sub-groups of motion vectors.
Claim 15
Dependent Claim
118 words
The apparatus as recited in claim 12, wherein said second determination means includes: means for converting the second set of motion vectors to a first sub-group of motion vectors for quasi-feature point pixels contained in the B frame wherein the quasi-feature point pixels represent a number of pixels of the B frame shifted from the feature point pixels of the second reference frame by the second set of motion vectors; and means for extracting a second sub-group of motion vectors for remaining pixels contained in the processing region of the B frame by using the first sub-group of motion vectors to produce the first and the second sub-groups of motion vectors as the second group of motion vectors.
Claim 16
Dependent Claim
82 words
The apparatus as recited in claim 13, wherein said extraction means includes: means for assigning each of the remaining pixels of the current frame as a target pixel; means for selecting one or more quasi-feature point pixels contained in a predetermined region encompassing the target pixel; and means for calculating a motion vector for the target pixel by using motion vectors for the selected quasi-feature point pixels to thereby generate the second sub-group of motion vectors for all of the remaining pixels.
Claim 17
Dependent Claim
80 words
The apparatus as recited in claim 14, wherein said first selection means includes means for selecting the set of feature point pixels from the reference frame by using a grid and edge detection method which selects pixels located on the edge as the feature point pixels, wherein each of the selected pixels is located in a predetermined search range encompassing a corresponding node of the grid and has a maximum value among values of pixels contained the predetermined search range.
Claim 18
Dependent Claim
14 words
The apparatus as recited in claim 15, wherein the grid is a rectangular grid.
Claim 19
Independent Claim
175 words
A method, for use in an image signal decoding system, for decoding an encoded bidirectionally predictive frame (encoded B frame) of an encoded digital video signal based on two reconstructed neighboring frames of the encoded B frame by employing a feature point based motion estimation approach to generate a reconstructed B frame signal, wherein the B frame includes a set of motion vectors and selection information, which comprises the steps of: (a) selecting one of reconstructed neighboring frame as a reference frame based on the selection information; (b) detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the reconstructed neighboring frames to generate region information denoting the detected processing region; (c) selecting a number of pixels from pixels contained in the detected processing region of the reference frame as a set of feature points based on the region information; and (d) providing the reconstructed B frame by using the set of motion vectors, the selected set of feature points and the reference frame.
Claim 20
Independent Claim
175 words
A method, for use in an image signal decoding system, for decoding an encoded bidirectionally predictive frame (encoded B frame) of an encoded digital video signal based on two reconstructed neighboring frames of the encoded B frame by employing a feature point based motion estimation approach to generate a reconstructed B frame signal, wherein the B frame includes a set of motion vectors and selection information, which comprises the steps of: (a) selecting one of reconstructed neighboring frame as a reference frame based on the selection information; (b) detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the reconstructed neighboring frames to generate region information denoting the detected processing region; (c) selecting a number of pixels from pixels contained in the detected processing region of the reference frame as a set of feature points based on the region information; and (d) providing the reconstructed B frame by using the set of motion vectors, the selected set of feature points and the reference frame.
Claim 21
Dependent Claim
107 words
The method as recited in claim 17, wherein said step (b) includes the steps of: (b1) subtracting each pixel value of a first reconstructed neighboring frame from each corresponding pixel value of a second reconstructed neighboring frame to generate a frame difference signal containing a plurality of pixel difference values; and (b2) comparing each of the pixel difference values with a predetermined threshold value to generate the processing region information, wherein the region information represents the detected processing region which corresponds to a region of the frame difference signal containing a number of the pixel difference values, each being greater than or equal to the predetermined threshold.
Claim 22
Dependent Claim
65 words
The method as recited in claim 18, wherein said step (d) includes the steps of: (d1) determining a group of motion vectors for all pixels contained in the processing region of the B frame based on the set of motion vectors; and (d2) producing the reconstructed B frame and a second predicted B frame by using the group of motion vectors and the reference frame.
Claim 23
Dependent Claim
80 words
The method as recited in claim 19, wherein the step (c) includes the step of selecting the set of feature point pixels from the reference frame by using a grid and edge detection method which selects pixels located on the edge as the feature point pixels, wherein each of the selected pixels is located in a predetermined search range encompassing a corresponding node of the grid and has a maximum value among values of pixels contained the predetermined search range.
Claim 24
Independent Claim
186 words
An apparatus, for use in an image signal decoding system, for decoding an encoded bidirectionally predictive frame (encoded B frame) of an encoded digital video signal based on two reconstructed neighboring frames of the encoded B frame by employing a feature point based motion estimation approach to generate a reconstructed B frame signal, wherein the B frame includes a set of motion vectors and selection information, which comprises: a first selection means for selecting one of reconstructed neighboring frames as a reference frame based on the selection information; a detection means for detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the reconstructed neighboring frames to generate region information denoting the detected processing region; a second selection means for selecting a number of pixels from pixels contained in the detected processing region of the reference frame as a set of feature points based on the region information; and a generation means for providing the reconstructed B frame by using the set of motion vectors, the selected set of feature points and the reference frame.
Claim 25
Independent Claim
186 words
An apparatus, for use in an image signal decoding system, for decoding an encoded bidirectionally predictive frame (encoded B frame) of an encoded digital video signal based on two reconstructed neighboring frames of the encoded B frame by employing a feature point based motion estimation approach to generate a reconstructed B frame signal, wherein the B frame includes a set of motion vectors and selection information, which comprises: a first selection means for selecting one of reconstructed neighboring frames as a reference frame based on the selection information; a detection means for detecting a processing region representing a motion of a moving object of the digital video signal based on a difference between the reconstructed neighboring frames to generate region information denoting the detected processing region; a second selection means for selecting a number of pixels from pixels contained in the detected processing region of the reference frame as a set of feature points based on the region information; and a generation means for providing the reconstructed B frame by using the set of motion vectors, the selected set of feature points and the reference frame.
Claim 26
Dependent Claim
106 words
The apparatus as recited in claim 21, wherein said detection means includes: means for subtracting each pixel value of a first reconstructed neighboring frame from each corresponding pixel values of a second reconstructed neighboring frame to generate a frame difference signal containing a plurality of pixel difference values; and means for comparing each of the difference pixel values with a predetermined threshold value to generate processing region information, wherein the processing region information represents the detected processing region which corresponds to a region of the frame difference signal containing a number of the pixel difference values, each being greater than or equal to the predetermined threshold.
Claim 27
Dependent Claim
62 words
The apparatus as recited in claim 22, wherein said generation means includes: (d1) determining a group of motion vectors for all pixels contained in the processing region of the B frame based on the set of motion vectors; and (d2) producing the reconstructed B frame and a second predicted B frame by using the group of motion vectors and the reference frame.
Claim 28
Dependent Claim
80 words
The apparatus as recited in claim 23, wherein the second selection means includes means for selecting the set of feature point pixels from the reference frame by using a grid and edge detection method which selects pixels located on the edge as the feature point pixels, wherein each of the selected pixels is located in a predetermined search range encompassing a corresponding node of the grid and has a maximum value among values of pixels contained the predetermined search range.
References Cited (Backward Citations)
US5241608A
Cited
US5592228A
Cited
US5579401A
Cited
US5581308A
Cited
US5598216A
Cited
US5546129A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-09-15 | 2001-03-17 | 2001-09-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-09-15 | 2005-03-17 | 2005-09-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-09-15 | 2009-03-17 | 2009-09-16 | $7700.00 | Window Closed / Lapsed |