US5784115A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for motion compensated de-interlacing of video frames
Assignee: Xerox Corp
•
Filing: 1996-12-31
•
Granted: 1998-07-21
•
Expires: 2016-12-31
Abstract
Abstract A system and a method for motion-compensated de-interlacing of interlaced video frames that generates high quality progressive video frames, keeps computational complexity low and requires the use of only a single image frame is provided. The system and method of this invention determine if global motion (camera motion) is present in the scene. If global motion is detected, it is estimated and compensated. The globally-compensated image is then analyzed to determine whether local motion is present. If local motion is detected, the image pixels affected by the local motion are interpolated using motion-adaptive techniques. If no local motion and no global motion is detected, the image pixels are interleaved.
Inventors
- 👤 Gozde Bozdagi
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 14:26
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/01; H04N7/0117; H04N7/012; H04N19/00; H04N19/50; H04N19/503; H04N19/51; H04N19/527; H04N19/587
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
263 words
A system for generating motion-compensated progressive video frame from an interlaced initial video frame, comprising: a field splitter that splits the initial video frame into an even field and an odd field; a global motion determiner that determines if global motion is present in the initial video frame; a global motion compensator, responsive to the global motion determiner, that generates a globally-compensated video frame from the initial video frame when global motion is present in the initial video frame; a local motion determiner that determines if local motion is present in the initial video frame when no global motion is present in the initial video frame, and that determines if local motion is present in the globally-compensated video frame when global motion is present in the initial video frame; a local motion interpolator, responsive to the local motion determiner, that generates a locally-interpolated video frame from the initial video frame when only local motion is present in the initial video frame, and from the globally-compensated video frame when local motion is present in the globally-compensated video frame; and a field combiner, responsive to the global and local motion determiners, that combines the even and odd fields of the initial video frame into a single progressive video frame when substantially no local motion and substantially no global motion is present in the initial video frame, and that combines the even and odd fields of the compensated and/or interpolated video frame into a single progressive video frame when global motion, local motion or both global and local motion are present in the initial video frame.
Claim 2
Independent Claim
263 words
A system for generating motion-compensated progressive video frame from an interlaced initial video frame, comprising: a field splitter that splits the initial video frame into an even field and an odd field; a global motion determiner that determines if global motion is present in the initial video frame; a global motion compensator, responsive to the global motion determiner, that generates a globally-compensated video frame from the initial video frame when global motion is present in the initial video frame; a local motion determiner that determines if local motion is present in the initial video frame when no global motion is present in the initial video frame, and that determines if local motion is present in the globally-compensated video frame when global motion is present in the initial video frame; a local motion interpolator, responsive to the local motion determiner, that generates a locally-interpolated video frame from the initial video frame when only local motion is present in the initial video frame, and from the globally-compensated video frame when local motion is present in the globally-compensated video frame; and a field combiner, responsive to the global and local motion determiners, that combines the even and odd fields of the initial video frame into a single progressive video frame when substantially no local motion and substantially no global motion is present in the initial video frame, and that combines the even and odd fields of the compensated and/or interpolated video frame into a single progressive video frame when global motion, local motion or both global and local motion are present in the initial video frame.
Claim 3
Dependent Claim
64 words
The system of claim 1, wherein the global motion determiner comprises: a motion map calculator that calculates a motion map between the even and odd fields, said motion map containing motion map pixels with respective gray-levels that correspond to global motion present in the initial video frame; and a pixel counter that counts the number of motion map pixels having a predetermined gray-level value.
Claim 4
Dependent Claim
14 words
The system of claim 1, wherein said global motion compensator comprises a motion-compensating filter.
Claim 5
Dependent Claim
14 words
The system of claim 1, wherein said local motion interpolator comprises a motion-adaptive filter.
Claim 6
Dependent Claim
13 words
The system of claim 4, wherein said motion-adaptive filter comprises an edge-adaptive interpolator.
Claim 7
Independent Claim
320 words
A system for generating motion-compensated progressive video frame from an interlaced initial video frame, comprising: a field splitter that splits the initial video frame into an even field and an odd field; a motion map calculator that calculates a motion map between the even and odd fields, said motion map containing motion map pixels with respective gray-levels that correspond to global motion present in the initial video frame; a pixel counter that counts the number of motion map pixels having a predetermined gray-level value; a motion-compensating filter that globally compensates the initial video frame when global motion is present in the initial video frame, that locally compensates the globally-compensated video frame if local motion is present, and combines the even and odd fields of the globally and/or locally compensated video frame into a single progressive video frame; a motion-adaptive filter that locally interpolates the initial video frame if local motion is present, and combines the even and odd fields of the locally-interpolated video frame into a single progressive video frame; a field interleaver that interleaves the even and odd fields of the initial video frame when substantially no local motion and substantially no global motion is present in the initial video frame; and a controller that communicates with and controls the operation of the field splitter, motion map calculator, motion-compensating filter, motion adaptive filter and field interleaver, wherein said controller determines if global or local motion is present in the initial and compensated video frames, sends the even and odd fields of the initial video frame to the motion-compensating filter if global motion is present, sends the even and odd fields of the initial video frame to the motion-adaptive filter if substantially no global motion is present, and sends the even and odd fields of the initial video frame to the field interleaver if substantially no global motion and substantially no local motion is present in the initial video frame.
Claim 8
Independent Claim
320 words
A system for generating motion-compensated progressive video frame from an interlaced initial video frame, comprising: a field splitter that splits the initial video frame into an even field and an odd field; a motion map calculator that calculates a motion map between the even and odd fields, said motion map containing motion map pixels with respective gray-levels that correspond to global motion present in the initial video frame; a pixel counter that counts the number of motion map pixels having a predetermined gray-level value; a motion-compensating filter that globally compensates the initial video frame when global motion is present in the initial video frame, that locally compensates the globally-compensated video frame if local motion is present, and combines the even and odd fields of the globally and/or locally compensated video frame into a single progressive video frame; a motion-adaptive filter that locally interpolates the initial video frame if local motion is present, and combines the even and odd fields of the locally-interpolated video frame into a single progressive video frame; a field interleaver that interleaves the even and odd fields of the initial video frame when substantially no local motion and substantially no global motion is present in the initial video frame; and a controller that communicates with and controls the operation of the field splitter, motion map calculator, motion-compensating filter, motion adaptive filter and field interleaver, wherein said controller determines if global or local motion is present in the initial and compensated video frames, sends the even and odd fields of the initial video frame to the motion-compensating filter if global motion is present, sends the even and odd fields of the initial video frame to the motion-adaptive filter if substantially no global motion is present, and sends the even and odd fields of the initial video frame to the field interleaver if substantially no global motion and substantially no local motion is present in the initial video frame.
Claim 9
Dependent Claim
40 words
The system of claim 6, wherein the motion-compensating filter compensates for global motion by calculating a set of affine parameters that estimate the global motion, and warping one of the initial video frame fields with the set of affine parameters.
Claim 10
Dependent Claim
40 words
The system of claim 7, wherein the motion-compensating filter calculates the set of affine parameters that estimates the global motion by performing a least-squares estimation technique on all image pixels in one of the fields of the initial video frame.
Claim 11
Dependent Claim
39 words
The system of claim 7, wherein the motion-compensating filter divides one of the fields into 8×8 blocks of image pixels, and determines a set of affine parameters for each block by performing a least-squares estimation technique on each block.
Claim 12
Dependent Claim
42 words
The system of claim 9, wherein the motion-compensating filter divides the affine parameter sets into clusters, and chooses an affine parameter set at a center of a cluster with the most affine parameter sets as the set that estimates the global motion.
Claim 13
Independent Claim
155 words
A method of motion-compensating and de-interlacing video frames, comprising the steps of: determining if global motion is present in an initial video frame; globally compensating the initial video frame if global motion is present; determining if local motion is present in the globally-compensated video frame; locally interpolating the globally-compensated video frame when local motion is present; determining if local motion is present in the initial video frame when no global motion is present in the initial video frame; locally interpolating the initial video frame when local motion is present; combining an even and odd field of the initial video frame into a single progressive video frame when no local motion and no global motion is present in the initial video frame; and combining an even and odd field of the locally interpolated and/or globally compensated video frame into a single progressive video frame when local and/or global motion is present in the initial video frame.
Claim 14
Independent Claim
155 words
A method of motion-compensating and de-interlacing video frames, comprising the steps of: determining if global motion is present in an initial video frame; globally compensating the initial video frame if global motion is present; determining if local motion is present in the globally-compensated video frame; locally interpolating the globally-compensated video frame when local motion is present; determining if local motion is present in the initial video frame when no global motion is present in the initial video frame; locally interpolating the initial video frame when local motion is present; combining an even and odd field of the initial video frame into a single progressive video frame when no local motion and no global motion is present in the initial video frame; and combining an even and odd field of the locally interpolated and/or globally compensated video frame into a single progressive video frame when local and/or global motion is present in the initial video frame.
Claim 15
Dependent Claim
95 words
The method of claim 11, wherein the global motion determination is made by: splitting the initial video frame into an even field and an odd field; calculating a motion map between the even and odd fields, said motion map containing motion map pixels with respective gray-levels that correspond to global motion present in the video frame; counting the number of motion map pixels having a predetermined gray-level value; and determining that global motion is present in the initial video frame when the number of image pixels with a predetermined gray-level value exceeds a predetermined threshold.
Claim 16
Dependent Claim
16 words
The method of claim 12, wherein the initial video frame is globally compensated using motion-compensating techniques.
Claim 17
Dependent Claim
36 words
The method of claim 13, wherein the initial video frame is globally compensated by: calculating affine parameters that estimate the global motion using affine parametrization techniques; and warping one of the fields using the affine parameters.
Claim 18
Dependent Claim
26 words
The method of claim 14, wherein the affine parameters are calculated by performing a least-squares estimation technique on all image pixels in one of the fields.
Claim 19
Dependent Claim
75 words
The method of claim 14, wherein the affine parameters are calculated by: dividing one of the fields into 8×8 blocks of image pixels; calculating a set of affine parameters for each block by performing a least-squares estimation technique on each block; dividing the affine parameter sets into clusters; determining which cluster has the most affine parameter sets; and choosing an affine parameter set at a center of the cluster with the most affine parameter sets.
Claim 20
Dependent Claim
16 words
The method of claim 11, wherein the globally-compensated video frame is locally interpolated using motion-adaptive techniques.
Claim 21
Dependent Claim
15 words
The method of claim 17, wherein the globally-compensated image is locally interpolated using edge-adaptive interpolation.
Claim 22
Dependent Claim
16 words
The method of claim 11, wherein the initial video frame is locally interpolated using motion-adaptive techniques.
Claim 23
Dependent Claim
16 words
The method of claim 19, wherein the initial video frame is locally interpolated using edge-adaptive interpolation.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-07-20 | 2002-01-19 | 2002-07-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-07-20 | 2006-01-19 | 2006-07-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-07-20 | 2010-01-19 | 2010-07-21 | $7700.00 | Window Closed / Lapsed |