Patent US5410358A successfully refreshed from Google Patents.
US5410358A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and device for frame interpolation of a moving image
Assignee: 50% INTERST TO KOKUSAI DENSHIN DENWA Co (KDD)
•
Filing: 1992-07-22
•
Granted: 1995-04-25
•
Expires: 2012-07-22
Abstract
Abstract Apparatus and method for forming an interpolated image corresponding to a given temporal distance ratio between a first and a second image including respectively, a first image in which the first and second images include a first and a second 3-D shape model of an object having respective shading values and that there is a 3-D motion vector defining the transformation between the first and the second 3-D shape models. The method includes: a) adjusting the interpolation 3-D motion vector (Vab) to obtain an interpolation 3-D motion vector (vi); b) forming an interpolation 3-D shape model (Mi) from the interpolation 3-D motion vector (Vi) and either the first or the second 3-D shape model (Ma,Mb); and c) forming an interpolation image from the interpolation 3-D shape model and the image shaping values from the first and second 3-D shape models. The invention provides a method and apparatus for frame interpolation of a moving image which remedies block-shaped distortion in interpolated frames, and which can reproduce smooth movement even when the input image includes movement in 3-dimensional space.
Inventors
- 👤 Mark A. Shackleton
- 👤 William J. Welsh
- 👤 Atsushi Koike
- 👤 Masahide Kaneko
- 👤 Yoshinori Hatori
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 18:14
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/01; H04N7/0135; H04N7/014; H04N19/00; H04N19/20
Claims Analysis
Total Claims: 20
Claim 1
Independent Claim
129 words
A method of forming an interpolated image corresponding to a given temporal distance ratio between a first and a second image, the first and second images each including a first and a second 3-D shape model of an object having respective shading values and there being a 3-D motion vector defining the transformation between the first and the second 3-D shape models, said method comprising the steps of: a) adjusting the 3-D motion vector to obtain an interpolation 3-D motion vector; b) forming an interpolation 3-D shape model from the interpolation 3-D motion vector and either the first or the second 3-D shape model; and c) forming an interpolation image from the interpolation 3-D shape model and the image shaping values from the first and second 3-D shape models.
Claim 2
Independent Claim
129 words
A method of forming an interpolated image corresponding to a given temporal distance ratio between a first and a second image, the first and second images each including a first and a second 3-D shape model of an object having respective shading values and there being a 3-D motion vector defining the transformation between the first and the second 3-D shape models, said method comprising the steps of: a) adjusting the 3-D motion vector to obtain an interpolation 3-D motion vector; b) forming an interpolation 3-D shape model from the interpolation 3-D motion vector and either the first or the second 3-D shape model; and c) forming an interpolation image from the interpolation 3-D shape model and the image shaping values from the first and second 3-D shape models.
Claim 3
Dependent Claim
27 words
A method as in claim 1 in which the second 3-D shape model is obtained by applying the 3-D motion vector to the first 3-D shape model.
Claim 4
Dependent Claim
144 words
Apparatus for forming an interpolated image corresponding to a given temporal distance ration between a first and a second image, the first and second images each including a first and a second 3-D shape model of an object having respective shading values and there being a 3-4D motion vector defining the transformation between the first and the second 3-D shape models, said apparatus comprising: a) a 3-D motion vector adjustment means for adjusting the 3-D motion vector to obtain an interpolation 3-D motion vector; b) a first shape model transformation means for forming an interpolation 3-D shape model from the interpolation 3-D motion vector and either the first or the second 3-D shape model; and c) a frame interpolation means for forming an interpolation image from the interpolation 3-D shape model and the image shading values from the first and second 3-D shape models.
Claim 5
Dependent Claim
144 words
Apparatus for forming an interpolated image corresponding to a given temporal distance ration between a first and a second image, the first and second images each including a first and a second 3-D shape model of an object having respective shading values and there being a 3-4D motion vector defining the transformation between the first and the second 3-D shape models, said apparatus comprising: a) a 3-D motion vector adjustment means for adjusting the 3-D motion vector to obtain an interpolation 3-D motion vector; b) a first shape model transformation means for forming an interpolation 3-D shape model from the interpolation 3-D motion vector and either the first or the second 3-D shape model; and c) a frame interpolation means for forming an interpolation image from the interpolation 3-D shape model and the image shading values from the first and second 3-D shape models.
Claim 6
Dependent Claim
34 words
Apparatus as in claim 3 further including a second 3-D shape model transformation means for forming the second interpolation 3-D shape model from the interpolation 3-D motion vector and the first 3-D shape model.
Claim 7
Dependent Claim
29 words
Apparatus as in claim 3 in which there is included one 3-D shape model storage means corresponding to, and for storing, a respective one of the 3-D shape models.
Claim 8
Dependent Claim
128 words
Apparatus as in claim 3 and further including: a shape change information adjustment means responsive to the information on subject element shape changes which has been transmitted from the transmitter side, and to the temporal distance ratio between the previous and current frames and the interpolated frame, to provide the changes in subject element shapes between the previous frame and the interpolated frame; an element shape change adjustment means which provides a 3-dimensional shape model that corresponds to the position and orientation and also to the element shapes of the subject of the current frame; and an element shape change adjustment means which provides a 3-dimensional shape model that corresponds to the position and orientation and also to the element shapes of the subject of the interpolated frame.
Claim 9
Dependent Claim
90 words
Apparatus as in claim 6 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the current frame to operate upon the 3-dimensional shape mode of the previous frame; and (ii) causing the information on element shape changes between the previous frame and the current frame, said information having been transmitted from the transmitter side, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 10
Dependent Claim
106 words
Apparatus as in claim 6 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the interpolated frame, which motion vector has been obtained in the 3-dimensional motion vector adjustment process, to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on element shape changes between the previous frame the interpolated frame, which information has been obtained in the aforementioned shape change information adjustment process, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 11
Dependent Claim
29 words
Apparatus as in claim 4 in which there is included one 3-D shape model storage means corresponding to, and for storing, a respective one of the 3-D shape models.
Claim 12
Dependent Claim
128 words
Apparatus as in claim 4 and further including: a shape change information adjustment means responsive to the information on subject element shape changes which has been transmitted from the transmitter side, and to the temporal distance ratio between the previous and current frames and the interpolated frame, to provide the changes in subject element shapes between the previous frame and the interpolated frame; an element shape change adjustment means which provides a 3-dimensional shape model that corresponds to the position and orientation and also to the element shapes of the subject of the current frame; and an element shape change adjustment means which provides a 3-dimensional shape model that corresponds to the position and orientation and also to the element shapes of the subject of the interpolated frame.
Claim 13
Dependent Claim
90 words
Apparatus as in claim 10 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the current frame to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on element shape changes between the previous frame and the current frame, said information having been transmitted from the transmitter side, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 14
Dependent Claim
107 words
Apparatus as in claim 10 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the interpolated frame, which motion vector has been obtained in the 3-dimensional motion vector adjustment process, to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on element shape changes between the previous frame and the interpolated frame, which information has been obtained in the aforementioned shape change information adjustment process, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 15
Dependent Claim
128 words
Apparatus as in claim 5 and further including: a shape change information adjustment means responsive to the information on subject element shape changes which has been transmitted from the transmitter side, and to the temporal distance ratio between the previous and current frames and the interpolated frame, to provide the changes in subject element shapes between the previous frame and the interpolated frame; an element shape change adjustment means which provides a 3-dimensional shape model that corresponds to the position and orientation and also to the element shapes of the subject of the current frame; and an element shape change adjustment means which provides a 3-dimensional shape model that corresponds to the position and orientation and also to the element shapes of the subject of the interpolated frame.
Claim 16
Dependent Claim
90 words
Apparatus as in claim 13 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the current frame to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on element shape changes between the previous frame and the current frame, said information having been transmitted from the transmitter side, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 17
Dependent Claim
107 words
Apparatus as in claim 13 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the interpolated frame, which motion vector has been obtained in the 3-dimensional motion vector adjustment process, to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on clement shape changes between the previous frame and the interpolated frame, which information has been obtained in the aforementioned shape change information adjustment process, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 18
Dependent Claim
107 words
Apparatus as in claim 7 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the interpolated frame, which motion vector has been obtained in the 3-dimensional motion vector adjustment process, to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on element shape changes between the previous frame and the interpolated frame, which information has been obtained in the aforementioned shape change information adjustment process, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 19
Dependent Claim
106 words
Apparatus as in claim 11 in which the element shape change adjustment operates by: (i) causing the 3-dimensional motion vector between the previous frame and the interpolated frame, which motion vector has been obtained in the 3-dimensional motion vector adjustment process, to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on element shape changes between the previous frame and the interpolated frame, which information has been obtained in the aforementioned shape change information adjustment process, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
Claim 20
Dependent Claim
107 words
Apparatus as in claim 14 in which the element shape change adjustment means operates by: (i) causing the 3-dimensional motion vector between the previous frame and the interpolated frame, which motion vector has been obtained in the 3-dimensional motion vector adjustment process, to operate upon the 3-dimensional shape model of the previous frame; and (ii) causing the information on element shape changes between the previous frame and the interpolated frame, which information has been obtained in the aforementioned shape change information adjustment process, to operate upon the latter stage of the aforementioned 3-dimensional shape model transformation process which transforms the 3-dimensional shape model of the previous frame.
References Cited (Backward Citations)
US4600919A
Cited
US4600919B1
Cited
GB2144301A
Cited
US4651207A
Cited
US4668986A
Cited
US4672442A
Cited
DE3704777C1
Cited
US4862267A
Cited
JPS6459729A
Cited
US5060064A
Cited
EP0388187A2
Cited
US5173865A
Cited
US5055925A
Cited
US5057921A
Cited
US4980762A
Cited
US5117287A
Cited
US5162907A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-04-24 | 1998-10-24 | 1999-04-25 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-04-24 | 2002-10-24 | 2003-04-25 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-04-24 | 2006-10-24 | 2007-04-25 | $7700.00 | Window Closed / Lapsed |