EP0388187A2
Expired / Lapsed
EP
⏱️ 0.0 years remaining
Method and apparatus for detecting motion of moving picture
Assignee: KDDI Corp
•
Filing: 1990-03-14
•
Granted: —
•
Expires: 2010-03-14
Abstract
Abstract A system for detecting three-dimensional motion of a three-dimensional object by obtaining, for each block, a velocity vector from two temporally successive images of a moving picture including the three-dimensional object. A three-dimensional model is prepared in correspondence to the solid configuration of the three-dimensional object, an area is obtained in the previous frame picture where the three-dimensional object and the three-dimensional model overlap, the area is divided into a plurality of blocks, a velocity vector between the current input image and the previous frame image is obtained for each block, depth information in the block is obtained from the three-dimensional model, and three-dimensional motion parameters of the three-dimensional object, that is, its rotational movement and translational movement components, are obtained from the velocity vectors and depth information thus obtained in the plurality of blocks, whereby the three-dimensional motion of the three-dimensional object is detected.
Inventors
- 👤 Atsushi Koike
- 👤 Masahide Kaneko
- 👤 Yoshinori Hatori
Bibliographic Details
Application Number
—
Jurisdiction
EP
Data Source
google_patents
Last Synchronized
2026-11-06 08:28
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; G06T7/223; G06T2207/00; G06T2207/10; G06T2207/10016
Claims Analysis
Total Claims: 11
Claim 1
Independent Claim
115 words
A method for detecting a motion of a moving picture in which, for a moving picture including a three-dimensional object moving three-dimensionally, a velocity vector is obtained, for each block, from images of two temporally successive frames to detect the three-dimensional motion of the object, characterized by the inclusion of: a step of prestoring a three-dimensional model corresponding to the solid configuration of said three-dimensional object; a step of obtaining depth information from said three-dimensional model corresponding to the block in which said velocity vector was obtained; and a step of obtaining three-dimensional parameters of said three-dimensional object from said depth information and said velocity vector to detect the three-dimensional motion of said three-dimensional object.
Claim 2
Independent Claim
115 words
A method for detecting a motion of a moving picture in which, for a moving picture including a three-dimensional object moving three-dimensionally, a velocity vector is obtained, for each block, from images of two temporally successive frames to detect the three-dimensional motion of the object, characterized by the inclusion of: a step of prestoring a three-dimensional model corresponding to the solid configuration of said three-dimensional object; a step of obtaining depth information from said three-dimensional model corresponding to the block in which said velocity vector was obtained; and a step of obtaining three-dimensional parameters of said three-dimensional object from said depth information and said velocity vector to detect the three-dimensional motion of said three-dimensional object.
Claim 3
Independent Claim
147 words
A method for detecting a motion of a moving picture in which, for a moving picture including a three-dimensional object moving three-dimensionally, a velocity vector is obtained, for each block, from images of two temporally successive frames to detect the three-dimensional motion of the object, characterized by the inclusion of: a step of prestoring a three-dimensional model corresponding to the solid configuration of said three-dimensional object; a step of obtaining depth information from said three-dimensional model corresponding to the block in which said velocity vector was obtained; a step of obtaining three-dimensional motion parameters of said three-dimensional object from said depth information and said velocity vector to detect the three-dimensional motion of said three-dimensional object; and a step of detecting the general move of said three-dimensional object from said input image and said image of said preceding frame and adjusting said general movement of said three-dimensional object.
Claim 4
Independent Claim
147 words
A method for detecting a motion of a moving picture in which, for a moving picture including a three-dimensional object moving three-dimensionally, a velocity vector is obtained, for each block, from images of two temporally successive frames to detect the three-dimensional motion of the object, characterized by the inclusion of: a step of prestoring a three-dimensional model corresponding to the solid configuration of said three-dimensional object; a step of obtaining depth information from said three-dimensional model corresponding to the block in which said velocity vector was obtained; a step of obtaining three-dimensional motion parameters of said three-dimensional object from said depth information and said velocity vector to detect the three-dimensional motion of said three-dimensional object; and a step of detecting the general move of said three-dimensional object from said input image and said image of said preceding frame and adjusting said general movement of said three-dimensional object.
Claim 5
Dependent Claim
86 words
A method for detecting a motion of a moving picture according to claim 2, characterized by further inclusion of: a characteristic point detecting step of predicting said general movement of said three-dimensional object from said three-dimensional motion parameters, detecting characteristic points which are elements of changing the configuration of said three-dimensional object in the vicinity of a position provided by the result of said prediction, and modifying the configuration of said three-dimensional model corresponding to said elements on the basis of the result of said detection.
Claim 6
Dependent Claim
76 words
A method for detecting a motion of a moving picture according to claim 2, characterized by further inclusion of: a three-dimensional model modifying step of synthesizing an image through utilization of a three-dimensional model manipulated using said three-dimensional motion parameters and luminance and chrominance information of said image of said preceding frame, detecting an error between said synthesized image and said input image by comparison, and modifying said three-dimensional model so that said error is reduced.
Claim 7
Independent Claim
252 words
An apparatus for detecting a motion of a moving picture, comprising: an image signal input terminal for inputting an image signal obtained by imaging a three-dimensionally moving object with a television camera or the like and digitizing the image; an image memory for storing said input image signal; a storage for storing a three-dimensional model of said three-dimensional object corresponding to the result of an estimation of the three-dimensional motion of said object in the preceding frame; a delay section for delaying, for at least one frame period, said image including said three-dimensional object, stored in said image memory; a blocking circuit for dividing said image from said delay section into a plurality of blocks; a velocity vector detector for obtaining a velocity vector of said three-dimensional object between said block and said input image read out of said image memory; a depth coordinate calculator for obtaining depth coordinates for each of said blocks through the use of said three-dimensional model corresponding to the result of estimation of movement of said object in said preceding frame; a three-dimensional motion parameter estimator for obtaining three-dimensional motion parameters (a rotational motion component and a translational motion component) of said three-dimensional object between frames on the basis of said velocity vector and said depth coordinates of each of said blocks; and a three-dimensional model controller for adjusting, on the basis of the output of said three-dimensional motion parameter estimator, said three-dimensional model to assume the same position and direction as those of said three-dimensional object.
Claim 8
Independent Claim
252 words
An apparatus for detecting a motion of a moving picture, comprising: an image signal input terminal for inputting an image signal obtained by imaging a three-dimensionally moving object with a television camera or the like and digitizing the image; an image memory for storing said input image signal; a storage for storing a three-dimensional model of said three-dimensional object corresponding to the result of an estimation of the three-dimensional motion of said object in the preceding frame; a delay section for delaying, for at least one frame period, said image including said three-dimensional object, stored in said image memory; a blocking circuit for dividing said image from said delay section into a plurality of blocks; a velocity vector detector for obtaining a velocity vector of said three-dimensional object between said block and said input image read out of said image memory; a depth coordinate calculator for obtaining depth coordinates for each of said blocks through the use of said three-dimensional model corresponding to the result of estimation of movement of said object in said preceding frame; a three-dimensional motion parameter estimator for obtaining three-dimensional motion parameters (a rotational motion component and a translational motion component) of said three-dimensional object between frames on the basis of said velocity vector and said depth coordinates of each of said blocks; and a three-dimensional model controller for adjusting, on the basis of the output of said three-dimensional motion parameter estimator, said three-dimensional model to assume the same position and direction as those of said three-dimensional object.
Claim 9
Dependent Claim
60 words
An apparatus for detecting a motion of a moving picture according to claim 5, characterized by further inclusion of: an object detector for obtaining the general configuration, position and direction of said three-dimensional object in said input image from said input image read out of said image memory and said image of said preceding frame read out of said delay.
Claim 10
Dependent Claim
80 words
An apparatus for detecting a motion of a moving picture according to claim 5 or 6, characterized by further inclusion of: a characteristic point extractor whereby when a configurational change occurs in a part of the element of said object, the positions of characteristic points in said three-dimensional object are extracted from said adjusted three-dimensional model; and a three-dimensional model modifier whereby said three-dimensional model corresponding to said element is modified on the basis of the result of said extraction.
Claim 11
Dependent Claim
137 words
An apparatus for detecting a motion of a moving picture according to claim 5, 6 or 7, characterized by further inclusion of: an image synthesizer whereby an image corresponding to said three-dimensional motion parameters is synthesized using luminance and chrominance information in said image of said preceding frame and said three-dimensional object; an error detector for detecting, by comparison, an error between said synthesized image provided from said image synthesizer section and said input image; a modifying information generator for generating information relating to modification of the configuration of said three-dimensional model so that said error is reduced; a three-dimensional model storage for storing a three-dimensional model modified in accordance with said modifying information; and a configuration modification controller for repeating said modification operations of said three-dimensional model until said error becomes smaller than a predetermined value.
References Cited (Backward Citations)
No citation records indexed.
USPTO Annuity & Maintenance Windows
Maintenance schedule is calculated for granted US utility patents.