US5416899A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Memory based method and apparatus for computer graphics
Assignee: ISTITUTO TRENTINO DI CULTURA A Corp OF ITALY
•
Filing: 1992-01-13
•
Granted: 1995-05-16
•
Expires: 2012-01-13
Abstract
Abstract A memory based computer graphic animation system generates desired images and image sequences from 2-D views. The 2-D views provide sparse data from which intermediate views are generated based on a generalization and interpolation technique of the invention. This technique is called a Hyper Basis function network and provides a smooth mapping between the given set of 2-D views and a resulting image sequence for animating a subject in a desired movement. A multilayer network provides learning of such mappings and is based on Hyper Basis Functions (HBF's). A special case of the HBFs is the radial basis function technique used in a preferred embodiment. The invention generalization/integration technique involves establishing working axes along which different views of the subject are taken. Different points along the working axes define different positions (geometrical and/or graphical) of the subject. For each of these points, control points for defining a view of the subject are either given or calculated by interpolation/generalization of the present invention.
Inventors
- 👤 Tomaso A. Poggio
- 👤 Roberto Brunelli
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 08:37
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/20; H; H04; H04N; H04N7/00; H04N7/14; H04N7/15; G06T; G06T1/00; G06T13/00; G06T13/80; H04N7/141; H04N7/147; H04N7/157; Y; Y10; Y10S; Y10S345/00; Y10S345/949; Y10S345/95; Y10S345/951; Y10S345/953
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
306 words
Apparatus for computer graphics and animation comprising: a source for inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along at least one working axis, each working axis being formed of a plurality of parameter values, each parameter value of a working axis defining a different position of the subject along that working axis; a preprocessor coupled to receive from the source the sample views, the preprocessor determining (i) a set of control points of the subject in each sample view, and (ii) plane coordinate values of the control points in each sample view, and for each sample view, the preprocessor associating the coordinate values of the control points with the parameter values of each working axis indicative of the sample position of the subject in that sample view, for different objects of the class, the preprocessor determining different sets of control points; an image processor coupled to the preprocessor and responsive to the associations between the coordinate values of the control points and the parameter values of the sample positions of the subject, the image processor mapping the coordinate values of the control points for sample positions of the subject to control point coordinate values for desired intermediate positions along each working axis to form intermediate views of the subject, the image processor forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a range of subject positions for animation, in a certain movement, of any object in the class of objects; and a display coupled to the image processor for displaying an image sequence from the set of image sequences to provide graphic animation of the subject in the certain movement.
Claim 2
Dependent Claim
306 words
Apparatus for computer graphics and animation comprising: a source for inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along at least one working axis, each working axis being formed of a plurality of parameter values, each parameter value of a working axis defining a different position of the subject along that working axis; a preprocessor coupled to receive from the source the sample views, the preprocessor determining (i) a set of control points of the subject in each sample view, and (ii) plane coordinate values of the control points in each sample view, and for each sample view, the preprocessor associating the coordinate values of the control points with the parameter values of each working axis indicative of the sample position of the subject in that sample view, for different objects of the class, the preprocessor determining different sets of control points; an image processor coupled to the preprocessor and responsive to the associations between the coordinate values of the control points and the parameter values of the sample positions of the subject, the image processor mapping the coordinate values of the control points for sample positions of the subject to control point coordinate values for desired intermediate positions along each working axis to form intermediate views of the subject, the image processor forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a range of subject positions for animation, in a certain movement, of any object in the class of objects; and a display coupled to the image processor for displaying an image sequence from the set of image sequences to provide graphic animation of the subject in the certain movement.
Claim 3
Dependent Claim
44 words
Apparatus as claimed in claim 1 wherein the image processor includes means for forming an image sequence from the sample views and intermediate views arranged in order according to sequence of the sample and intermediate positions for animating the subject in the certain movement.
Claim 4
Dependent Claim
93 words
Apparatus as claimed in claim 1 wherein: the source further inputs at least one example view of an object of the class other than the subject; and the image processor includes means for mapping the coordinate values of the control points of the views forming the set of image sequences to control points of the example view to determine, for each parameter value of each working axis, coordinate values of the control points for intermediate views of the object, to generate a respective image sequence for animating the object in the certain movement.
Claim 5
Dependent Claim
25 words
Apparatus as claimed in claim 1 wherein the display includes a display unit networked to the image processor for remote display of the image sequences.
Claim 6
Dependent Claim
52 words
Apparatus as claimed in claim 1 wherein the source includes means for establishing at least one working axis that defines the position of the subject as one of rotation about a longitudinal axis, tilt about an orthogonal axis, instance in time along a time axis, or facial expression along a respective axis.
Claim 7
Dependent Claim
27 words
The apparatus as claimed in claim 1 wherein the display further displays an image from the set of image sequences to provide graphic representation of the subject.
Claim 8
Dependent Claim
273 words
In a computer system, a graphics and animation method, comprising the steps of: inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along at least one working axis, each working axis being formed of a plurality of parameter values, each parameter value of a working axis defining a different position of the subject along that working axis, and a sequence of the sample positions together with intermediate positions animating the subject in a certain movement; determining a set of control points of the subject in each sample view, including for different objects of the class of similar objects, determining different sets of control points; for each sample view (i) determining plane coordinate values of the control points, and (ii) establishing an association between the coordinate values of the control points and parameter values of each working axis indicative of the sample position of the subject in that sample view; mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along each working axis to form intermediate views of the subject; forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a range of subject positions for animation of any object in the class of objects; and displaying an image sequence from the set of image sequences through a display of the computer system to provide graphic animation of the subject in the certain movement.
Claim 9
Dependent Claim
273 words
In a computer system, a graphics and animation method, comprising the steps of: inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along at least one working axis, each working axis being formed of a plurality of parameter values, each parameter value of a working axis defining a different position of the subject along that working axis, and a sequence of the sample positions together with intermediate positions animating the subject in a certain movement; determining a set of control points of the subject in each sample view, including for different objects of the class of similar objects, determining different sets of control points; for each sample view (i) determining plane coordinate values of the control points, and (ii) establishing an association between the coordinate values of the control points and parameter values of each working axis indicative of the sample position of the subject in that sample view; mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along each working axis to form intermediate views of the subject; forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a range of subject positions for animation of any object in the class of objects; and displaying an image sequence from the set of image sequences through a display of the computer system to provide graphic animation of the subject in the certain movement.
Claim 10
Dependent Claim
52 words
A method as claimed in claim 7 wherein the step of mapping control point values for sample positions of the subject to control point coordinate values for desired intermediate positions includes interpolating values of the control points between parameter values of the sample positions and desired parameter values of the intermediate positions.
Claim 11
Dependent Claim
45 words
A method as claimed in claim 7 wherein the step of forming a set of image sequences includes arranging the sample views and formed intermediate views in order according to sequence of the sample and intermediate positions for animating the subject in the certain movement.
Claim 12
Dependent Claim
90 words
A method as claimed in claim 7 further comprising the steps of: inputting at least one example view of an object of the class other than the subject; and determining and mapping coordinate values of the control points of the views forming the set of image sequences to control points of the example view to determine, for each parameter value of each working axis, coordinate values of the control points for intermediate views of the object, to generate a respective image sequence for animating the object in the certain movement.
Claim 13
Dependent Claim
65 words
A method as claimed in claim 7 wherein the step of inputting sample views includes establishing at least one working axis as one of a longitudinal axis about which the subject may be rotated in a view, an orthogonal axis about which the subject may be tilted in a view, a time axis, or an axis for indicating range of facial expressions of the subject.
Claim 14
Dependent Claim
29 words
A method as claimed in claim 7 wherein the step of displaying includes displaying an image from the set of image sequences to provide graphic representation of the subject.
Claim 15
Dependent Claim
303 words
Apparatus for computer graphics and animation comprising: a source for inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along a plurality of working axes, each working axis being formed of a plurality of parameter values, each parameter value defining a different position of the subject along the working axes; a preprocessor coupled to receive from the source the sample views, the preprocessor determining (i) a set of control points of the subject in each sample view, and (ii) plane coordinate values of the control points in each sample view, and for each sample view, the preprocessor associating the coordinate values of the control points with the parameter values of the working axes indicative of the sample position of the subject in that sample view, for different objects of the class, the preprocessor determining different sets of control points; an image processor coupled to the preprocessor and responsive to the associations between the coordinate values of the control points and the parameter values of the sample positions of the subject, the image processor mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along the working axes to form intermediate views of the subject, the image processor forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a prototype range for animation of any object in the class of objects in a certain movement; and a display coupled to the image processor for displaying an image sequence from the set of image sequences to provide graphic animation of the subject in the certain movement.
Claim 16
Dependent Claim
303 words
Apparatus for computer graphics and animation comprising: a source for inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along a plurality of working axes, each working axis being formed of a plurality of parameter values, each parameter value defining a different position of the subject along the working axes; a preprocessor coupled to receive from the source the sample views, the preprocessor determining (i) a set of control points of the subject in each sample view, and (ii) plane coordinate values of the control points in each sample view, and for each sample view, the preprocessor associating the coordinate values of the control points with the parameter values of the working axes indicative of the sample position of the subject in that sample view, for different objects of the class, the preprocessor determining different sets of control points; an image processor coupled to the preprocessor and responsive to the associations between the coordinate values of the control points and the parameter values of the sample positions of the subject, the image processor mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along the working axes to form intermediate views of the subject, the image processor forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a prototype range for animation of any object in the class of objects in a certain movement; and a display coupled to the image processor for displaying an image sequence from the set of image sequences to provide graphic animation of the subject in the certain movement.
Claim 17
Dependent Claim
37 words
The apparatus as claimed in claim 13 wherein the image processor interpolates the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions.
Claim 18
Dependent Claim
20 words
The apparatus as claimed in claim 14 wherein the image processor comprises a Gaussian function to map the control points.
Claim 19
Dependent Claim
19 words
The apparatus as claimed in claim 15 wherein the Gaussian function is calculated by a Hyper Basis Function network.
Claim 20
Dependent Claim
18 words
The apparatus as claimed in claim 16 wherein the Hyper Basis Function network implements a Radial Basis Function.
Claim 21
Dependent Claim
20 words
The apparatus as claimed in claim 13 wherein the image processor comprises a spline function to map the control points.
Claim 22
Dependent Claim
27 words
The apparatus as claimed in claim 13 wherein the display further displays an image from the set of image sequences to provide graphic representation of the subject.
Claim 23
Dependent Claim
263 words
In a computer system, a graphics and animation method comprising the steps of: inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along a plurality of working axes, each working axis being formed of a plurality of parameter values, each parameter value defining a different position of the subject along the working axes, and a sequence of the sample positions together with intermediate positions animating the subject in a certain movement; determining a set of control points of the subject in each sample view, including for different objects of the class, determining different sets of control points; for each sample view (i) determining coordinate values of the control points, and (ii) establishing an association between the coordinate values of the control points and parameter values of the working axes indicative of the sample position of the subject in that sample view; mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along the working axes to form intermediate views of the subject; forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a prototype range for animation of any object in the class of objects; and displaying an image sequence from the set of image sequences through a display of the computer system to provide graphic animation of the subject in the certain movement.
Claim 24
Dependent Claim
263 words
In a computer system, a graphics and animation method comprising the steps of: inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along a plurality of working axes, each working axis being formed of a plurality of parameter values, each parameter value defining a different position of the subject along the working axes, and a sequence of the sample positions together with intermediate positions animating the subject in a certain movement; determining a set of control points of the subject in each sample view, including for different objects of the class, determining different sets of control points; for each sample view (i) determining coordinate values of the control points, and (ii) establishing an association between the coordinate values of the control points and parameter values of the working axes indicative of the sample position of the subject in that sample view; mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along the working axes to form intermediate views of the subject; forming a set of image sequences from both the sample views and formed intermediate views, one image sequence for each working axis, the set of image sequences defining a prototype range for animation of any object in the class of objects; and displaying an image sequence from the set of image sequences through a display of the computer system to provide graphic animation of the subject in the certain movement.
Claim 25
Dependent Claim
35 words
The method as claimed in claim 20 wherein the step of mapping comprises interpolating the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points.
Claim 26
Dependent Claim
17 words
The method as claimed in claim 20 wherein the step of mapping comprises executing a Gaussian function.
Claim 27
Dependent Claim
21 words
The method as claimed in claim 22 wherein the step of executing a Gaussian function includes executing a Hyper Basis Function.
Claim 28
Dependent Claim
22 words
The method as claimed in claim 23 wherein the step of executing a Hyper Basis Function includes executing a Radial Basis Function.
Claim 29
Dependent Claim
17 words
The method as claimed in claim 20 wherein the step of mapping comprises executing a spline function.
Claim 30
Dependent Claim
29 words
The method as claimed in claim 20 wherein the step of displaying includes displaying an image from the set of image sequences to provide graphic representation of the subject.
Claim 31
Dependent Claim
272 words
Apparatus for computer graphics comprising: a source for inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along at least one working axis, each working axis being formed of a plurality of parameter values, each parameter value of a working axis defining a different position of the subject along that working axis; a preprocessor coupled to receive from the source the sample views, the preprocessor determining (i) a set of control points of the subject in each sample view, and (ii) plane coordinate values of the control points in each sample view, and for each sample view, the preprocessor associating the coordinate values of the control points with the parameter values of each working axis indicative of the sample position of the subject in that sample view, for different objects of the class, the preprocessor determining different sets of control points; an image processor coupled to the preprocessor and responsive to the associations between the coordinate values of the control points and the parameter values of the sample positions of the subject, the image processor mapping the coordinate values of the control points for sample positions of the subject to control point coordinate values for desired intermediate positions along each working axis to form intermediate views of the subject, the image processor forming a set of images from both the sample views and formed intermediate views, one image subset for each working axis; and a display coupled to the image processor for displaying an image from the set of images to provide graphic representation of the subject.
Claim 32
Dependent Claim
272 words
Apparatus for computer graphics comprising: a source for inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along at least one working axis, each working axis being formed of a plurality of parameter values, each parameter value of a working axis defining a different position of the subject along that working axis; a preprocessor coupled to receive from the source the sample views, the preprocessor determining (i) a set of control points of the subject in each sample view, and (ii) plane coordinate values of the control points in each sample view, and for each sample view, the preprocessor associating the coordinate values of the control points with the parameter values of each working axis indicative of the sample position of the subject in that sample view, for different objects of the class, the preprocessor determining different sets of control points; an image processor coupled to the preprocessor and responsive to the associations between the coordinate values of the control points and the parameter values of the sample positions of the subject, the image processor mapping the coordinate values of the control points for sample positions of the subject to control point coordinate values for desired intermediate positions along each working axis to form intermediate views of the subject, the image processor forming a set of images from both the sample views and formed intermediate views, one image subset for each working axis; and a display coupled to the image processor for displaying an image from the set of images to provide graphic representation of the subject.
Claim 33
Dependent Claim
217 words
In a computer system, a graphics method comprising the steps of: inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along a plurality of working axes, each working axis being formed of a plurality of parameter values, each parameter value defining a different position of the subject along the working axes; determining a set of control points of the subject in each sample view, including for different objects of the class, determining different sets of control points; for each sample view (i) determining coordinate values of the control points, and (ii) establishing an association between the coordinate values of the control points and parameter values of the working axes indicative of the sample position of the subject in that sample view; mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along the working axes to form intermediate views of the subject; forming a set of images from both the sample views and formed intermediate views, one image subset for each working axis; and displaying an image from the set of images through a display of the computer system to provide graphic representation of the subject.
Claim 34
Dependent Claim
217 words
In a computer system, a graphics method comprising the steps of: inputting sample views of a subject belonging to a class of similar objects, each sample view providing the subject in a different sample position along a plurality of working axes, each working axis being formed of a plurality of parameter values, each parameter value defining a different position of the subject along the working axes; determining a set of control points of the subject in each sample view, including for different objects of the class, determining different sets of control points; for each sample view (i) determining coordinate values of the control points, and (ii) establishing an association between the coordinate values of the control points and parameter values of the working axes indicative of the sample position of the subject in that sample view; mapping the coordinate values of the control points for sample positions of the subject to the coordinate values of the control points for desired intermediate positions along the working axes to form intermediate views of the subject; forming a set of images from both the sample views and formed intermediate views, one image subset for each working axis; and displaying an image from the set of images through a display of the computer system to provide graphic representation of the subject.
References Cited (Backward Citations)
US3510210A
Cited
US4600919A
Cited
US4600919B1
Cited
US4797836A
Cited
WO1989009458A1
Cited
US5029997A
Cited
US5261041A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-05-15 | 1998-11-14 | 1999-05-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-05-15 | 2002-11-14 | 2003-05-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-05-15 | 2006-11-14 | 2007-05-16 | $7700.00 | Window Closed / Lapsed |