← Back to Patent Explorer
US5590261A Expired / Lapsed US ⏱️ 0.0 years remaining

Finite-element method for image alignment and morphing

Assignee: Massachusetts Institute of Technology
•
Filing: 1993-05-07
•
Granted: 1996-12-31
•
Expires: 2013-05-07
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract In a morphing system for creating intermediate images that, viewed serially, make an object in a source image appear to metamorphose into a different object in a target image, correspondences between feature points in the source and target images are determined by simulating the modes of motion of respective elastic sheets in which are embedded nodal points that correspond to respective feature points in the images. For each feature point, a generalized-feature vector is determined whose components represent the associated nodal point's participations in the various motion modes. Correspondences between feature points in the source and target images are determined in accordance with the closeness of the points' generalized feature vectors. Correspondences thus determined can additionally be used for alignment and object-recognition purposes.

Inventors

  • 👤 Stanley E. Sclaroff
  • 👤 Alex Pentland

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-08 10:44
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; G06T7/246; G06V; G06V10/00; G06V10/70; G06V10/74; G06V10/75; G06V10/754

Claims Analysis

Total Claims: 20
Claim 1
Independent Claim 325 words
A method of processing images by determining a point in a target image comprising electronically encoded target points that corresponds to a given point in a source image comprising electronically encoded source points, the method comprising the steps of: A) defining first and second simulated elastic bodies associated with the source and target images, respectively, each body comprising body points which include nodal points; B) identifying source and target feature points among the source and target points, respectively; C) for each of the images, computing the mode shapes of the modes of collective motion of nodal points of the body associated with that image and whose positions with respect to each other are the same as those of the feature points in the associated image, each of said mode shapes being an eigenvector comprising eigenvector components, each eigenvector component being associated with a different nodal point and representing the relative participation of that nodal point in the mode to which the eigenvector corresponds, and thereby associating with each feature point a generalized feature vector whose components represent the participations as embodied in the eigenvector components, of that feature point's associated nodal point in respective modes; D) assigning to each of a plurality of the source feature points a target feature point associated with a generalized feature vector whose difference from that associated with that source feature point is sufficiently small according to a predetermined criterion; E) determining a mapping function of source points to target points in accordance with the relationships between the target feature points to which source feature points are assigned and the points to which the mapping function maps those same feature points; F) identify the point in the target image that corresponds to the given source point by applying the mapping function to the given source point; and G) based on the correspondence, processing at least one of the source and target images or generating at least one intermediate image therebetween.
Claim 2
Independent Claim 325 words
A method of processing images by determining a point in a target image comprising electronically encoded target points that corresponds to a given point in a source image comprising electronically encoded source points, the method comprising the steps of: A) defining first and second simulated elastic bodies associated with the source and target images, respectively, each body comprising body points which include nodal points; B) identifying source and target feature points among the source and target points, respectively; C) for each of the images, computing the mode shapes of the modes of collective motion of nodal points of the body associated with that image and whose positions with respect to each other are the same as those of the feature points in the associated image, each of said mode shapes being an eigenvector comprising eigenvector components, each eigenvector component being associated with a different nodal point and representing the relative participation of that nodal point in the mode to which the eigenvector corresponds, and thereby associating with each feature point a generalized feature vector whose components represent the participations as embodied in the eigenvector components, of that feature point's associated nodal point in respective modes; D) assigning to each of a plurality of the source feature points a target feature point associated with a generalized feature vector whose difference from that associated with that source feature point is sufficiently small according to a predetermined criterion; E) determining a mapping function of source points to target points in accordance with the relationships between the target feature points to which source feature points are assigned and the points to which the mapping function maps those same feature points; F) identify the point in the target image that corresponds to the given source point by applying the mapping function to the given source point; and G) based on the correspondence, processing at least one of the source and target images or generating at least one intermediate image therebetween.
Claim 3
Dependent Claim 13 words
A method as defined in claim 1 wherein the mapping function is non-deformational.
Claim 4
Dependent Claim 79 words
A method as defined in claim 1 wherein the mapping function applies to each source point a respective target point whose displacement from that source point is the sum of the products of (A) the displacements from source feature points of intermediate points that result when subjected to scaling and a rigid-body transformation, in the target feature points with which their respective source feature points are associated and (B) respective sums of interpolation functions evaluated at that source point.
Claim 5
Dependent Claim 52 words
A method as defined in claim 3 wherein the interpolation functions are Gaussian functions centered on respective source feature points having locations in the source image, the centering being accomplished such that each Gaussian function assumes its maximum value for an argument corresponding to the position of its respective source feature point.
Claim 6
Dependent Claim 100 words
A method as defined in claim 1 wherein the step of computing the mode shapes includes employing as the displacement of each body point in each simulated elastic body a value equal to the sum, evaluated at that body point, of the products of the displacements of that simulated elastic body's nodal points and respective interpolation functions, each interpolation function being a sum over the nodal points of Gaussian functions, centered on the respective nodal points such that each of the Gaussian functions assumes its maximum value for an argument value corresponding to the position of its respective nodal point.
Claim 7
Dependent Claim 16 words
A method as defined in claim 1 wherein the source and target images are one-dimensional images.
Claim 8
Dependent Claim 16 words
A method as defined in claim 1 wherein the source and target images are two-dimensional images.
Claim 9
Dependent Claim 16 words
A method as defined in claim 1 wherein the source and target images are three-dimensional images.
Claim 10
Dependent Claim 15 words
A method as defined in claim 1 wherein the images are n-dimensional images, where n>3.
Claim 11
Independent Claim 345 words
An apparatus for processing images by determining a point in an electronically encoded target image comprising target points which include target feature points that corresponds to a given point in an electronically encoded source image comprising source points which include source feature points, the apparatus comprising: A) body-defining circuitry for defining first and second simulated elastic bodies associated with the source and target images, respectively, each body comprising body points which include nodal points; B) mode-shape-computation circuitry for computing, for each of the images, the mode shapes of the modes of collective motion of nodal points of the body associated with that image and whose positions with respect to each other are the same as those of the feature points in the associated image, each of said mode shapes being an eigenvector comprising eigenvector components, each eigenvector component being associated with a different nodal point and representing the relative participation of that nodal point in the mode to which the eigenvector corresponds, and thereby associating with each feature point a generalized feature vector whose components represent the participations, as embodied in the eigenvector components, of that feature point's associated nodal point in respective modes; C) correspondence circuitry for assigning to each of a plurality of the source feature points a target feature point associated with a generalized feature vector whose difference from that associated with that source feature point is sufficiently small according to a predetermined criterion; D) map-determination circuitry for determining a mapping function of source points to target points in accordance with the relationships between the target feature points to which source feature points are assigned and the points to which the mapping function maps those same feature points; E) point-identifying circuitry for identifying the point in the target image that corresponds to the given source point by applying the mapping function to the given source point and generating an indication of the point thus identified; and F) image-processing circuitry for processing, based on the correspondence, at least one of the source and target images or generating at least one intermediate image therebetween.
Claim 12
Independent Claim 345 words
An apparatus for processing images by determining a point in an electronically encoded target image comprising target points which include target feature points that corresponds to a given point in an electronically encoded source image comprising source points which include source feature points, the apparatus comprising: A) body-defining circuitry for defining first and second simulated elastic bodies associated with the source and target images, respectively, each body comprising body points which include nodal points; B) mode-shape-computation circuitry for computing, for each of the images, the mode shapes of the modes of collective motion of nodal points of the body associated with that image and whose positions with respect to each other are the same as those of the feature points in the associated image, each of said mode shapes being an eigenvector comprising eigenvector components, each eigenvector component being associated with a different nodal point and representing the relative participation of that nodal point in the mode to which the eigenvector corresponds, and thereby associating with each feature point a generalized feature vector whose components represent the participations, as embodied in the eigenvector components, of that feature point's associated nodal point in respective modes; C) correspondence circuitry for assigning to each of a plurality of the source feature points a target feature point associated with a generalized feature vector whose difference from that associated with that source feature point is sufficiently small according to a predetermined criterion; D) map-determination circuitry for determining a mapping function of source points to target points in accordance with the relationships between the target feature points to which source feature points are assigned and the points to which the mapping function maps those same feature points; E) point-identifying circuitry for identifying the point in the target image that corresponds to the given source point by applying the mapping function to the given source point and generating an indication of the point thus identified; and F) image-processing circuitry for processing, based on the correspondence, at least one of the source and target images or generating at least one intermediate image therebetween.
Claim 13
Dependent Claim 13 words
An apparatus as defined in claim 10 wherein the mapping function is non-deformational.
Claim 14
Dependent Claim 79 words
An apparatus as defined in claim 10 wherein the mapping function applies to each source point a respective target point whose displacement from that source point is the sum of the products of (A) the displacements from source feature points of intermediate points that result, when subjected to scaling and a rigid-body transformation, in the target feature points with which their respective source feature points are associated and (B) respective sums of interpolation functions evaluated at that source point.
Claim 15
Dependent Claim 52 words
An apparatus as defined in claim 12 wherein the interpolation functions are Gaussian functions centered on respective source feature points having locations in the source image, the centering being accomplished such that each Gaussian function assumes its maximum value for an argument corresponding to the position of its respective source feature point.
Claim 16
Dependent Claim 95 words
An apparatus as defined in claim 10 wherein the mode-shape-computation circuitry employs as the displacement of each body point in each simulated elastic body a value equal to the sum, evaluated at that body point of the products of the displacements of that simulated elastic body's nodal points and respective interpolation functions, each interpolation function being a sum over the nodal points of Gaussian functions, centered on the respective nodal points such that each of the Gaussian functions assumes its maximum value for an argument value corresponding to the position of its respective nodal point.
Claim 17
Dependent Claim 16 words
An apparatus as defined in claim 10 wherein the source and target images are one-dimensional images.
Claim 18
Dependent Claim 16 words
An apparatus as defined in claim 10 wherein the source and target images are two-dimensional images.
Claim 19
Dependent Claim 16 words
An apparatus as defined in claim 10 wherein the source and target images are three-dimensional images.
Claim 20
Dependent Claim 15 words
An apparatus as defined in claim 10 wherein the images are n-dimensional images, where n>3.

References Cited (Backward Citations)

EP0440218A2 Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1999-12-31 2000-07-01 2000-12-31 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2003-12-31 2004-07-01 2004-12-31 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2007-12-31 2008-07-01 2008-12-31 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag