US5907626A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for object tracking and mosaicing in an image sequence using a two-dimensional mesh
Assignee: Monument Peak Ventures LLC
•
Filing: 1997-08-01
•
Granted: 1999-05-25
•
Expires: 2017-08-01
Abstract
Abstract A method for motion tracking and constructing a mosaic of video objects is disclosed. Also disclosed is a method for synthetic object transfiguration from a mosaic. A 2-D triangular mesh is employed to represent a video object, which permits to describe the motion of the object by the displacements of the node points of the mesh, and to describe any intensity variations by the contrast and brightness parameters estimated for each node point. Using the temporal history of the node point locations, the nodes of the 2-D mesh are continued to be tracked even when they become invisible because of self-occlusion or occlusion by another object. By adding new nodes or updating the 2-D triangular mesh, any uncovered parts of the video object are incrementally added to the mosaic. A finite number of views representing the constructed mosaic are selected and used for synthetic transfiguration of a replacement object in place of the original one.
Inventors
- 👤 Candemir Toklu
- 👤 A. Tanju Erdem
- 👤 A. Murat Tekalp
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-31 17:33
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4038; G06T7/00; G06T7/20; G06T7/246; G06V; G06V10/00; G06V10/20; G06V10/24; G06V10/10; G06V10/16
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
74 words
A computer program product for creating a mosaic from a plurality of images, comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) receiving the plurality of images; (b) forming a mesh on each of the plurality of images for permitting tracking of local motion in the images; and (c) creating a mosaic from the plurality of images based on local motion described by the meshes.
Claim 2
Dependent Claim
74 words
A computer program product for creating a mosaic from a plurality of images, comprising: a computer readable storage medium having a computer program stored thereon for performing the steps of: (a) receiving the plurality of images; (b) forming a mesh on each of the plurality of images for permitting tracking of local motion in the images; and (c) creating a mosaic from the plurality of images based on local motion described by the meshes.
Claim 3
Dependent Claim
46 words
The computer program product as in claim 1 further comprising the steps of: (d) forming a replacement mosaic from selected views of a replacement object; and (e) transfiguring the replacement mosaic for generating a new sequence of images based on local motion described by the meshes.
Claim 4
Dependent Claim
54 words
The computer program product as in claim 1, wherein step (c) further includes forming the mesh on an object in the plurality of images and detecting regions that are to be covered by out-of-plane rotations of the object and/or occlusion by another object, and regions that are to remain visible in a subsequent frame.
Claim 5
Dependent Claim
21 words
The computer program product as in claim 3, wherein step (c) further includes propagating the object mesh in a subsequent frame.
Claim 6
Dependent Claim
25 words
The computer program product as in claim 4, wherein step (c) further includes finding a covered region due to self occlusion in the subsequent frame.
Claim 7
Dependent Claim
23 words
The computer program product as in claim 5, wherein step (c) further includes moving visible nodes towards a boundary of the object mesh.
Claim 8
Dependent Claim
20 words
The computer program product as in claim 6, wherein step (c) further includes introducing new nodes to the object mesh.
Claim 9
Dependent Claim
33 words
The computer program product as in claim 7, wherein step (c) further includes predicting locations of nodes of the mosaic mesh in the subsequent frame from locations of nodes of the object mesh.
Claim 10
Dependent Claim
24 words
The computer program product as in claim 8, wherein step (c) further includes refining the object mesh and mosaic mesh in the subsequent frame.
Claim 11
Dependent Claim
30 words
The computer program product as in claim 2, wherein step (d) further includes selecting a subset views in the received plurality of images that contain information present in the mosaic.
Claim 12
Dependent Claim
27 words
The computer program product as in claim 10, wherein step (c) further includes obtaining views of the replacement object that correspond to the selected subset of views.
Claim 13
Independent Claim
62 words
A method for for creating a mosaic from a plurality of images, the method comprising the steps of: (a) receiving the plurality of images; (b) forming a mesh on each of the plurality of images for permitting tracking of local motion in the images; and (c) creating a mosaic from the plurality of images based on local motion described by the meshes.
Claim 14
Independent Claim
62 words
A method for for creating a mosaic from a plurality of images, the method comprising the steps of: (a) receiving the plurality of images; (b) forming a mesh on each of the plurality of images for permitting tracking of local motion in the images; and (c) creating a mosaic from the plurality of images based on local motion described by the meshes.
Claim 15
Dependent Claim
44 words
The method as in claim 12 further comprising the steps of: (d) forming a replacement mosaic from selected views of a replacement object; and (e) transfiguring the replacement mosaic for generating a new sequence of images based on local motion described by the meshes.
Claim 16
Dependent Claim
52 words
The method as in claim 13, wherein step (c) further comprises forming the mesh on an object in the plurality of images and detecting regions that are to be covered by out-of-plane rotations of the object and/or occlusion by another object, and regions that are to remain visible in a subsequent frame.
Claim 17
Dependent Claim
19 words
The method as in claim 14, wherein step (c) further comprises propagating the object mesh in a subsequent frame.
Claim 18
Dependent Claim
23 words
The method as in claim 15, wherein step (c) further comprises finding a covered region due to self occlusion in the subsequent frame.
Claim 19
Dependent Claim
21 words
The method as in claim 16, wherein step (c) further comprises moving visible nodes towards a boundary of the object mesh.
Claim 20
Dependent Claim
18 words
The method as in claim 17, wherein step (c) further comprises introducing new nodes to the object mesh.
Claim 21
Dependent Claim
31 words
The method as in claim 18, wherein step (c) further comprises predicting locations of nodes of the mosaic mesh in the subsequent frame from locations of nodes of the object mesh.
Claim 22
Dependent Claim
22 words
The method as in claim 19, wherein step (c) further comprises refining the object mesh and mosaic mesh in the subsequent frame.
Claim 23
Dependent Claim
28 words
The method as in claim 13, wherein step (d) further comprising selecting a subset views in the received plurality of images that contain information present in the mosaic.
Claim 24
Dependent Claim
25 words
The method as in claim 21, wherein step (d) further comprising obtaining views of the replacement object that correspond to the selected subset of views.
References Cited (Backward Citations)
US4783833A
Cited
US5617482A
Cited
US5280530A
Cited
US5657402A
Cited
US5262856A
Cited
US5649032A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-05-24 | 2002-11-23 | 2003-05-25 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-05-24 | 2006-11-23 | 2007-05-25 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-05-24 | 2010-11-23 | 2011-05-25 | $7700.00 | Window Closed / Lapsed |