US6643387B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus and method for context-based indexing and retrieval of image sequences
Assignee: MediaTek Inc
•
Filing: 2000-01-24
•
Granted: 2003-11-04
•
Expires: 2020-01-24
Abstract
Abstract An apparatus and method for implementing object motion segmentation and object trajectory segmentation for an image sequence. Specifically, block-based motion vectors for a pair of adjacent frames are used to derive optical flow, e.g., affine, motion parameters. Such optical flow motion parameters are employed to determine key objects where their motion and trajectory within a sequence of frames are calculated and stored. Such object motion information is used to improve or offer image processing functions such as context-based indexing of the input image sequence by using motion-based information.
Inventors
- 👤 Sriram Sethuraman
- 👤 Edmond Chalom
- 👤 Iraj Sodagar
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:43
CPC Classifications
G; G06; G06V; G06V20/00; G06V20/40; G06V20/46; G06F; G06F16/00; G06F16/70; G06F16/78; G06F16/783; G06F16/7847; G06F16/786; G06V20/49
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
73 words
A method for performing object motion segmentation for an image sequence having a plurality of frames, said method comprising the steps of: a) determining at least one connected region within one of said frames of said image sequence; b) applying block-based motion vectors corresponding to blocks within said at least one connected region to generate optical flow motion parameters; and c) using said generated optical flow motion parameters for identifying a key object.
Claim 2
Independent Claim
73 words
A method for performing object motion segmentation for an image sequence having a plurality of frames, said method comprising the steps of: a) determining at least one connected region within one of said frames of said image sequence; b) applying block-based motion vectors corresponding to blocks within said at least one connected region to generate optical flow motion parameters; and c) using said generated optical flow motion parameters for identifying a key object.
Claim 3
Dependent Claim
34 words
The method of claim 1 , wherein said applying step b) applies block-based motion vectors of at least three blocks of said at least one connected region to generate said optical flow motion parameters.
Claim 4
Dependent Claim
26 words
The method of claim 1 , further comprising the step of: d) determining if an identified key object found in step c) is of sufficient size.
Claim 5
Dependent Claim
32 words
The method of claim 1 , further comprising the step of: d) determining if any two identified key objects found in step c) are to be merged into a single key object.
Claim 6
Dependent Claim
42 words
The method of claim 4 , wherein said determining step d) comprises the step of: d1) applying block-based motion vectors from at least three blocks from said any two identified key objects to generate a new set of optical flow motion parameters.
Claim 7
Dependent Claim
58 words
The method of claim 1 , further comprising the steps of: d) labeling an identified key object found in step c); and e) tracking said labeled key object in a current frame by using motion vector information from said current frame to correlate a region in said current frame with a labeled key object of a previous frame.
Claim 8
Dependent Claim
32 words
The method of claim 1 , further comprising the steps of: d) indexing the image sequence in accordance with said optical flow motion parameters of any identified key objects from step c).
Claim 9
Dependent Claim
41 words
The method of claim 7 , wherein said indexing step d) indexes the image sequence in accordance with said optical flow motion parameters of any identified key objects in conjunction with a spatial information associated with said any identified key objects.
Claim 10
Dependent Claim
53 words
The method of claim 1 , further comprising the steps of: d) splitting said identified key object into a plurality of sub-objects; and e) applying block-based motion vectors from at least three blocks from each of said sub-objects to generate a new set of optical flow motion parameters for each of said sub-objects.
Claim 11
Independent Claim
80 words
A method for performing motion segmentation and trajectory segmentation for an image sequence having a plurality of frames, said method comprising the steps of: a) applying optical flow object motion segmentation to obtain motion information for identifying at least one key object for a frame of the image sequence; and b) applying optical flow object trajectory segmentation to obtain trajectory information for said at least one key object for a frame interval greater than two frames of the image sequence.
Claim 12
Independent Claim
80 words
A method for performing motion segmentation and trajectory segmentation for an image sequence having a plurality of frames, said method comprising the steps of: a) applying optical flow object motion segmentation to obtain motion information for identifying at least one key object for a frame of the image sequence; and b) applying optical flow object trajectory segmentation to obtain trajectory information for said at least one key object for a frame interval greater than two frames of the image sequence.
Claim 13
Dependent Claim
58 words
The method of claim 10 , wherein said applying step a) comprises the steps of: a1) determining at least one connected region within one of said frame of said image sequence; a2) applying block-based motion vectors to generate optical flow motion parameters; and a3) using said generated optical flow motion parameters for searching one or more key objects.
Claim 14
Dependent Claim
16 words
The method of claim 1 , wherein said optical flow motion parameters are affine motion parameters.
Claim 15
Independent Claim
79 words
An apparatus for performing object motion segmentation for an image sequence having a plurality of frames, said apparatus comprising: means for determining at least one connected region within one of said frame of said image sequence; and an optical flow object segmenter for applying block-based motion vectors corresponding to blocks within said at least one connected region to generate optical flow motion parameters and for using said generated optical flow motion parameters for searching one or more key objects.
Claim 16
Independent Claim
79 words
An apparatus for performing object motion segmentation for an image sequence having a plurality of frames, said apparatus comprising: means for determining at least one connected region within one of said frame of said image sequence; and an optical flow object segmenter for applying block-based motion vectors corresponding to blocks within said at least one connected region to generate optical flow motion parameters and for using said generated optical flow motion parameters for searching one or more key objects.
Claim 17
Dependent Claim
35 words
The apparatus of claim 13 , wherein said optical flow object segmenter applies block-based motion vectors of at least three blocks of said at least one connected region to generate said optical flow motion parameters.
Claim 18
Dependent Claim
22 words
The apparatus of claim 13 , wherein said optical flow object segmenter determines if an identified key object is of sufficient size.
Claim 19
Dependent Claim
52 words
The apparatus of claim 13 , wherein said optical flow object segmenter determines if any two identified key objects are to be merged into a single key object by applying block-based motion vectors from at least three blocks from said any two identified key objects to generate said optical flow motion parameters.
Claim 20
Independent Claim
74 words
An apparatus for performing motion segmentation and trajectory segmentation for an image sequence having a plurality of frames, said apparatus comprising: an optical flow object motion segmenter for obtaining motion information for at least one key object for a frame of the image sequence; and an optical flow object trajectory segmenter for obtaining trajectory information for said at least one key object for a frame interval greater than two frames of the image sequence.
Claim 21
Independent Claim
74 words
An apparatus for performing motion segmentation and trajectory segmentation for an image sequence having a plurality of frames, said apparatus comprising: an optical flow object motion segmenter for obtaining motion information for at least one key object for a frame of the image sequence; and an optical flow object trajectory segmenter for obtaining trajectory information for said at least one key object for a frame interval greater than two frames of the image sequence.
Claim 22
Dependent Claim
61 words
The apparatus of claim 17 , wherein said optical flow object motion segmenter comprises: means for determining at least one connected region within one of said frame of said image sequence; and a segmenter for applying block-based motion vectors to generate optical flow motion parameters and for using said generated optical flow motion parameters for searching one or more key objects.
Claim 23
Dependent Claim
82 words
A computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions including instructions which, when executed by a processor, cause the processor to perform the steps comprising of: a) determining at least one connected region within one of said frame of said image sequence; b) applying block-based motion vectors corresponding to blocks within said at least one connected region to generate optical flow motion parameters; and c) using said generated optical flow motion parameters for identifying a key object.
Claim 24
Dependent Claim
82 words
A computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions including instructions which, when executed by a processor, cause the processor to perform the steps comprising of: a) determining at least one connected region within one of said frame of said image sequence; b) applying block-based motion vectors corresponding to blocks within said at least one connected region to generate optical flow motion parameters; and c) using said generated optical flow motion parameters for identifying a key object.
Claim 25
Dependent Claim
87 words
A computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions including instructions which, when executed by a processor, cause the processor to perform the steps comprising of: a) applying optical flow object motion segmentation to obtain motion information for identifying at least one key object for a frame of the image sequence; and b) applying optical flow object trajectory segmentation to obtain trajectory information for said at least one key object for a frame interval greater than two frames of the image sequence.
Claim 26
Dependent Claim
87 words
A computer-readable medium having stored thereon a plurality of instructions, the plurality of instructions including instructions which, when executed by a processor, cause the processor to perform the steps comprising of: a) applying optical flow object motion segmentation to obtain motion information for identifying at least one key object for a frame of the image sequence; and b) applying optical flow object trajectory segmentation to obtain trajectory information for said at least one key object for a frame interval greater than two frames of the image sequence.
References Cited (Backward Citations)
US6097832A
Cited
US5787205A
Cited
US6236682B1
Cited
US5557684A
Cited
US5734737A
Cited
US5802220A
Cited
EP0805405A2
Cited
US6154578A
Cited
US5909251A
Cited
US5930379A
Cited
US6263089B1
Cited
US6400830B1
Cited
US6400831B2
Cited
US6192156B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-11-03 | 2007-05-05 | 2007-11-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-11-03 | 2011-05-05 | 2011-11-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-11-03 | 2015-05-05 | 2015-11-04 | $7700.00 | Window Closed / Lapsed |