US7024020B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus and method for generating object-labeled image in video sequence
Assignee: Samsung Electronics Co Ltd
•
Filing: 2001-09-04
•
Granted: 2006-04-04
•
Expires: 2021-09-04
Abstract
Abstract An apparatus and method for generating object-labeled images based on query images in a video sequence are provided. A video sequence is divided into a plurality of shots, each of which consists of a set of frames having a similar scene, and an initial object region is extracted from each of the shots by determining whether an object image exists in key frames of the shots. Based on the initial object region extracted from each of the key frames, object regions are tracked in all frames of the shots. Then, the object regions are labeled to generate object-labeled images. Therefore, the object-labeled image generating apparatus and method can be applied regardless of the degree of motion of an object and time required to extract query objects is reduced.
Inventors
- 👤 Seong-deok Lee
- 👤 Chang-yeong Kim
- 👤 Ji-Yeon Kim
- 👤 Sang-kyun Kim
- 👤 Young-Su Moon
- 👤 Doo-sik Park
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:34
CPC Classifications
G; G06; G06V; G06V20/00; G06V20/40; G06V20/46; G06F; G06F16/00; G06F16/70; G06F16/73; G06F16/732; G06F16/7335; G06F16/78; G06F16/783; G06F16/7837; G06V20/70; Y; Y10; Y10S; Y10S707/00; Y10S707/99941; Y10S707/99944; Y10S707/99945; Y10S707/99948
Claims Analysis
Total Claims: 12
Claim 1
Independent Claim
156 words
A method for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, the method comprising the steps of: (a) dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots; (b) determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames; (c) for each query object, tracking object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query object based initial object regions; and (d) labeling the object regions tracked in each of the frames based on information on the corresponding query objects.
Claim 2
Independent Claim
156 words
A method for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, the method comprising the steps of: (a) dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots; (b) determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames; (c) for each query object, tracking object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query object based initial object regions; and (d) labeling the object regions tracked in each of the frames based on information on the corresponding query objects.
Claim 3
Dependent Claim
61 words
The method of claim 1 , wherein step (b) comprises: generating query object based shot mask images in all key frames of the shots by setting pixels of the query object based initial object regions extracted from each of the key frames as a first value and setting the remaining pixels of each of the key frames as a second value.
Claim 4
Dependent Claim
91 words
The method of claim 2 , wherein step (c) comprises: (c1) tracking the object regions in all frames of each of the shots based on the corresponding query image based shot mask images and video feature values of the corresponding query objects; and (c2) generating query object based frame mask images in all frames of each of the shots by setting pixels of the object regions tracked in each of the frames as a first value and setting the remaining pixels of each of the key frames as a second value.
Claim 5
Dependent Claim
41 words
The method of claim 3 , wherein, in step (d), each of the object regions is labeled in each frame with a unique number set to the corresponding query image or coordinate information of the corresponding query image in each frame.
Claim 6
Independent Claim
174 words
An apparatus for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, the apparatus comprising: a shot and key frame setting unit for dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots; an initial object region extractor for determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames; an object region tracker for tracking, for each query object, object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query image object based initial object regions; and an object-labeled image generator for labeling the object regions tracked in each of the frames based on information on the corresponding query objects.
Claim 7
Independent Claim
174 words
An apparatus for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, the apparatus comprising: a shot and key frame setting unit for dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots; an initial object region extractor for determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames; an object region tracker for tracking, for each query object, object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query image object based initial object regions; and an object-labeled image generator for labeling the object regions tracked in each of the frames based on information on the corresponding query objects.
Claim 8
Dependent Claim
65 words
The apparatus of claim 5 , wherein the initial object region extractor generates query object based shot mask images in all key frames of each of the shots by setting pixels of the query object based initial object regions extracted from each of the key frames as a first value and setting the remaining pixels of each of the key frames as a second value.
Claim 9
Dependent Claim
90 words
The apparatus of claim 6 , wherein the object region tracker tracks the object regions in all frames of each of the shots based on the corresponding query image based shot mask images and video feature values of the corresponding query objects, and generates query object based frame mask images in all frames of each of the shots by setting pixels of the object regions tracked in each of the frames as a first value and setting the remaining pixels of each of the key frames as a second value.
Claim 10
Dependent Claim
41 words
The apparatus of claim 5 , wherein the object-labeled image generator labels each of the object regions in each frame with a unique number set to the corresponding query image or coordinate information of the corresponding query image in each frame.
Claim 11
Dependent Claim
166 words
A computer readable medium having embodied thereon a computer program for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, wherein generating object-labeled images comprises the steps of: (a) dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots; (b) determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames; (c) for each query object, tracking object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query object based initial object regions; and (d) labeling the object regions tracked in each of the frames based on information on the corresponding query objects.
Claim 12
Dependent Claim
166 words
A computer readable medium having embodied thereon a computer program for receiving a video sequence including query objects to be extracted and generating object-labeled images based on the query objects, wherein generating object-labeled images comprises the steps of: (a) dividing the video sequence into one or more shots, each of which is a set of frames having a similar scene, and selecting one or more key frames from each of the shots; (b) determining whether there exists an object similar to each of the query objects in each of the key frames and extracting the similar objects as corresponding query object based initial object regions from each of the key frames; (c) for each query object, tracking object regions in all frames of only shots determined to have a respective similar object in a key frame based on the corresponding query object based initial object regions; and (d) labeling the object regions tracked in each of the frames based on information on the corresponding query objects.
References Cited (Backward Citations)
US5109435A
Cited
US5138671A
Cited
US5500904A
Cited
US5748775A
Cited
US5862508A
Cited
US5943442A
Cited
WO1998050869A1
Cited
JP2002513487A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-04-03 | 2009-10-03 | 2010-04-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-04-03 | 2013-10-03 | 2014-04-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-04-03 | 2017-10-03 | 2018-04-04 | $7700.00 | Window Closed / Lapsed |