Patent US8316301B2 successfully refreshed from Google Patents.
US8316301B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus, medium, and method segmenting video sequences based on topic
Assignee: Samsung Electronics Co Ltd
•
Filing: 2006-08-04
•
Granted: 2012-11-20
•
Expires: 2026-08-04
Abstract
Abstract Provided are an apparatus, medium, and method segmenting video sequences based on a topic. The apparatus may include a start-shot determination unit detecting a plurality of key-frames by using character information from video sequences including a plurality of frames to determine the detected key-frames as start-shots for each topic, and a topic list creation unit creating a topic list by using the start-shots for each topic.
Inventors
- 👤 Jungbae Kim
- 👤 Doosun Hwang
- 👤 Jiyeun Kim
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:26
CPC Classifications
G; G11; G11B; G11B27/00; G11B27/10; G11B27/19; G11B27/28; G11B27/32; G11B27/326; G06; G06V; G06V20/00; G06V20/40; G06V20/46; G06V20/47
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
109 words
An apparatus topic based segmenting a video program, the apparatus comprising: a start-shot determination unit to detect a plurality of key-frames based on character information from video sequences including a plurality of frames to determine the detected key-frames as start-shots for each topic; and a topic list creation unit including at least one processing device to create a topic list based on the start-shots for each topic, wherein the start-shot determination unit determines the detected key-frames corresponding to a total number of main characters appearing in the video sequences and the total number of main characters is determined by analyzing an electronic program guide (EPG) signal and character clustering.
Claim 2
Independent Claim
109 words
An apparatus topic based segmenting a video program, the apparatus comprising: a start-shot determination unit to detect a plurality of key-frames based on character information from video sequences including a plurality of frames to determine the detected key-frames as start-shots for each topic; and a topic list creation unit including at least one processing device to create a topic list based on the start-shots for each topic, wherein the start-shot determination unit determines the detected key-frames corresponding to a total number of main characters appearing in the video sequences and the total number of main characters is determined by analyzing an electronic program guide (EPG) signal and character clustering.
Claim 3
Dependent Claim
23 words
The apparatus of claim 1 , wherein the start-shot determination unit detects key-frames based on clothing information of at least one main character.
Claim 4
Dependent Claim
46 words
The apparatus of claim 1 , wherein the topic list creation unit organizes frames existing between a current topic start-shot and a next topic start-shot into a current topic episode, and adds the current topic episode to the start-shot of each topic in the topic list.
Claim 5
Dependent Claim
98 words
The apparatus of claim 1 , wherein the start-shot determination unit comprises: a pre-processing unit to determine frames belonging to a respective scene by detecting scene change among frames included in the video sequences and to obtain the total number of main characters appearing in the video sequences; a face detection unit to detect faces from the determined frames belonging to the respective scene to determine face detection frames; and a key-frame determination unit to cluster the determined face detection frames according to the main characters corresponding to the total number of main characters to determine the key-frames.
Claim 6
Dependent Claim
25 words
The apparatus of claim 4 , wherein the pre-processing unit detects the scene change by calculating similarity between a current frame and a previous frame.
Claim 7
Dependent Claim
24 words
The apparatus of claim 4 , wherein the pre-processing unit obtains the total number of main characters from the electronic program guide (EPG) signal.
Claim 8
Dependent Claim
62 words
The apparatus of claim 4 , wherein the pre-processing unit comprises: a thumbnail image creation unit to create thumbnail images for input frames; a scene change detection unit to detect the scene change using similarity of color histograms between thumbnail images of neighboring frames; and a number-of-main-characters determination unit to determine the total number of main characters by analyzing the EPG signal.
Claim 9
Dependent Claim
63 words
The apparatus of claim 4 , wherein the face detection unit comprises: a thumbnail image re-organization unit to create an integral image for thumbnail images of input frames and to re-organize the thumbnail images using the integral image; a sub-window generation unit to generate a sub-window within the re-organized thumbnail images; and a classifying unit to determining whether the sub-window includes a face.
Claim 10
Dependent Claim
73 words
The apparatus of claim 8 , wherein the face detection unit divides the thumbnail images of the input frames into a plurality of sections comprising a section having a highest probability of detecting the face, and sequentially provides the plurality of sections to the thumbnail image re-organization unit in descending order from the section having the highest probability of detecting the face to a section having a lowest probability of detecting the face.
Claim 11
Dependent Claim
90 words
The apparatus of claim 4 , wherein the key-frame determination unit comprises: a clothing information extraction unit to extract clothing information from a face detection frame; a character clustering unit to perform a character clustering method based on the extracted clothing information; and a main character determination unit to select a cluster corresponding to the main character from a plurality of clusters, clustered in the character clustering unit, corresponding to the total number of main characters and to provide frames included in the selected cluster as key-frames of each topic.
Claim 12
Dependent Claim
15 words
The apparatus of claim 10 , wherein the clothing information comprises a clothing color histogram.
Claim 13
Independent Claim
100 words
A method of topic based segmenting of video sequences, the method comprising: detecting, using at least one processing device, a plurality of key-frames based on character information from video sequences including a plurality of frames to determine the detected key-frames as start-shots for each topic; and creating a topic list based on the start-shots for each topic, wherein the determination of the start-shots determines the detected key-frames corresponding to a total number of main characters appearing in the video sequences and the total number of main characters is determined by analyzing an electronic program guide (EPG) signal and character clustering.
Claim 14
Independent Claim
100 words
A method of topic based segmenting of video sequences, the method comprising: detecting, using at least one processing device, a plurality of key-frames based on character information from video sequences including a plurality of frames to determine the detected key-frames as start-shots for each topic; and creating a topic list based on the start-shots for each topic, wherein the determination of the start-shots determines the detected key-frames corresponding to a total number of main characters appearing in the video sequences and the total number of main characters is determined by analyzing an electronic program guide (EPG) signal and character clustering.
Claim 15
Dependent Claim
25 words
The method of claim 12 , wherein the determination of the start-shots includes detecting key-frames based on clothing information of at least one main character.
Claim 16
Dependent Claim
47 words
The method of claim 12 , wherein the creation of the topic list organizes frames existing between a current topic start-shot and a next topic start-shot into a current topic episode, and adds the current topic episode to the start-shot of each topic in the topic list.
Claim 17
Dependent Claim
90 words
The method of claim 12 , wherein the determination of the start-shots comprises: detecting a scene change from the frames included in the video sequences to determine frames belonging to a respective scene and obtaining the total number of main characters appearing in the video sequences; detecting faces from the determined frames belonging to the respective scene to determine face detection frames; and clustering the determined face detection frames according to the main characters corresponding to the total number of main characters to determine the face detection frames as key-frames.
Claim 18
Dependent Claim
31 words
The method of claim 15 , wherein the scene change is detected by creating thumbnail images of input frames and using similarity of color histograms between thumbnail images of neighboring frames.
Claim 19
Dependent Claim
23 words
The method of claim 15 , wherein the total number of main characters is obtained by analyzing the electronic program guide (EPG) signal.
Claim 20
Dependent Claim
48 words
The method of claim 15 , wherein the detection of the faces comprises: creating an integral image for thumbnail images of input frames and re-organizing the thumbnail images using the integral image; generating a sub-window within the re-organized thumbnail images; and determining whether the sub-window comprises a face.
Claim 21
Dependent Claim
74 words
The method of claim 18 , wherein the detection of the faces further comprises dividing the thumbnail images of the input frames into a plurality of sections comprising a section having a highest probability of detecting a face, and sequentially providing the thumbnail images for the thumbnail image re-organizing in descending order from the section having the highest probability of detecting the face to a section having a lowest probability of detecting the face.
Claim 22
Dependent Claim
68 words
The method of claim 15 , wherein the determination of the key-frames comprises: extracting clothing information from the face detection frames; performing a character clustering method based on the extracted clothing information; and selecting a cluster corresponding to the main character from a plurality of clusters corresponding to the total number of main characters and providing frames included in the selected cluster as the key-frames of each topic.
Claim 23
Dependent Claim
25 words
A non-transitory computer readable storage medium comprising computer readable code to control at least one processing device to implement the method of claim 12 .
References Cited (Backward Citations)
US5821945A
Cited
US6072542A
Cited
US6438165B2
Cited
US6602297B1
Cited
US6493042B1
Cited
US20060064716A1
Cited
US6724933B1
Cited
US6711587B1
Cited
US20020102024A1
Cited
US20020146168A1
Cited
KR100438269B1
Cited
US20030030752A1
Cited
US20040008789A1
Cited
US20040143434A1
Cited
US20060090179A1
Cited
US20060103736A1
Cited
US20060173916A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2015-11-20 | 2016-05-21 | 2016-11-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2019-11-20 | 2020-05-21 | 2020-11-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2023-11-20 | 2024-05-21 | 2024-11-20 | $7700.00 | Window Closed / Lapsed |