Patent US6546185B1 successfully refreshed from Google Patents.
US6546185B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for searching a particular character in a motion picture
Assignee: LG Electronics Inc
•
Filing: 1999-01-29
•
Granted: 2003-04-08
•
Expires: 2019-01-29
Abstract
Abstract A system for searching a particular character in a motion picture is disclosed comprising a recording medium on which the motion picture is recorded, the recorded motion picture being reproduced and displayed by a reproducing mechanism. The recording medium contains video information of a character table and location information indicative of scenes or sections in which a particular character appears. Thus, the system automatically searches and displays scenes and sections in which a character appears in the motion picture based upon the character table and the location information.
Inventors
- 👤 Hyeon Jun Kim
- 👤 Jin Soo Lee
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 14:08
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/76; H04N5/91; H04N21/00; H04N21/40; H04N21/43; H04N21/432; G; G06; G06F; G06F16/00; G06F16/70; G06F16/78; G06F16/783; G06F16/7837; G06F16/784; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161
Claims Analysis
Total Claims: 37
Claim 1
Independent Claim
204 words
A system for identifying and searching a particular character in a motion picture comprising: a character table generator that initially detects and identifies characters by detecting Face_Scenes when a face in a frame of the motion picture is greater than a predetermined size and detecting characters by their faces in the Face_Scenes, makes a character table based on the detected faces in the Face_Scenes and indexes scenes in which the character in the character table appears in the motion picture based upon the Face_Scenes; a recording medium inputting and storing the motion picture, the character table, and index information indicating scenes in which a character in the character table appears in the motion picture; a display unit; a user interface receiving a character selection; and reproduction unit automatically searching and displaying on the display unit at least one scene in which the selected character appears in the motion picture based upon the character table and the index information, wherein the character table generator detects faces in the Face_Scenes by automatically initially detecting faces in the Face_Scene, wherein the automatic initial detecting comprises identifying density lines connecting portions having the same lightness on an image of a face or identifying a direction of a nose.
Claim 2
Independent Claim
204 words
A system for identifying and searching a particular character in a motion picture comprising: a character table generator that initially detects and identifies characters by detecting Face_Scenes when a face in a frame of the motion picture is greater than a predetermined size and detecting characters by their faces in the Face_Scenes, makes a character table based on the detected faces in the Face_Scenes and indexes scenes in which the character in the character table appears in the motion picture based upon the Face_Scenes; a recording medium inputting and storing the motion picture, the character table, and index information indicating scenes in which a character in the character table appears in the motion picture; a display unit; a user interface receiving a character selection; and reproduction unit automatically searching and displaying on the display unit at least one scene in which the selected character appears in the motion picture based upon the character table and the index information, wherein the character table generator detects faces in the Face_Scenes by automatically initially detecting faces in the Face_Scene, wherein the automatic initial detecting comprises identifying density lines connecting portions having the same lightness on an image of a face or identifying a direction of a nose.
Claim 3
Dependent Claim
78 words
A system of claim 1 , wherein the reproduction unit comprises: a reproduction controller automatically searching and reproducing the motion picture according to a location information; a character and index processor processing the index information to obtain the location information indicating scenes in which the selected character in the character table appears in the motion picture; and a motion picture processor processing the motion picture reproduced at the reproduction controller and outputting a result to the display unit.
Claim 4
Dependent Claim
23 words
A system of claim 2 , wherein the Face Scenes comprise only scenes where a face size is greater than a predetermined size.
Claim 5
Dependent Claim
28 words
A system of claim 1 , wherein the character table is displayed on the display unit allowing a user to make the character selection through the user interface.
Claim 6
Dependent Claim
22 words
A system of claim 4 , wherein the displayed character table is representative scenes of each character appearing in the motion picture.
Claim 7
Dependent Claim
61 words
A system of claim 1 , wherein the index information indicates sections in which a character in the character table appears in the motion picture, and wherein the reproduction unit automatically searches and displays on the display unit at least one section in which the selected character appears in the motion picture based upon the character table and the index information.
Claim 8
Dependent Claim
25 words
A system of claim 6 , wherein a section is a predetermined interval of scenes in which a character successively appears in the motion picture.
Claim 9
Dependent Claim
62 words
A system of claim 6 , wherein the character table made by representative scenes of each character appearing in the motion picture is displayed on the display unit allowing a user to make the character selection through the user interface, and wherein the reproduction unit displays the first frame of the section corresponding to the representative scene based upon the index information.
Claim 10
Dependent Claim
33 words
A system of claim 6 , wherein the reproduction unit displays the first frame of the section in which the selected character first appears in the motion picture based upon the index information.
Claim 11
Dependent Claim
45 words
A system of claim 6 , wherein the indexed sections of the selected character are displayed on the display unit allowing a user to make a section selection through the user interface and wherein the reproduction unit displays the first frame of the selected section.
Claim 12
Dependent Claim
19 words
A system of claim 6 , wherein the reproduction unit automatically displays all the sections of the selected character.
Claim 13
Dependent Claim
19 words
A system of claim 1 , wherein the reproduction unit automatically displays all the scenes of the selected character.
Claim 14
Dependent Claim
68 words
The system for identifying and searching a particular character in a motion picture as claimed in claim 1 , wherein the character table generator detects faces in the Face_Scenes by sampling two images at an interval of Δt, where the difference between the two sampled images are sorted to create a differential image and the differential image, if greater than a predetermined threshold, is defined as a face.
Claim 15
Dependent Claim
32 words
The system for identifying and searching a particular character in a motion picture as claimed in claim 1 , wherein the automatic initial detecting further comprises identifying a gradation of a face.
Claim 16
Dependent Claim
46 words
The system for identifying and searching a particular character in a motion picture as claimed in claim 1 , wherein the automatic initial detecting further comprises identifying a gradation on a half line passing a center of a face in an image of equivalent density lines.
Claim 17
Dependent Claim
41 words
The system for identifying and searching a particular character in a motion picture as claimed in claim 1 , wherein the automatic initial detecting further comprises identifying an Aegean-face information and an Aegean-nose information obtained through a principle component analysis (PCA).
Claim 18
Dependent Claim
117 words
The system for identifying and searching a particular character in a motion picture as claimed in claim 1 , wherein the character table generator indexes scenes by: extracting color information samples of a character's clothes from the detected Face_Scenes; determining whether clothes color information corresponding to the sample color information of a character appears in frames between two Face_Scenes of a character group from which the color information was extracted; designating an interval between two frames as a section if the interval between frames, including said two Face_Scenes, containing the sample clothes color information is less than a predetermined reference value t; and indexing the designated sections according to the character's identification mark and a scene number.
Claim 19
Independent Claim
168 words
A method of producing a recording medium comprising: inputting and displaying a motion picture; detecting previously unclassified Face_Scenes when a face in a frame of the motion picture is greater than a predetermined size; automatically initially identifying, classifying, making and recording of characters into a character table based upon the classified Face_Scenes; and indexing scenes in which a character in the character table appears in the motion picture based upon the Face_Scenes, wherein the indexing the scenes comprises, extracting color information samples of a character's clothes from the detected Face_Scenes, determining whether clothes color information corresponding to the sample color information of a character appears in frames between two Face_Scenes of a character group from which the color information was extracted, designating an interval between two frames as a section if the interval between frames, including said two Face_Scenes, containing the sample clothes color information is less than a predetermined reference value t, and indexing the designated sections according to the character's identification mark and a scene number.
Claim 20
Independent Claim
168 words
A method of producing a recording medium comprising: inputting and displaying a motion picture; detecting previously unclassified Face_Scenes when a face in a frame of the motion picture is greater than a predetermined size; automatically initially identifying, classifying, making and recording of characters into a character table based upon the classified Face_Scenes; and indexing scenes in which a character in the character table appears in the motion picture based upon the Face_Scenes, wherein the indexing the scenes comprises, extracting color information samples of a character's clothes from the detected Face_Scenes, determining whether clothes color information corresponding to the sample color information of a character appears in frames between two Face_Scenes of a character group from which the color information was extracted, designating an interval between two frames as a section if the interval between frames, including said two Face_Scenes, containing the sample clothes color information is less than a predetermined reference value t, and indexing the designated sections according to the character's identification mark and a scene number.
Claim 21
Dependent Claim
56 words
A method of claim 18 , wherein the making the character table comprises: classifying and grouping the detected Face_Scenes into various characters using a face recognition technology; selecting representative Face_Scenes from each character group; and making the character table with the selected representative Face_Scenes, and assigning an identification mark to each character in the character table.
Claim 22
Dependent Claim
23 words
A method of claim 19 , wherein grouping the detected Face_Scenes into various characters further includes manually checking and modifying the character groups.
Claim 23
Dependent Claim
165 words
A method of claim 18 , wherein the indexing further comprises: (a) determining whether clothes color information corresponding to the sample color information of the character in a indexed section appears in frames preceding and succeeding the frames of the first and last frames of said indexed section; (b) designating an interval between the preceding frame determined to contain clothes color information corresponding to the sample color information of the character in a indexed section and the first frame of the indexed section as part of said indexed section if the interval is less than the predetermined value t; (c) designating an interval between the succeeding frame determined to contain clothes color information corresponding to the sample color information of the character in a indexed section and the last frame of the indexed section as part of said indexed section if the interval is less than the predetermined value t; (d) re-indexing the indexed section, if necessary; and repeating steps (a)-(d) for each indexed sections.
Claim 24
Dependent Claim
24 words
A method of producing a recording medium as claimed in claim 18 , wherein characters are initially identified and classified automatically and not manually.
Claim 25
Dependent Claim
66 words
A method of producing a recording medium as claimed in claim 18 , wherein the automatic initial classification of characters comprises identifying a face of a character by sampling two images at an interval of Δt, where the difference between the two sampled images are sorted to create a differential image and the differential image, if greater than a predetermined threshold, is defined as a face.
Claim 26
Independent Claim
132 words
A system for searching a particular character in a motion picture comprising: a character and index processor comprising a facial recognizer to detect Face_Scenes, a facial classifier to initially classify and group characters, wherein the facial classifier assigns a character identification mark or number to each character and a table generator to generate a character table based on each character's identification mark or number and a portion of the motion picture in which each character appears; a recording medium storing the motion picture, the character table, and index information indicating scenes in which a character in the character table appears in the motion picture; and a display unit displaying the character table allowing a user to select a character and displaying the portion of the motion picture in which the character appears.
Claim 27
Independent Claim
132 words
A system for searching a particular character in a motion picture comprising: a character and index processor comprising a facial recognizer to detect Face_Scenes, a facial classifier to initially classify and group characters, wherein the facial classifier assigns a character identification mark or number to each character and a table generator to generate a character table based on each character's identification mark or number and a portion of the motion picture in which each character appears; a recording medium storing the motion picture, the character table, and index information indicating scenes in which a character in the character table appears in the motion picture; and a display unit displaying the character table allowing a user to select a character and displaying the portion of the motion picture in which the character appears.
Claim 28
Dependent Claim
61 words
A system of claim 24 , wherein the index information indicates sections in which a character in the character table appears in the motion picture, and wherein the reproduction unit automatically searches and displays on the display unit at least one section in which the selected character appears in the motion picture based upon the character table and the index information.
Claim 29
Dependent Claim
45 words
A system of claim 25 , wherein the indexed sections of the selected character are displayed on the display unit allowing a user to make a section selection through the user interface and wherein the reproduction unit displays the first frame of the selected section.
Claim 30
Dependent Claim
54 words
The system of claim 24 , wherein the character table generating means classifies and groups the detected Face_Scenes into various characters using a face recognition technology, selects representative Face_Scenes from each character group, makes the character table with the selected representative Face_Scenes, and assigns the identification mark to each character in the character table.
Claim 31
Dependent Claim
102 words
The system of claim 24 , wherein the indexing means extracts color information samples of a character's clothes from the detected Face_Scenes, determines whether clothes color information corresponding to the sample color information of a character appears in frames between two Face_Scenes of a character group from which the color information was extracted, designates an interval between two frames as a section if the interval between frames, including said two Face_Scenes, containing the sample clothes color information is less than a predetermined reference value t, and wherein the designated sections are indexed according to the character's identification mark and a scene number.
Claim 32
Dependent Claim
37 words
The system for searching a particular character in a motion picture as claimed in claim 24 , wherein initial identification of characters is automatically done by the system without manual input or intervention by a system user.
Claim 33
Dependent Claim
65 words
The system for searching a particular character in a motion picture as claimed in claim 24 , wherein initial identification of characters comprises identifying a face by sampling two images at an interval of Δt, where the difference between the two sampled images are sorted to create a differential image and the differential image, if greater than a predetermined threshold, is defined as a face.
Claim 34
Dependent Claim
51 words
A system of claim 24 , wherein the facial recognizer detects faces in the Face_Scenes by automatically initially detecting faces in the Face_Scene, wherein the automatic initial detecting comprises identifying density lines connecting portions having the same lightness on an image of a face or identifying a direction of a nose.
Claim 35
Dependent Claim
19 words
A system of claim 31 , wherein the automatic initial detecting further comprises identifying a gradation of a face.
Claim 36
Dependent Claim
33 words
A system of claim 31 , wherein the automatic initial detecting further comprises identifying a gradation on a half line passing a center of a face in an image of equivalent density lines.
Claim 37
Dependent Claim
28 words
A system of claim 31 , wherein the automatic initial detecting further comprises identifying an Aegean-face information and an Aegean-nose information obtained through a principle component analysis (PCA).
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-04-07 | 2006-10-07 | 2007-04-08 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-04-07 | 2010-10-07 | 2011-04-08 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-04-07 | 2014-10-07 | 2015-04-08 | $7700.00 | Window Closed / Lapsed |