Patent US7146349B2 successfully refreshed from Google Patents.
US7146349B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Network for describing multimedia information
Assignee: International Business Machines Corp
•
Filing: 2001-11-01
•
Granted: 2006-12-05
•
Expires: 2021-11-01
Abstract
Abstract A method and apparatus for encoding knowledge using a multimedia network. A multimedia network represents semantic concepts and their relations using multimedia content. A multimedia network associates words and multimedia content with the semantic concepts in order to illustrate and exemplify the semantic concepts as well as describe lexical, semantic, and perceptual relations. The multimedia network can be searched, browsed, or summarized for purposes of information discovery. The multimedia network can also be used for personalizing multimedia content or for querying a multimedia information repository by expanding a query to include related concepts encoded in a Multimedia network.
Inventors
- 👤 Ana Belen Benitez-Jimenez
- 👤 Chung-Sheng Li
- 👤 John R. Smith
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:16
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/40; G06F16/48
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
102 words
A method implemented by at least one computer for encoding knowledge, comprising the steps of: forming a network having nodes that represent semantic concepts; associating one or more words with one or more of the nodes; associating multimedia content with one or more of the nodes; representing relationships between the nodes as arcs between associated words and arcs between associated multimedia content; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 2
Independent Claim
102 words
A method implemented by at least one computer for encoding knowledge, comprising the steps of: forming a network having nodes that represent semantic concepts; associating one or more words with one or more of the nodes; associating multimedia content with one or more of the nodes; representing relationships between the nodes as arcs between associated words and arcs between associated multimedia content; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 3
Dependent Claim
30 words
The method of claim 1 , further comprising: creating lexical relations between semantic concepts on the basis of one or more of: word forms and word meaning of associated words.
Claim 4
Dependent Claim
28 words
The method of claim 1 , wherein relationships between semantic concepts and between associated content are based at least in part on audio and/or visual feature descriptor values.
Claim 5
Dependent Claim
21 words
The method of claim 3 , further comprising: extracting feature descriptors from multimedia content; and computing similarity measures between descriptor values.
Claim 6
Dependent Claim
20 words
The method of claim 1 , wherein the media network knowledge is represented using the ISO MPEG-7 Description Definition Language.
Claim 7
Dependent Claim
25 words
The method of claim 1 , wherein the relationships between the nodes are based, at least in part, on the features of the multimedia content.
Claim 8
Dependent Claim
17 words
The method of claim 1 , wherein the relationships between the nodes denote similarity of semantic concepts.
Claim 9
Dependent Claim
16 words
The method of claim 1 , further comprising displaying the new multimedia presentation on a monitor.
Claim 10
Independent Claim
129 words
A method implemented by at least one computer for searching an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: accepting a query; matching the query to the words and multimedia content related to the concepts encoded in the media network knowledge representation; navigating the relationship arcs of the concepts associated with matching words and multimedia content; retrieving related concepts, words, and multimedia content from the matched nodes or related nodes; creating a new multimedia presentation from the matching related concepts, words, and multimedia content.
Claim 11
Independent Claim
129 words
A method implemented by at least one computer for searching an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: accepting a query; matching the query to the words and multimedia content related to the concepts encoded in the media network knowledge representation; navigating the relationship arcs of the concepts associated with matching words and multimedia content; retrieving related concepts, words, and multimedia content from the matched nodes or related nodes; creating a new multimedia presentation from the matching related concepts, words, and multimedia content.
Claim 12
Dependent Claim
29 words
The method of claim 9 , further comprising: forming a query comprised of words; and matching the query words to the words encoded in the media network knowledge representation.
Claim 13
Dependent Claim
31 words
The method of claim 9 , further comprising: forming a query comprised of multimedia content; and matching the query content to the multimedia content encoded in the media network knowledge representation.
Claim 14
Dependent Claim
53 words
The method of claim 9 , further comprising: forming a query comprised of audio and/or visual feature descriptor values, wherein the feature descriptor values denote proximity to the semantic concepts of the nodes; and matching the query descriptor values to the descriptor values of the content encoded in the media network knowledge representation.
Claim 15
Dependent Claim
123 words
A computer-implemented method for browsing an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: displaying one or more concept nodes and associated words and/or multimedia content; providing means for allowing a user to select related concepts for viewing; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 16
Dependent Claim
123 words
A computer-implemented method for browsing an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: displaying one or more concept nodes and associated words and/or multimedia content; providing means for allowing a user to select related concepts for viewing; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 17
Dependent Claim
47 words
The method of claim 13 , further comprising: providing means for allowing the user to select concept nodes and associated words and/or multimedia content for display on the basis of specific types or values of relations to a particular concept node or associated word or multimedia content.
Claim 18
Independent Claim
122 words
A method implemented by at least one computer for summarizing an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: extracting a subset of nodes, relations, and words and/or multimedia content from an encoded media network knowledge representation; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 19
Independent Claim
122 words
A method implemented by at least one computer for summarizing an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: extracting a subset of nodes, relations, and words and/or multimedia content from an encoded media network knowledge representation; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 20
Dependent Claim
17 words
The method of claim 15 , further comprising: consolidating together concept nodes, relations, words, and/or multimedia content.
Claim 21
Independent Claim
124 words
A method implemented by at least one computer for updating an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: adding, deleting or modifying concepts, relations, or associated words, multimedia content, or descriptors in the encoded media network knowledge representation; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 22
Independent Claim
124 words
A method implemented by at least one computer for updating an encoded media network knowledge representation that comprises a network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: adding, deleting or modifying concepts, relations, or associated words, multimedia content, or descriptors in the encoded media network knowledge representation; receiving a user query for at least one semantic concept; recursively searching the network for matching multimedia content within the network related to the user query; and creating a new multimedia presentation from the matching multimedia content within the network.
Claim 23
Independent Claim
116 words
A method implemented by at least one computer for querying a multimedia information repository associated with an encoded media network knowledge representation that comprises an encoded network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: searching the encoded media network knowledge representation; retrieving words, content, and/or descriptors from the media network knowledge representation; searching the information repository using the retrieved words, content, and/or descriptors; and creating a new multimedia presentation from the retrieved words, content, and/or descriptors within the network.
Claim 24
Independent Claim
116 words
A method implemented by at least one computer for querying a multimedia information repository associated with an encoded media network knowledge representation that comprises an encoded network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: searching the encoded media network knowledge representation; retrieving words, content, and/or descriptors from the media network knowledge representation; searching the information repository using the retrieved words, content, and/or descriptors; and creating a new multimedia presentation from the retrieved words, content, and/or descriptors within the network.
Claim 25
Independent Claim
119 words
A method implemented by at least one computer for personalizing multimedia information in a system comprising an encoded media network knowledge representation that includes an encoded network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: describing the multimedia information using words or descriptors; describing user preferences using words, multimedia content, and/or descriptors; matching the user preferences with the descriptions of the multimedia information; and extracting, retrieving, and/or summarizing the matched multimedia items; and creating a new multimedia presentation from the matched multimedia items.
Claim 26
Independent Claim
119 words
A method implemented by at least one computer for personalizing multimedia information in a system comprising an encoded media network knowledge representation that includes an encoded network having nodes that represent semantic concepts, one or more words and multimedia associated with the one or more nodes, and wherein relationships between the nodes are represented as arcs between associated words and arcs between associated multimedia content, the method comprising the steps of: describing the multimedia information using words or descriptors; describing user preferences using words, multimedia content, and/or descriptors; matching the user preferences with the descriptions of the multimedia information; and extracting, retrieving, and/or summarizing the matched multimedia items; and creating a new multimedia presentation from the matched multimedia items.
Claim 27
Dependent Claim
128 words
A computer program product in a computer readable medium for use for encoding knowledge, the computer program product comprising: first instructions for forming a network having logical nodes that represent semantic concepts; second instructions for associating one or more words with one or more of the nodes; third instructions for associating multimedia content with one or more of the nodes; fourth instructions for representing relationships between the nodes as arcs between associated words and arcs between associated multimedia content; fifth instructions for receiving a user query for at least one semantic concept; sixth instructions for recursively searching the network for matching multimedia content within the network related to the user query; and seventh instructions for creating a new multimedia presentation from the matching multimedia content within the network.
Claim 28
Dependent Claim
128 words
A computer program product in a computer readable medium for use for encoding knowledge, the computer program product comprising: first instructions for forming a network having logical nodes that represent semantic concepts; second instructions for associating one or more words with one or more of the nodes; third instructions for associating multimedia content with one or more of the nodes; fourth instructions for representing relationships between the nodes as arcs between associated words and arcs between associated multimedia content; fifth instructions for receiving a user query for at least one semantic concept; sixth instructions for recursively searching the network for matching multimedia content within the network related to the user query; and seventh instructions for creating a new multimedia presentation from the matching multimedia content within the network.
References Cited (Backward Citations)
US4965763A
Cited
US5251129A
Cited
US5263126A
Cited
US5806060A
Cited
US6112201A
Cited
US5983237A
Cited
US5802508A
Cited
US6246977B1
Cited
US6253170B1
Cited
US5963447A
Cited
EP0962873A1
Cited
US6493692B1
Cited
US6564263B1
Cited
US6819797B1
Cited
US6411724B1
Cited
US6405162B1
Cited
US6721697B1
Cited
US6629088B1
Cited
US6598018B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-12-04 | 2010-06-05 | 2010-12-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-12-04 | 2014-06-05 | 2014-12-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-12-04 | 2018-06-05 | 2018-12-05 | $7700.00 | Window Closed / Lapsed |