US6493707B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Hypervideo: information retrieval using realtime buffers
Assignee: Verizon Laboratories Inc
•
Filing: 1999-10-29
•
Granted: 2002-12-10
•
Expires: 2019-10-29
Abstract
Abstract Disclosed is a method and device for selecting documents, such as Web pages or sites, for presentation to a user, in response to a user expression of interest, during the course of presentation to the user of a document, such as a video or audio selection, whose content varies with time. The method takes advantage of information retrieval techniques to select documents related to the portion of the temporal document in which the user has expressed interest. The method generates the search query to use to select documents by reference to text associated with the portion of the temporal document in which the user has expressed interest, as by using the closed caption test associated with the video, or by using speech recognition techniques. The method further uses a weighting function to weigh the terms used in the search query, depending on their temporal relationship to the user expression of interest. The method uses a buffer to save necessary information about the temporal occurrence of terms in the temporal document.
Inventors
- 👤 Jayanta Kumar Dey
- 👤 Haiping Xu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:09
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/90; G06F16/95; G06F16/953; G06F16/9535; G06F16/40; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99934; Y10S707/99936
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
263 words
A method for finding documents which relate to a portion of a temporal document, comprising: (a) in response to a signal of interest at a particular time during the temporal document, identifying a portion of the temporal document for which related documents are to be found; (b) selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) finding the related documents by use of information retrieval techniques as applied to the text selected; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; and wherein W ( t ) = W t 1 , t 2 ( t ) = ∫ k = 0 t ( 1 - exp ( - t 1 ) ) * exp ( - t 1 k ) * ( 1 - exp ( - t 2 ) ) * exp ( - t 2 ( t - k ) ) , where t 1 and t 2 are constants.
Claim 2
Independent Claim
263 words
A method for finding documents which relate to a portion of a temporal document, comprising: (a) in response to a signal of interest at a particular time during the temporal document, identifying a portion of the temporal document for which related documents are to be found; (b) selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) finding the related documents by use of information retrieval techniques as applied to the text selected; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; and wherein W ( t ) = W t 1 , t 2 ( t ) = ∫ k = 0 t ( 1 - exp ( - t 1 ) ) * exp ( - t 1 k ) * ( 1 - exp ( - t 2 ) ) * exp ( - t 2 ( t - k ) ) , where t 1 and t 2 are constants.
Claim 3
Dependent Claim
14 words
The method of claim 1 , wherein t 1 =0.0001 and t 2 =0.00025.
Claim 4
Dependent Claim
34 words
The method of claim 2 , wherein W(t)=W t1, t2 (t) for times from 30 seconds before the signal of interest is given until the signal is given, and W(t)=0 for all other times.
Claim 5
Dependent Claim
15 words
The method of claim 1 , wherein the related documents are accessed through the Internet.
Claim 6
Dependent Claim
33 words
The method of claim 4 , further including selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection.
Claim 7
Dependent Claim
87 words
The method of claim 5 , wherein the related documents are selected from the collection according to the scores achieved when evaluating the documents in the collection according to a formula giving scores to documents depending upon the occurrence in the documents of terms which occur in text associated with the portion of the temporal document identified, where each term is weighted by a function W(t) according to the time t at which the term occurs relative to the time at which the signal of interest occurs.
Claim 8
Dependent Claim
58 words
The method of claim 6 , wherein the terms which occur in the text which is associated with the portion of the temporal document identified, and the times at which the terms occur, are determined by reference to the buffer which contains the terms and the times in the video or audio material at which the terms occur.
Claim 9
Dependent Claim
15 words
The method of claim 6 , where a predetermined number of documents, 1000, is selected.
Claim 10
Independent Claim
467 words
A method for finding documents which relate to a portion of a temporal document, comprising: (a) in response to a signal of interest at a particular time during the temporal document, identifying a portion of the temporal document for which related documents are to be found; (b) selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) finding the related documents by use of information retrieval techniques as applied to the text selected; and (e) selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; wherein the related documents are selected from the collection according to the scores achieved when evaluating documents in the collection according to a formula giving scores to documents depending upon the occurrence in the documents of terms which occur in text associated with the portion of the temporal document identified, where each term is weighted by a function W(t) according to the time t at which the term occurs relative to the time at which the signal of interest occurs; and wherein a score S D of a document D in the collection may be determined by crediting the document D, for each term T in the temporal portion of the document identified which occurs in the document D, with an amount proportional to W(t), to Robertson's term frequency TF TD and to ID FT where W(t) is the weight assigned to a term which occurs at time t relative to the signal of interest, TF TD =N TD /( N TD +K 1 +K 2 *( L D /L 0 )), and N TD is the number of times the term T occurs in document D, L D is the length of document D, L 0 is the average length of a document in the collection of documents indexed, K 1 and K 2 are constants, and ID FT =log(( N+K 3 )/ N T )/log( N+K 4 ), and N is the number of documents in the collection, N T is the number of documents containing the term T in the collection, and K 3 and K 4 are constants.
Claim 11
Independent Claim
467 words
A method for finding documents which relate to a portion of a temporal document, comprising: (a) in response to a signal of interest at a particular time during the temporal document, identifying a portion of the temporal document for which related documents are to be found; (b) selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) finding the related documents by use of information retrieval techniques as applied to the text selected; and (e) selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; wherein the related documents are selected from the collection according to the scores achieved when evaluating documents in the collection according to a formula giving scores to documents depending upon the occurrence in the documents of terms which occur in text associated with the portion of the temporal document identified, where each term is weighted by a function W(t) according to the time t at which the term occurs relative to the time at which the signal of interest occurs; and wherein a score S D of a document D in the collection may be determined by crediting the document D, for each term T in the temporal portion of the document identified which occurs in the document D, with an amount proportional to W(t), to Robertson's term frequency TF TD and to ID FT where W(t) is the weight assigned to a term which occurs at time t relative to the signal of interest, TF TD =N TD /( N TD +K 1 +K 2 *( L D /L 0 )), and N TD is the number of times the term T occurs in document D, L D is the length of document D, L 0 is the average length of a document in the collection of documents indexed, K 1 and K 2 are constants, and ID FT =log(( N+K 3 )/ N T )/log( N+K 4 ), and N is the number of documents in the collection, N T is the number of documents containing the term T in the collection, and K 3 and K 4 are constants.
Claim 12
Dependent Claim
24 words
The method of claim 9 , wherein K 1 is 0.5, K 2 is 1.5, K 3 is 0.5, and K 4 is 1.0.
Claim 13
Dependent Claim
27 words
The method of claim 6 , wherein the determination of the documents in the collection which receive the highest scores is carried out using compressed document surrogates.
Claim 14
Dependent Claim
38 words
The method of claim 6 , wherein the determination of the documents in the collection which receive the highest scores is carried out by a server which is distinct from the server which receives the signal of interest.
Claim 15
Independent Claim
270 words
A device for finding documents which relate to a portion of a temporal document, comprising: (a) means for identifying a portion of the temporal document for which related documents are to be found, in response to a signal of interest at a particular time during the temporal document; (b) means for selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) means for weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) means for finding the related documents by use of information retrieval techniques as applied to the text selected; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; wherein W ( t ) = W t 1 , t 2 ( t ) = ∫ k = 0 t ( 1 - exp ( - t 1 ) ) * exp ( - t 1 k ) * ( 1 - exp ( - t 2 ) ) * exp ( - t 2 ( t - k ) ) , where t 1 and t 2 are constants.
Claim 16
Independent Claim
270 words
A device for finding documents which relate to a portion of a temporal document, comprising: (a) means for identifying a portion of the temporal document for which related documents are to be found, in response to a signal of interest at a particular time during the temporal document; (b) means for selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) means for weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) means for finding the related documents by use of information retrieval techniques as applied to the text selected; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; wherein W ( t ) = W t 1 , t 2 ( t ) = ∫ k = 0 t ( 1 - exp ( - t 1 ) ) * exp ( - t 1 k ) * ( 1 - exp ( - t 2 ) ) * exp ( - t 2 ( t - k ) ) , where t 1 and t 2 are constants.
Claim 17
Dependent Claim
14 words
The device of claim 13 , wherein t 1 =0.0001 and t 2 =0.00025.
Claim 18
Dependent Claim
34 words
The device of claim 14 , wherein W(t)=W t1, t2 (t) for times from 30 seconds before the signal of interest is given until the signal is given, and W(t)=0 for all other times.
Claim 19
Dependent Claim
15 words
The device of claim 13 , wherein the related documents are accessed through the Internet.
Claim 20
Dependent Claim
35 words
The device of claim 16 , further including means for selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection.
Claim 21
Dependent Claim
88 words
The device of claim 17 , wherein th e related documents are selected from the collection according to the scores achieved when evaluating the documents in the collection according to a formula giving scores to documents depending upon the occurrence in the documents of terms which occur in text associated with the portion of the temporal document identified, where each term is weighted by a function W(t) according to the time t at which the term occurs relative to the time at which the signal of interest occurs.
Claim 22
Dependent Claim
58 words
The device of claim 18 , wherein the terms which occur in the text which is associated with the portion of the temporal document identified, and the times at which the terms occur, are determined by reference to the buffer which contains the terms and the times in the video or audio material at which the terms occur.
Claim 23
Dependent Claim
15 words
The device of claim 18 , where a predetermined number of documents, 1000, is selected.
Claim 24
Independent Claim
475 words
A device for finding documents which relate to a portion of a temporal document, comprising: (a) means for identifying a portion of the temporal document for which related documents are to be found, in response to a signal of interest at a particular time during the temporal document; (b) means for selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) means for weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) means for finding the related documents by use of information retrieval techniques as applied to the text selected; (e) means for selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; wherein the related documents are selected from the collection according to the scores achieved when evaluating documents in the collection according to a formula giving scores to documents depending upon the occurrence in the documents of terms which occur in text associated with the portion of the temporal document identified, where each term is weighted by a function W(t) according to the time t at which the term occurs relative to the time at which the signal of interest occurs; and wherein a score S D of a document D in the collection may be determined by crediting the document D, for each term T in the temporal portion of the document identified which occurs in the document D, with an amount proportional to W(t), to Robertson's term frequency TFTD and to ID FT where W(t) is the weight assigned to a term which occurs at time t relative to the signal of interest, TF TD =N TD /( N TD +K 1 +K 2 *( L D /L 0 )), and N TD is the number of times the term T occurs in document D, L D is the length of document D, L 0 is the average length of a document in the collection of documents indexed, K 1 and K 2 are constants, and ID FT =log(( N+K 3 )/ N T )/log( N+K 4 ), and N is the number of documents in the collection, N T is the number of documents containing the term T in the collection, and K 3 and K 4 are constants.
Claim 25
Independent Claim
475 words
A device for finding documents which relate to a portion of a temporal document, comprising: (a) means for identifying a portion of the temporal document for which related documents are to be found, in response to a signal of interest at a particular time during the temporal document; (b) means for selecting text associated with the portion of the temporal document identified, by reference to a buffer wherein is stored each term in text associated with the temporal document, together with a time in the temporal document at which the term occurs; (c) means for weighting each term in the text selected by a function W(t) according to the time t at which the text occurs relative to the time at which the signal of interest occurs; (d) means for finding the related documents by use of information retrieval techniques as applied to the text selected; (e) means for selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection; wherein each term in the text associated with the temporal document is determined as that portion of the document is accessed, and is stored in a buffer together with the time in the temporal document at which the term occurs; wherein the related documents are selected from the collection according to the scores achieved when evaluating documents in the collection according to a formula giving scores to documents depending upon the occurrence in the documents of terms which occur in text associated with the portion of the temporal document identified, where each term is weighted by a function W(t) according to the time t at which the term occurs relative to the time at which the signal of interest occurs; and wherein a score S D of a document D in the collection may be determined by crediting the document D, for each term T in the temporal portion of the document identified which occurs in the document D, with an amount proportional to W(t), to Robertson's term frequency TFTD and to ID FT where W(t) is the weight assigned to a term which occurs at time t relative to the signal of interest, TF TD =N TD /( N TD +K 1 +K 2 *( L D /L 0 )), and N TD is the number of times the term T occurs in document D, L D is the length of document D, L 0 is the average length of a document in the collection of documents indexed, K 1 and K 2 are constants, and ID FT =log(( N+K 3 )/ N T )/log( N+K 4 ), and N is the number of documents in the collection, N T is the number of documents containing the term T in the collection, and K 3 and K 4 are constants.
Claim 26
Dependent Claim
24 words
The device of claim 21 , wherein K 1 is 0.5, K 2 is 1.5, K 3 is 0.5, and K 4 is 1.0.
Claim 27
Dependent Claim
27 words
The device of claim 18 , wherein the determination of the documents in the collection which receive the highest scores is carried out using compressed document surrogates.
Claim 28
Dependent Claim
38 words
The device of claim 18 , wherein the determination of the documents in the collection which receive the highest scores is carried out by a server which is distinct from the server which receives the signal of interest.
References Cited (Backward Citations)
US5636346A
Cited
US5640193A
Cited
US5515098A
Cited
US5504675A
Cited
US5708845A
Cited
US5826267A
Cited
US5991735A
Cited
US6154737A
Cited
US6070158A
Cited
US6141001A
Cited
US5933832A
Cited
US6199076B1
Cited
US5920859A
Cited
US5941944A
Cited
US5937422A
Cited
US5933822A
Cited
US6029167A
Cited
US6070157A
Cited
US5987457A
Cited
US6145000A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-12-09 | 2006-06-10 | 2006-12-10 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-12-09 | 2010-06-10 | 2010-12-10 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-12-09 | 2014-06-10 | 2014-12-10 | $7700.00 | Window Closed / Lapsed |