Patent US7028253B1 successfully refreshed from Google Patents.
US7028253B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Agent for integrated annotation and retrieval of images
Assignee: Monument Peak Ventures LLC
•
Filing: 2000-10-10
•
Granted: 2006-04-11
•
Expires: 2020-10-10
Abstract
Abstract A method for integrated retrieval and annotation of stored images involves running a user application in which text entered by a user is continuously monitored to isolate the context expressed by the text. The context is matched with metadata associated with the stored images, thereby providing one or more matched images, and the matched images are retrieved and displayed in proximity with the text. The context is then utilized to provide suggested annotations to the user for the matched images, together with the capability of selecting certain of the suggested annotations for subsequent association with the matched images. In a further extension, the method provides the user with the capability of inserting selected ones of the matched images into the text of the application, and further provides for automatically updating the metadata for the matched images.
Inventors
- 👤 Henry Lieberman
- 👤 Elizabeth Rosenzweig
- 👤 Pushpinder Singh
- 👤 Mark D. Wood
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 14:17
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/50; G06F16/58; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99934
Claims Analysis
Total Claims: 20
Claim 1
Independent Claim
154 words
A method for utilizing images that are stored in a data base with an e-mail application in which text is input by a user into a message, said method comprising the steps of: a) providing metadata associated with the stored images; b) running an e-mail application in which text is entered by a user into a message window; c) continuously monitoring text typed by the user into the message window to isolate keywords in the text; d) matching and ranking the keywords with the metadata associated with the stored images, thereby providing one or more matched images that are ranked according to the keywords; e) retrieving and displaying the matched images alongside the message window in order of their rank; and f) providing the user with the capability of moving selected ones of the matched images into the message window and utilizing the context to automatically provide new keyword annotations for the matched images.
Claim 2
Independent Claim
154 words
A method for utilizing images that are stored in a data base with an e-mail application in which text is input by a user into a message, said method comprising the steps of: a) providing metadata associated with the stored images; b) running an e-mail application in which text is entered by a user into a message window; c) continuously monitoring text typed by the user into the message window to isolate keywords in the text; d) matching and ranking the keywords with the metadata associated with the stored images, thereby providing one or more matched images that are ranked according to the keywords; e) retrieving and displaying the matched images alongside the message window in order of their rank; and f) providing the user with the capability of moving selected ones of the matched images into the message window and utilizing the context to automatically provide new keyword annotations for the matched images.
Claim 3
Dependent Claim
28 words
The method as claimed in claim 1 , wherein the step of utilizing the context further includes automatically updating the metadata for the matched image with the annotations.
Claim 4
Dependent Claim
23 words
The method as claimed in claim 1 , wherein the ranking is based on the number of matched keywords for each matched image.
Claim 5
Dependent Claim
36 words
The method as claimed in claim 1 , wherein the keywords and metadata include temporal references and the ranking is based on the temporal distance between the keyword and the metadata associated with each matched image.
Claim 6
Dependent Claim
45 words
The method as claimed in claim 1 , further comprising the step of utilizing the context to either automatically or manually select new keyword annotations for the matched images, wherein the ranking is based on a higher confidence level for the manually selected keyword annotations.
Claim 7
Dependent Claim
40 words
The method as claimed in claim 1 , wherein the keywords and metadata include spatial or geographic references and the ranking is based on the spatial or geographic correspondence between the keyword and the metadata associated with each matched image.
Claim 8
Independent Claim
175 words
A method for utilizing images that are stored in a data base with an e-mail application in which text is input by a user into a message, said method comprising the steps of: a) providing metadata associated with the stored images; b) running an e-mail application in which text is entered by a user into a message window; c) continuously monitoring text typed by the user into the message window to isolate keywords in the text; d) matching and ranking the keywords with the metadata associated with the stored images thereby providing one or more matched images that are ranked according to the keywords; e) retrieving and displaying the matched images alongside the message window in order of their rank; and f) providing the user with the capability of moving selected ones of the matched images into the message window and utilizing the context to provide new keyword annotations for the matched images, together with the capability of manually selecting certain of the annotations for subsequent association with the matched images in the data base.
Claim 9
Independent Claim
175 words
A method for utilizing images that are stored in a data base with an e-mail application in which text is input by a user into a message, said method comprising the steps of: a) providing metadata associated with the stored images; b) running an e-mail application in which text is entered by a user into a message window; c) continuously monitoring text typed by the user into the message window to isolate keywords in the text; d) matching and ranking the keywords with the metadata associated with the stored images thereby providing one or more matched images that are ranked according to the keywords; e) retrieving and displaying the matched images alongside the message window in order of their rank; and f) providing the user with the capability of moving selected ones of the matched images into the message window and utilizing the context to provide new keyword annotations for the matched images, together with the capability of manually selecting certain of the annotations for subsequent association with the matched images in the data base.
Claim 10
Dependent Claim
28 words
The method as claimed in claim 7 , wherein the step of utilizing the context further includes automatically updating the metadata for the matched image with the annotations.
Claim 11
Dependent Claim
154 words
A computer implemented autonomous agent stored on a computer readable medium and including programming instructions for use in interfacing a text-based application with a picture archive containing representations of images and metadata associated with the images said agent comprising: a language analyzer for continuously monitoring text entered by the user into the application and extracting keywords appropriate to the context surrounding the entered text; a retrieval agent for retrieving images from the archive on the basis of one or more matches between the extracted keywords and the metadata; an annotation agent for providing suggested annotations to the user for the matched images based on the extracted keywords, together with the capability of selecting certain of the suggested annotations for subsequent association with the matched images; and a picture database viewer for displaying the retrieved images to the user and for enabling the images to be incorporated into the application, as desired by the user.
Claim 12
Dependent Claim
154 words
A computer implemented autonomous agent stored on a computer readable medium and including programming instructions for use in interfacing a text-based application with a picture archive containing representations of images and metadata associated with the images said agent comprising: a language analyzer for continuously monitoring text entered by the user into the application and extracting keywords appropriate to the context surrounding the entered text; a retrieval agent for retrieving images from the archive on the basis of one or more matches between the extracted keywords and the metadata; an annotation agent for providing suggested annotations to the user for the matched images based on the extracted keywords, together with the capability of selecting certain of the suggested annotations for subsequent association with the matched images; and a picture database viewer for displaying the retrieved images to the user and for enabling the images to be incorporated into the application, as desired by the user.
Claim 13
Dependent Claim
45 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 9 , wherein the retrieval agent ranks the retrieved images based on attributes of the keywords, and the picture database viewer displays the retrieved images in order of their ranking.
Claim 14
Dependent Claim
24 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 9 , wherein the application is an e-mail application.
Claim 15
Dependent Claim
35 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 9 , wherein the picture database viewer incorporates a retrieved image into the application by a drag and drop operation.
Claim 16
Dependent Claim
37 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 9 , wherein the picture database viewer incorporates a retrieved image into the application by a one click selection of the image.
Claim 17
Dependent Claim
43 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 9 , further comprising a manual annotation agent for adding annotations to the retrieved image and for storing the added annotations to the metadata stored in the archive.
Claim 18
Dependent Claim
48 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 9 , wherein the retrieval agent retrieves images from the archive on the basis of matching between the extracted keywords and temporal metadata identifying the time and date when the images were captured.
Claim 19
Dependent Claim
37 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 9 , further comprising an automatic import agent for automatically entering images into the archive from one or more specified image sources.
Claim 20
Dependent Claim
36 words
The computer implemented autonomous agent stored on a computer readable medium as claimed in claim 16 , wherein the retrieval agent automatically retrieves the entered images and the picture database viewer automatically displays the entered images.
References Cited (Backward Citations)
US5742808A
Cited
US5404295A
Cited
JPH06119405A
Cited
US5546502A
Cited
US5539665A
Cited
US5493677A
Cited
US6108674A
Cited
JPH08314953A
Cited
US5870770A
Cited
US5873107A
Cited
US6374260B1
Cited
US6026396A
Cited
JPH10301953A
Cited
US6686970B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-04-10 | 2009-10-10 | 2010-04-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-04-10 | 2013-10-10 | 2014-04-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-04-10 | 2017-10-10 | 2018-04-11 | $7700.00 | Window Closed / Lapsed |