US7616816B2
Active / In Force
US
⏱️ 0.4 years remaining
System and method for mission-driven visual information retrieval and organization
Assignee: SRI International Inc
•
Filing: 2007-03-20
•
Granted: 2009-11-10
•
Expires: 2027-03-20
Abstract
Abstract The present invention provides a virtual data collection system and method that provides an image analyst with full-control of the image, including the ability to retrieve and reorganize information from an existing video database of images. The system provides for the search and retrieval of information from previously collected images, and reorganize them to meet new or revised mission objectives. The system also enables quick access of the “right” information through virtual data collection from the existing video database.
Inventors
- 👤 Hui Cheng
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:22
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/70; G06F16/73; G06F16/732; G06F16/7335; G06F16/20; G06F16/29; G06F16/74; G06F16/743; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
107 words
A method for interactive searching and retrieval, of at least one video image stored in a database having a collection of video images, the method comprising: providing to a user a reference image to define an area of interest and a spatial context of the reference image; defining at least one parameter applicable to geo-spatial location of the image of interest; generating at least one query based on said parameter; searching the database in accordance with the query to retrieve video frames of the image of interest; ranking and organizing the retrieved video frames; and refining the query based on the ranked and the organized video frames.
Claim 2
Independent Claim
107 words
A method for interactive searching and retrieval, of at least one video image stored in a database having a collection of video images, the method comprising: providing to a user a reference image to define an area of interest and a spatial context of the reference image; defining at least one parameter applicable to geo-spatial location of the image of interest; generating at least one query based on said parameter; searching the database in accordance with the query to retrieve video frames of the image of interest; ranking and organizing the retrieved video frames; and refining the query based on the ranked and the organized video frames.
Claim 3
Dependent Claim
14 words
The method of claim 1 wherein said video image is an aerial video image.
Claim 4
Dependent Claim
19 words
The method of claim 1 further comprising classifying the retrieved video frames to create clusters of similar video frames.
Claim 5
Dependent Claim
27 words
The method of claim 1 further comprising providing a plurality of parameters to the user and generating a query based on the parameter selected by the user.
Claim 6
Dependent Claim
27 words
The method of claim 4 wherein said parameters comprise area of interest, spatial context, color, texture, edge, object, semantic meanings of objects, sensor controls and combinations thereof.
Claim 7
Dependent Claim
24 words
The method of claim 5 wherein said sensor controls comprise field-of-view, sensor angle, sensor heading, ground sampling distance, sensor ground speed and combinations thereof.
Claim 8
Dependent Claim
18 words
The method of claim 1 further comprising providing a histogram of said parameters for the retrieved video clips.
Claim 9
Dependent Claim
25 words
The method of claim 1 further comprising providing a virtual image sensor to the user to control the retrieved video frame displayed to the user.
Claim 10
Dependent Claim
27 words
The method of claim 8 wherein said ranking and organizing the retrieved video frame is based on how the virtual image sensor is controlled by the user.
Claim 11
Dependent Claim
29 words
The method of claim 8 wherein said ranking and organizing the retrieved video frame is based on history of controls of the virtual image sensor utilized by the user.
Claim 12
Dependent Claim
23 words
The method of claim 1 wherein said ranking and organizing the retrieved video frame is based on content of said retrieved video image.
Claim 13
Dependent Claim
21 words
The method of claim 1 wherein said ranking and organizing the retrieved video frame is based on metadata of the image.
Claim 14
Dependent Claim
21 words
The method of claim 1 wherein said ranking and organizing the retrieved video clip is based on history of the queries.
Claim 15
Independent Claim
138 words
A system for searching and retrieval of at least one video image stored in a database having a collection of video images, the system comprising: an interactive search and retrieval (IS&R) module for defining parameters applicable to geo-spatial location of the image of interest; wherein said IS&R module comprise a map/mosaic based browsing component for providing to a user a reference image to define an area of interest and a spatial context of the reference image a query generation (QG) module for generating at least one query based on said parameters; a processor for searching the database in accordance with the query to retrieve video frames of the image of interest; and an adaptive ranking (AR) module for ranking and organizing the retrieved video frames and refining the query based on the ranked and the organized video frames.
Claim 16
Independent Claim
138 words
A system for searching and retrieval of at least one video image stored in a database having a collection of video images, the system comprising: an interactive search and retrieval (IS&R) module for defining parameters applicable to geo-spatial location of the image of interest; wherein said IS&R module comprise a map/mosaic based browsing component for providing to a user a reference image to define an area of interest and a spatial context of the reference image a query generation (QG) module for generating at least one query based on said parameters; a processor for searching the database in accordance with the query to retrieve video frames of the image of interest; and an adaptive ranking (AR) module for ranking and organizing the retrieved video frames and refining the query based on the ranked and the organized video frames.
Claim 17
Dependent Claim
14 words
The system of claim 14 wherein said video image is an aerial video image.
Claim 18
Dependent Claim
33 words
The system of claim 15 wherein said IS&R module comprise a video frame based browsing component for providing to the user a cluster of similar video frames to locate the image of interest.
Claim 19
Dependent Claim
41 words
The system of claim 15 further comprising virtual image sensor having controls that function to edit the view of the video frame initially selected by the user based one of the map/mosaic based browsing component or video frame based browsing component.
Claim 20
Dependent Claim
31 words
the system of claim 17 further comprising a visualization module to display information regarding the video frame, said information comprise a histogram of video frames of said controls of the sensor.
Claim 21
Dependent Claim
53 words
The system of claim 14 wherein said retrieved video frame is organized based on one or more of factors comprising content of said retrieved video image, metadata of the image, how the virtual image sensor is controlled by the user, history of the controls of the virtual image sensor, history of the queries.
Claim 22
Dependent Claim
13 words
The system of claim 14 wherein said reference image is a map image.
Claim 23
Dependent Claim
13 words
The system of claim 14 wherein said reference image is a mosaic image.
References Cited (Backward Citations)
US5652717A
Cited
US5802361A
Cited
US5991460A
Cited
US6112172A
Cited
US6774917B1
Cited
US20040004737A1
Cited
US20040004663A1
Cited
US20040126038A1
Cited
US20060122776A1
Cited
US20070115373A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2012-11-09 | 2013-05-11 | 2013-11-10 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2016-11-09 | 2017-05-11 | 2017-11-10 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2020-11-09 | 2021-05-11 | 2021-11-10 | $7700.00 | Window Closed / Lapsed |