Patent FR533899A successfully refreshed from Google Patents.
Patent US5850469A successfully refreshed from Google Patents.
US5850469A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Real time tracking of camera pose
Assignee: General Electric Co
•
Filing: 1996-11-04
•
Granted: 1998-12-15
•
Expires: 2016-11-04
Abstract
Abstract The present invention is a system for real time tracking of position and orientation, termed "pose", of a remote camera. While remote cameras have been used on a regular basis to inspect machinery for wear or damage, knowing the exact location of a camera is difficult. Off-line feature extraction is employed with on-line pose determination. The feature extraction precomputes features from a CAD model of the object visible in a selected set of views. The on-line pose determination starts from an initial pose estimate, determines the visible model features, projects them into a two-dimensional image coordinate system, matches each to the current camera image, and uses the differences between the predicted and matched feature positions in a gradient descent technique to iteratively refine the pose estimate. The on-line portion of the system is designed to execute at video frame rates, providing a continual indication of borescope tip pose.
Inventors
- 👤 Kenneth Morris Martin
- 👤 Nelson Raymond Corby, Jr.
- 👤 Thomas Dean VerSchure
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 02:46
CPC Classifications
G; G01; G01S; G01S5/00; G01S5/16; G01S5/163; G06; G06T; G06T7/00; G06T7/70; G06T7/73; G06T7/74; G06T2207/00; G06T2207/30; G06T2207/30244
Claims Analysis
Total Claims: 7
Claim 1
Independent Claim
186 words
A system for determining a camera aperture position and orientation ("pose") within a subject comprising: a) a model memory having a prestored computer model of 3D structures of said subject; b) a sample point generator functioning to read the computer model, and create a plurality of sample points throughout the model; c) an image generator coupled to the sample point generator, which creates images of the 3D model structures as viewed from the sample point for a plurality of orientation angles, and for the plurality of sample points; d) a feature memory capable of storing information provided to it; e) a feature identifier for receiving images from the image generator, and identifying intensity gradients and their corresponding locations in the images, identifying which gradients are contiguous, and storing a plurality of the largest gradients, and their corresponding locations as features in the feature memory; f) an on-line pose determination subsystem, coupled to the feature memory, for acquiring live image frame of said subject, receiving selected features from the feature memory, and comparing the features to the live image frame to determine said adjusted camera aperture pose.
Claim 2
Independent Claim
186 words
A system for determining a camera aperture position and orientation ("pose") within a subject comprising: a) a model memory having a prestored computer model of 3D structures of said subject; b) a sample point generator functioning to read the computer model, and create a plurality of sample points throughout the model; c) an image generator coupled to the sample point generator, which creates images of the 3D model structures as viewed from the sample point for a plurality of orientation angles, and for the plurality of sample points; d) a feature memory capable of storing information provided to it; e) a feature identifier for receiving images from the image generator, and identifying intensity gradients and their corresponding locations in the images, identifying which gradients are contiguous, and storing a plurality of the largest gradients, and their corresponding locations as features in the feature memory; f) an on-line pose determination subsystem, coupled to the feature memory, for acquiring live image frame of said subject, receiving selected features from the feature memory, and comparing the features to the live image frame to determine said adjusted camera aperture pose.
Claim 3
Dependent Claim
36 words
The system for determining a camera aperture position and orientation of claim 1 further comprising a model generator for creating a computer model of said subject, and for storing this model in the computer model memory.
Claim 4
Dependent Claim
33 words
The system for determining a camera aperture position and orientation of claim 1 further comprising a feature optimizer for removing from feature memory, similar, redundant, features being less than a predetermined distance apart.
Claim 5
Dependent Claim
201 words
The system for determining a camera aperture position and orientation of claim 1 wherein the on-line pose determination subsystem comprising: a) an operator-positionable camera having an aperture, for acquiring live images as viewed from its aperture; b) a feature selector, for receiving manual input for the initial position and orientation ("pose") of the camera aperture, and for receiving subsequent automated pose estimates, functioning to select features within a predetermined view frustum of the camera at its current estimated pose; c) projection device coupled to the feature selector for receiving the selected features and for projecting them into a projected 2D image as viewed from the current estimated pose; d) a frame capturer coupled to the camera, for selecting a single digital image frame at a time from the camera; e) an estimate adjuster coupled to the projection device and the frame capturer for iteratively correlating the projected 2D image with the digital frame, moving the projected 2D image relative to the digital frame to determine an error offset vector, and updating the current pose estimate with the error offset vector to produce a new current pose estimate which is provided to the feature selector and the projection device for further processing.
Claim 6
Dependent Claim
58 words
The system for determining a camera aperture position and orientation of claim 1 further comprising a display device coupled to the model memory, the camera and the estimate adjuster, for receiving the initial and current pose estimates, providing a computer graphic display of the computer model as viewed from the pose estimates, and displaying the camera live video.
Claim 7
Dependent Claim
41 words
The system for determining a camera aperture position and orientation of claim 1 further comprising a manual control panel capable of accepting manual input from an operator and providing it to the feature selector, the projection device and the display device.
References Cited (Backward Citations)
EP0005918B1
Cited
GB2116000A
Cited
GB2237951A
Cited
US5432712A
Cited
US5259037A
Cited
US5566246A
Cited
US5606627A
Cited
US5699444A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-12-14 | 2002-06-15 | 2002-12-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-12-14 | 2006-06-15 | 2006-12-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-12-14 | 2010-06-15 | 2010-12-15 | $7700.00 | Window Closed / Lapsed |