US5684531A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Ranging apparatus and method implementing stereo vision system
Assignee: National Aeronautics and Space Administration
•
Filing: 1995-04-10
•
Granted: 1997-11-04
•
Expires: 2015-04-10
Abstract
Abstract A laser-directed ranging system for use in telerobotics applications and other applications involving physically handicapped individuals. The ranging system includes a left and right video camera mounted on a camera platform, and a remotely positioned operator. The position of the camera platform is controlled by three servo motors to orient the roll axis, pitch axis and yaw axis of the video cameras, based upon an operator input such as head motion. A laser is provided between the left and right video camera and is directed by the user to point to a target device. The images produced by the left and right video cameras are processed to eliminate all background images except for the spot created by the laser. This processing is performed by creating a digital image of the target prior to illumination by the laser, and then eliminating common pixels from the subsequent digital image which includes the laser spot. The horizontal disparity between the two processed images is calculated for use in a stereometric ranging analysis from which range is determined.
Inventors
- 👤 Larry C. Li
- 👤 Brian J. Cox
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 03:29
CPC Classifications
G; G01; G01C; G01C3/00; G01C3/02; G01C3/06; G01C3/08; G01C3/085; G01C11/00; G01C11/04; G01C11/06; G01S; G01S17/00; G01S17/02; G01S17/06; G01S17/08; G01S17/86; G01S17/88; G06; G06T; G06T7/00; G06T7/50; G06T7/521; G06T7/55; G06T7/593; H; H04; H04N; H04N7/00; H04N7/18; G01S17/89; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/10021; H04N13/00; H04N13/20; H04N13/204; H04N13/239; H04N13/254; H04N13/296; H04N2013/0074; H04N2013/0081
Claims Analysis
Total Claims: 42
Claim 1
Independent Claim
178 words
A ranging system for telerobotics applications, comprising: a first video camera; a second video camera spaced from said first video camera, said first and said second video cameras being located in a common plane; a directional light source positioned relative to said first and said second video cameras for illuminating a portion of a selected target during selected periods; capture means, associated with said video cameras, for capturing a first set of stereoscopic images of the target while said directional light source is illuminating a portion of the target, and for capturing a second set of stereoscopic images of the target while said directional light source is not illuminating a portion of the target, and means for generating a third set of stereoscopic images of the target eliminating common elements of the first and second set of images; a robotic device; and a processor electrically associated with said capture means and said robotics device, said processor including a ranging algorithm for determining the range to said target based upon remaining elements in the third set of stereoscopic images.
Claim 2
Dependent Claim
178 words
A ranging system for telerobotics applications, comprising: a first video camera; a second video camera spaced from said first video camera, said first and said second video cameras being located in a common plane; a directional light source positioned relative to said first and said second video cameras for illuminating a portion of a selected target during selected periods; capture means, associated with said video cameras, for capturing a first set of stereoscopic images of the target while said directional light source is illuminating a portion of the target, and for capturing a second set of stereoscopic images of the target while said directional light source is not illuminating a portion of the target, and means for generating a third set of stereoscopic images of the target eliminating common elements of the first and second set of images; a robotic device; and a processor electrically associated with said capture means and said robotics device, said processor including a ranging algorithm for determining the range to said target based upon remaining elements in the third set of stereoscopic images.
Claim 3
Dependent Claim
16 words
A system as in claim 1, wherein said video cameras are mounted on a camera platform.
Claim 4
Dependent Claim
46 words
A system as in claim 2, wherein said camera platform is electrically coupled to said processor, further comprising a position and orientation sensor coupled to said processor, and wherein said processor positions said camera platform based upon electrical signals generated by said position and orientation sensor.
Claim 5
Dependent Claim
25 words
A system as in claim 3, wherein said position and orientation sensor comprises means for generating signals indicative of the movement of an operator's head.
Claim 6
Dependent Claim
16 words
A system as in claim 4, wherein the operator is positioned remotely from said video cameras.
Claim 7
Dependent Claim
21 words
A system as in claim 1, wherein said directional light source is activated by an operator remote from said light source.
Claim 8
Dependent Claim
17 words
A system as in claim 1, wherein said light source is activated by a physically handicapped person.
Claim 9
Dependent Claim
17 words
A system as in claim 1, wherein said directional light source illuminates a spot on said target.
Claim 10
Dependent Claim
134 words
A system as in claim 8, wherein said means for capturing a first set of stereoscopic images of the target while said directional light source is illuminating a portion of a selected target, and for capturing a second set of stereoscopic images of the target while said directional light source is not illuminating a portion of the selected target include first and second frame grabbers associated with said first and second video cameras, respectively, and wherein said first frame grabber generates a first image of said target with said spot, and said second frame grabber generates a second image of said target with said spot, and said processor determines the disparity in said plane between the position of the spot in said first image and the position of the spot in said second image.
Claim 11
Dependent Claim
53 words
A system as in claim 1, wherein said first frame grabber is electrically coupled to said first video camera, and said second frame grabber is electrically coupled to said second video camera, and wherein the output signals from said first and said second frame grabbers are provided as input signals to said processor.
Claim 12
Dependent Claim
25 words
A system as in claim 5, further comprising a remote display for said operator, said display receiving images from said video cameras through said processor.
Claim 13
Dependent Claim
21 words
A system as in claim 1, wherein said directional light source is positioned in the same plane as said video cameras.
Claim 14
Dependent Claim
31 words
A system as in claim 1, wherein said processor determines the disparity in said plane between the illuminated image of said first camera and the illuminated image of said second camera.
Claim 15
Dependent Claim
24 words
A system as in claim 1, wherein said video cameras lie in a horizontal plane with respect to each other, for determining horizontal disparity.
Claim 16
Dependent Claim
13 words
A system as in claim 1, wherein said light source comprises a laser.
Claim 17
Independent Claim
104 words
An apparatus for determining range to a target, comprising: a directional light source operable to selectively illuminate a portion of a target to selectively create an illuminated spot on said target; a first video camera for capturing a first digital image of said spot; a second video camera for capturing a second digital image of said spot; and a computer operably associated with said first video camera and said second video camera for determining the range to said target by comparing said first and said digital images to determine disparity, wherein the range is determined from a look-up table for the determined disparity value.
Claim 18
Independent Claim
104 words
An apparatus for determining range to a target, comprising: a directional light source operable to selectively illuminate a portion of a target to selectively create an illuminated spot on said target; a first video camera for capturing a first digital image of said spot; a second video camera for capturing a second digital image of said spot; and a computer operably associated with said first video camera and said second video camera for determining the range to said target by comparing said first and said digital images to determine disparity, wherein the range is determined from a look-up table for the determined disparity value.
Claim 19
Dependent Claim
39 words
An apparatus as in claim 16, wherein said computer obtains the stereoscopic digital images of said spot by eliminating common pixels between an image of said target without said spot and an image of said target with said spot.
Claim 20
Dependent Claim
24 words
An apparatus as in claim 17, wherein said directional light source is a laser and wherein said computer turns off and on said laser.
Claim 21
Dependent Claim
19 words
An apparatus as in claim 18, further comprising a means for directing the directional light source on said target.
Claim 22
Dependent Claim
27 words
An apparatus as in claim 19, wherein said video cameras are mounted on a platform, and said platform is positioned by an operator to obtain said images.
Claim 23
Dependent Claim
20 words
An apparatus as in claim 20, comprising means for positioning the platform in response to head movement of the operator.
Claim 24
Dependent Claim
17 words
An apparatus as in claim 21, further including an operator display receiving images from said video cameras.
Claim 25
Dependent Claim
22 words
An apparatus as in claim 22, including a head mounted unit, and wherein said operator display is provided in said head-mounted unit.
Claim 26
Dependent Claim
37 words
An apparatus as in claim 23, further comprising a robotics device connected to said computer, wherein said operator activates said robotics device and said computer provides an electrical signal indicative of target location to said robotics device.
Claim 27
Dependent Claim
19 words
An apparatus as in claim 24, wherein said robotics device is activated by a voice command from the operator.
Claim 28
Dependent Claim
32 words
An apparatus as in claim 25, further comprising a voice recognition system connected to said computer, said voice recognition system comprising means for converting said voice command to an electrical output signal.
Claim 29
Independent Claim
100 words
A method for determining range to a target, comprising the steps of: (a) capturing a first set of stereoscopic images of a target; (b) activating a directional light source for illuminating a portion of said target; (c) capturing a second set of stereoscopic images of the target while the light source is directed onto the portion of said target; (d) generating a third set of stereoscopic images of the target by eliminating common elements of the first and second set of images; and (e) determining range to the target based upon remaining elements in the third set of stereoscopic images.
Claim 30
Independent Claim
100 words
A method for determining range to a target, comprising the steps of: (a) capturing a first set of stereoscopic images of a target; (b) activating a directional light source for illuminating a portion of said target; (c) capturing a second set of stereoscopic images of the target while the light source is directed onto the portion of said target; (d) generating a third set of stereoscopic images of the target by eliminating common elements of the first and second set of images; and (e) determining range to the target based upon remaining elements in the third set of stereoscopic images.
Claim 31
Dependent Claim
29 words
A method as in claim 27, wherein the range to the target is determined by calculating the disparity between the remaining elements of the third set of stereoscopic images.
Claim 32
Dependent Claim
20 words
A method as in claim 27, wherein said stereoscopic images includes a left video image and a right video image.
Claim 33
Dependent Claim
12 words
A method as in claim 29, wherein said video images are digitized.
Claim 34
Independent Claim
136 words
A method for remotely controlling a robotics device to manipulate a target device, comprising the steps of: (a) remotely viewing the target device; (b) capturing a left and a right video image of said target device; (c) activating a light source to generate a spot on said target device; (d) capturing a left and a right video image of said target device with said spot thereon; (e) eliminating common pixels between said video images captured in step (b) and said video images captured in step (d) to obtain a left and right image of said spot; (f) determining disparity between said left and right image obtained in step (e); (g) calculating range to said target device based upon said disparity determination; (h) positioning said robotics device to contact said target device based upon said range calculation.
Claim 35
Independent Claim
136 words
A method for remotely controlling a robotics device to manipulate a target device, comprising the steps of: (a) remotely viewing the target device; (b) capturing a left and a right video image of said target device; (c) activating a light source to generate a spot on said target device; (d) capturing a left and a right video image of said target device with said spot thereon; (e) eliminating common pixels between said video images captured in step (b) and said video images captured in step (d) to obtain a left and right image of said spot; (f) determining disparity between said left and right image obtained in step (e); (g) calculating range to said target device based upon said disparity determination; (h) positioning said robotics device to contact said target device based upon said range calculation.
Claim 36
Dependent Claim
28 words
A method as in claim 31, wherein the step of remotely viewing the target device includes positioning a left and right video camera to view the target device.
Claim 37
Dependent Claim
24 words
A method as in claim 32, wherein the positioning of said left and right cameras is performed by moving the head of an operator.
Claim 38
Dependent Claim
20 words
A method as in claim 31, wherein the video images are captured by a left and right frame grabber circuit.
Claim 39
Dependent Claim
19 words
A method as in claim 31, wherein said laser is positioned by an operator and activated by said operator.
Claim 40
Dependent Claim
23 words
A method as in claim 31, wherein said laser is activated by a computer after said target device is selected by an operator.
Claim 41
Independent Claim
176 words
An apparatus for determining range to a target, comprising: a directional light source for illuminating a portion of a selected target during selected periods; means including first and second video cameras for capturing a first set of stereoscopic images of the target while said directional light source is illuminating a portion of a selected target, and for capturing a second set of stereoscopic images of the target while said directional light source is not illuminating a portion of the selected target, and for generating a third set of stereoscopic images, of the illuminated portion of the target, by eliminating common elements of the first and second set of images; a computer operably associated with said first and second video cameras and said robotics device for determining the range to said target by comparing the positions of the illuminated portion of the target within said third set of images, based upon elements remaining in the third set of stereoscopic images and with common elements in said first and second sets of stereoscopic images eliminated, to determine disparity.
Claim 42
Independent Claim
176 words
An apparatus for determining range to a target, comprising: a directional light source for illuminating a portion of a selected target during selected periods; means including first and second video cameras for capturing a first set of stereoscopic images of the target while said directional light source is illuminating a portion of a selected target, and for capturing a second set of stereoscopic images of the target while said directional light source is not illuminating a portion of the selected target, and for generating a third set of stereoscopic images, of the illuminated portion of the target, by eliminating common elements of the first and second set of images; a computer operably associated with said first and second video cameras and said robotics device for determining the range to said target by comparing the positions of the illuminated portion of the target within said third set of images, based upon elements remaining in the third set of stereoscopic images and with common elements in said first and second sets of stereoscopic images eliminated, to determine disparity.
References Cited (Backward Citations)
US5510625A
Cited
US5040116A
Cited
US5109425A
Cited
US4979815A
Cited
US4969735A
Cited
US5175616A
Cited
US5109345A
Cited
US5130794A
Cited
US5168141A
Cited
US5216476A
Cited
US5420828A
Cited
US5320538A
Cited
US5331413A
Cited
US5526022A
Cited
US5495576A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-11-03 | 2001-05-05 | 2001-11-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-11-03 | 2005-05-05 | 2005-11-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-11-03 | 2009-05-05 | 2009-11-04 | $7700.00 | Window Closed / Lapsed |