US5051906A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Mobile robot navigation employing retroreflective ceiling features
Assignee: Transitions Research Corp
•
Filing: 1989-06-07
•
Granted: 1991-09-24
•
Expires: 2009-06-07
Abstract
Abstract Apparatus and method which provides for the determination of a vehicle's orientation and position in an environment, such as a hallway, from an image of a retroreflective ceiling feature. A mobile robot 10 includes a light source 28 and a camera 12 that are pitched up obliquely at an intermediate angle between a horizon and a zenith. The camera views a ceiling having one or more strip-like retroreflective features 16 which are preferably aligned with an axis of the hallway. In that the feature presents a pattern or alignment which is substantially parallel to a long axis of the hallway the pattern is detected and processed to derive robot navigation information therefrom.
Inventors
- 👤 John M. Evans, Jr.
- 👤 Steven J. King
- 👤 Carl F. R. Weiman
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-03 17:16
CPC Classifications
G; G01; G01S; G01S5/00; G01S5/16; G05; G05D; G05D1/00; G05D1/02; G05D1/021; G05D1/0231; G05D1/0244; G05D1/0246; G05D1/0268; G05D1/0272; G05D1/0255
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
175 words
Navigation apparatus for generating navigation related information for a vehicle, comprising: means for obtaining an image of a surface which overlies a vehicle or a projected path of the vehicle, the surface having one or more retroreflective features disposed thereon; means for illuminating the retroreflective features; means, coupled to said obtaining means, for detecting a location within the image of the one or more retroreflective features; and means, coupled to said detecting means, for generating, from the detected feature location or locations, at least vehicle position and orientation information, wherein said image obtaining means comprises means for forming a two-dimensional image comprised of a plurality of image pixels, wherein said detecting means comprises means, coupled to said two-dimensional image forming means, for identifying pixels which correspond to two opposing edges of the retroreflective feature, and wherein said generating means comprises means, coupled to said pixel identifying means, for projecting a line from the pixels that correspond to each of the opposing edges of the feature, an intersection of the projected lines defining a vanishing point.
Claim 2
Dependent Claim
175 words
Navigation apparatus for generating navigation related information for a vehicle, comprising: means for obtaining an image of a surface which overlies a vehicle or a projected path of the vehicle, the surface having one or more retroreflective features disposed thereon; means for illuminating the retroreflective features; means, coupled to said obtaining means, for detecting a location within the image of the one or more retroreflective features; and means, coupled to said detecting means, for generating, from the detected feature location or locations, at least vehicle position and orientation information, wherein said image obtaining means comprises means for forming a two-dimensional image comprised of a plurality of image pixels, wherein said detecting means comprises means, coupled to said two-dimensional image forming means, for identifying pixels which correspond to two opposing edges of the retroreflective feature, and wherein said generating means comprises means, coupled to said pixel identifying means, for projecting a line from the pixels that correspond to each of the opposing edges of the feature, an intersection of the projected lines defining a vanishing point.
Claim 3
Dependent Claim
36 words
Navigation apparatus as set forth in claim 1 wherein said generating means comprises: means for determining an offset distance and an angular displacement of the vehicle relative to the location of the feature within the image.
Claim 4
Dependent Claim
24 words
Navigation apparatus as set forth in claim 1 wherein said generating means comprises means for determining a distance from the vehicle to the surface.
Claim 5
Dependent Claim
21 words
Navigation apparatus as set forth in claim 1 wherein said two-dimensional image forming means is comprised of a CCD camera means.
Claim 6
Dependent Claim
21 words
Navigation apparatus as set forth in claim 1 wherein said two-dimensional image forming means is comprised of a vidicon camera means.
Claim 7
Dependent Claim
37 words
Navigation apparatus as set forth in claim 1 wherein said generating means further comprises: means for determining an offset distance and an angular displacement of the vehicle relative at least to the line projected from the pixels.
Claim 8
Dependent Claim
22 words
Navigation apparatus as set forth in claim 1 wherein said means for illuminating is comprised of a pulsed source of IR illumination.
Claim 9
Dependent Claim
20 words
Navigation apparatus as set forth in claim 1 wherein said identifying means includes means for executing a binary subdivision search.
Claim 10
Dependent Claim
26 words
Navigation apparatus as set forth in claim 1 wherein said generating means includes means for determining a location within the two-dimensional image of an epipolar line.
Claim 11
Dependent Claim
143 words
Navigation apparatus for generating navigation related information for a mobile robot, comprising: means for imaging at least a portion of a ceiling disposed over a forward path of a mobile robot, said imaging means including means for forming a two-dimensional image represented as a two-dimensional array having rows and columns of image pixels; means for searching the two-dimensional array of image pixels to identify two-dimensional array coordinates of image pixels, located in a plurality of rows of the two dimensional array, that correspond to oppositely disposed boundaries of at least one substantially linear retroreflective ceiling feature; means for generating a reference axis of robot motion relative to the identified two-dimensional array coordinates of the image pixels located in the plurality of rows of the two-dimensional array; and means for determining a position of the robot relative to the reference axis of robot motion.
Claim 12
Dependent Claim
143 words
Navigation apparatus for generating navigation related information for a mobile robot, comprising: means for imaging at least a portion of a ceiling disposed over a forward path of a mobile robot, said imaging means including means for forming a two-dimensional image represented as a two-dimensional array having rows and columns of image pixels; means for searching the two-dimensional array of image pixels to identify two-dimensional array coordinates of image pixels, located in a plurality of rows of the two dimensional array, that correspond to oppositely disposed boundaries of at least one substantially linear retroreflective ceiling feature; means for generating a reference axis of robot motion relative to the identified two-dimensional array coordinates of the image pixels located in the plurality of rows of the two-dimensional array; and means for determining a position of the robot relative to the reference axis of robot motion.
Claim 13
Dependent Claim
18 words
Navigation apparatus as set forth in claim 10 wherein said imaging means is comprised of a camera means.
Claim 14
Dependent Claim
20 words
Navigation apparatus as set forth in claim 10 and further comprising an IR light source for illuminating the retroreflective feature.
Claim 15
Dependent Claim
23 words
Navigation apparatus as set forth in claim 10 and further comprising means for measuring a height of the ceiling relative to the robot.
Claim 16
Dependent Claim
32 words
Navigation apparatus as set forth in claim 10 and further comprising means, coupled to said determining means, for controlling a motion of the robot relative to the reference axis of robot motion.
Claim 17
Dependent Claim
24 words
Navigation apparatus as set forth in claim 10 wherein the generating means includes means for converting the identified two-dimensional array coordinates to tangent coordinates.
Claim 18
Dependent Claim
34 words
Navigation apparatus as set forth in claim 10 where the imaging means is aimed obliquely along a forward path of the robot at an angle greater than zero degrees and less than ninety degrees.
Claim 19
Independent Claim
127 words
A method of providing navigation related information for a mobile robot, comprising the steps of: obtaining at least one image of a ceiling having one or more distinct retroreflective linear visual features, the ceiling overlying at least a projected path of the robot; locating within the ceiling image the one or more distinct retroreflective linear visual features; detecting an edge boundary of at least one of the features; generating at least one reference line relative to the edge detected boundary; and determining a location of the robot relative to the at least one reference line, wherein the step of generating at least one reference line includes a step of projecting perspective lines along detected edge boundaries, an intersection of the projected perspective lines defining a vanishing point.
Claim 20
Independent Claim
127 words
A method of providing navigation related information for a mobile robot, comprising the steps of: obtaining at least one image of a ceiling having one or more distinct retroreflective linear visual features, the ceiling overlying at least a projected path of the robot; locating within the ceiling image the one or more distinct retroreflective linear visual features; detecting an edge boundary of at least one of the features; generating at least one reference line relative to the edge detected boundary; and determining a location of the robot relative to the at least one reference line, wherein the step of generating at least one reference line includes a step of projecting perspective lines along detected edge boundaries, an intersection of the projected perspective lines defining a vanishing point.
Claim 21
Dependent Claim
44 words
The method of claim 17 wherein the step of obtaining an image includes a step of generating a plurality of image pixels each of which has a value which is a function of at least a brightness of a corresponding portion of the ceiling.
Claim 22
Dependent Claim
38 words
The method of claim 18 wherein the steps of locating and detecting each include a step of identifying a pixel or pixels having a value which indicates a location within the image of the retroreflective linear visual feature.
Claim 23
Dependent Claim
53 words
The method of claim 18 wherein the step of detecting an edge boundary includes a step of processing image pixels by a procedure selected from the group consisting of a binary subdivision search procedure, a Hough transform procedure, an edge detection and linking procedure, a curve fitting procedure, and combinations and variations thereof.
Claim 24
Dependent Claim
27 words
The method of claim 17 wherein the step of determining a position includes a step of determining an offset distance from the robot to the reference line.
Claim 25
Dependent Claim
29 words
The method of claim 21 wherein the step of determining a position includes a further step of determining an angular orientation of the robot relative to the reference line.
Claim 26
Dependent Claim
56 words
The method of claim 17 wherein the step of determining a location of the robot relative to the reference line includes the steps of: determining a height of the ceiling overlying the projected path of the robot; and employing the determined ceiling height to determine a lateral displacement of the robot relative to the reference line.
Claim 27
Independent Claim
148 words
A method of providing navigation information for a vehicle, comprising the steps of: imaging a surface which is disposed above at least a projected forward path of the vehicle, the surface having a height zO above the vehicle, the surface including one or more substantially linear retroreflective features; detecting along a first image scan line two opposing edges of the feature; detecting along a second image scan line two opposing edges of the feature; determining a vanishing point relative to the image from the detected opposing edges, an axis of vehicle alignment intersecting the vanishing point; projecting the axis of alignment onto the image to obtain a slope m; determining a pitch (Pch) component and a yaw (Yaw) component of vehicle orientation relative to the axis of alignment; and determining a lateral displacement xO of the vehicle from the axis of alignment in accordance with the equation: xO=-zO×cos(Yaw)/(m×cos(Pch))-zO×sin(Pch×sin(Yaw)/cos(Pch).
Claim 28
Independent Claim
148 words
A method of providing navigation information for a vehicle, comprising the steps of: imaging a surface which is disposed above at least a projected forward path of the vehicle, the surface having a height zO above the vehicle, the surface including one or more substantially linear retroreflective features; detecting along a first image scan line two opposing edges of the feature; detecting along a second image scan line two opposing edges of the feature; determining a vanishing point relative to the image from the detected opposing edges, an axis of vehicle alignment intersecting the vanishing point; projecting the axis of alignment onto the image to obtain a slope m; determining a pitch (Pch) component and a yaw (Yaw) component of vehicle orientation relative to the axis of alignment; and determining a lateral displacement xO of the vehicle from the axis of alignment in accordance with the equation: xO=-zO×cos(Yaw)/(m×cos(Pch))-zO×sin(Pch×sin(Yaw)/cos(Pch).
Claim 29
Dependent Claim
33 words
A method as set forth in claim 24 wherein the vanishing point is defined by coordinates uu and vv and wherein the yaw component is determined in accordance with the equation Yaw=arctan (uu×cos(Pch)).
References Cited (Backward Citations)
US3187185A
Cited
US3610754A
Cited
US4119900A
Cited
US4309748A
Cited
US4530057A
Cited
US4482960A
Cited
US4500970A
Cited
US4558215A
Cited
US4611292A
Cited
US4566032A
Cited
US4628453A
Cited
US4584704A
Cited
US4626995A
Cited
US4620285A
Cited
US4706195A
Cited
US4668859A
Cited
US4627511A
Cited
US4679152A
Cited
US4630109A
Cited
US4729660A
Cited
US4786167A
Cited
US4653316A
Cited
US4815008A
Cited
US4862047A
Cited
US4819169A
Cited
US4796198A
Cited
US4855915A
Cited
US4947094A
Cited
US4868752A
Cited
US4858132A
Cited
US4790402A
Cited
US4846297A
Cited
US4951213A
Cited
US4905151A
Cited
US4918607A
Cited
US4933864A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1994-09-23 | 1995-03-25 | 1995-09-24 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1998-09-23 | 1999-03-25 | 1999-09-24 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2002-09-23 | 2003-03-25 | 2003-09-24 | $7700.00 | Window Closed / Lapsed |