← Back to Patent Explorer
US4905151A Expired / Lapsed US ⏱️ 0.0 years remaining

One dimensional image visual system for a moving vehicle

Assignee: Transitions Research Corp
•
Filing: 1988-03-07
•
Granted: 1990-02-27
•
Expires: 2008-03-07
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A vision system for a mobile robot 10 comprises an optical sensor subsystem 20 which generates a substantially one dimensional image of an environment, a signal processing subsystem 24 for extracting and enhancing significant vertical visual features from the one dimensional image and a feature processing system 26 which analyses rapidly and in real time the extracted features for use by a control system 28 for navigation of the robot. The optical sensor may be a line scan camera having a plurality of outputs which relate to brightness values received from the environment. Triangulation, optical flow and optical flow with log transforms methods are disclosed for processing the one dimensional image data to yield azimuth and/or distance to an object within the environment. Also disclosed is a binocular vision system which generates two, one dimensional images and a method of processing same.

Inventors

  • 👤 Carl F. R. Weiman
  • 👤 John M. Evans, Jr.

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-23 06:12
CPC Classifications
G; G05; G05D; G05D1/00; G05D1/02; G05D1/021; G05D1/0231; G05D1/0246; G05D1/0253; G05D1/0268; G05D1/0272; G05D1/0274; G05D1/0251; G05D1/027

Claims Analysis

Total Claims: 45
Claim 1
Independent Claim 104 words
A vision system for a mobile vehicle comprising: means, having a substantially planar field of view of an environment, for generating a substantially linear, one-dimensional image of the environment through which a mobile vehicle moves, the environment including at least one object, said image generating means having an output signal for expressing a characteristic of the image at a plurality of points along the substantially one dimensional image; and means, coupled to said output signal, for processing said output signal to determine at least one characteristic associated with a position of the object relative to a position of said mobile vehicle within the environment.
Claim 2
Dependent Claim 104 words
A vision system for a mobile vehicle comprising: means, having a substantially planar field of view of an environment, for generating a substantially linear, one-dimensional image of the environment through which a mobile vehicle moves, the environment including at least one object, said image generating means having an output signal for expressing a characteristic of the image at a plurality of points along the substantially one dimensional image; and means, coupled to said output signal, for processing said output signal to determine at least one characteristic associated with a position of the object relative to a position of said mobile vehicle within the environment.
Claim 3
Dependent Claim 26 words
A vision system as defined in claim 1 wherein said at least one determined characteristic is an azimuth angle between said mobile vehicle and the object.
Claim 4
Dependent Claim 25 words
A vision system as defined in claim 1 wherein said at least one determined characteristic includes a distance to the object relative to the vehicle.
Claim 5
Dependent Claim 39 words
A vision system as defined in claim 1 and further comprising: means, coupled to said processing means, for varying the position of said mobile vehicle relative to the object as a function of said at least one determined characteristic.
Claim 6
Dependent Claim 30 words
A vision system as defined in claim 4 wherein said mobile vehicle moves across a substantially planar surface and wherein said field of view is substantially parallel with the surface.
Claim 7
Dependent Claim 21 words
A vision system as set forth in claim 1 and further comprising means, coupled to the vehicle, for illuminating the environment.
Claim 8
Dependent Claim 29 words
A vision system as set forth in claim 1 wherein said means for generating comprises a linear array of radiation detectors that view the environment through a cylindrical lens.
Claim 9
Dependent Claim 39 words
A vision system as set forth in claim 1 wherein said means for generating comprises a two-dimensional array of radiation detectors having detector outputs from a given row or column combined such that a substantially one-dimensional image is obtained.
Claim 10
Dependent Claim 138 words
A vision system for a vehicle comprising: optical sensor means for generating a substantially linear, one dimensional image of an environment through which the vehicle is to move, the environment including one or more features, said sensor means having a first output signal expressive of edge boundaries of the one or features appearing within the substantially one dimensional image; signal processing means coupled to said first output signal for processing said signal for detecting the edge boundaries associated with the one or more features, said signal processing means having a second output signal expressive at least of the detected edge boundaries; and feature processing means coupled to said second output signal for generating a third output signal expressive at least of a positional relationship between said vehicle and the one or more features within the field of view.
Claim 11
Dependent Claim 138 words
A vision system for a vehicle comprising: optical sensor means for generating a substantially linear, one dimensional image of an environment through which the vehicle is to move, the environment including one or more features, said sensor means having a first output signal expressive of edge boundaries of the one or features appearing within the substantially one dimensional image; signal processing means coupled to said first output signal for processing said signal for detecting the edge boundaries associated with the one or more features, said signal processing means having a second output signal expressive at least of the detected edge boundaries; and feature processing means coupled to said second output signal for generating a third output signal expressive at least of a positional relationship between said vehicle and the one or more features within the field of view.
Claim 12
Dependent Claim 52 words
A vision system as defined in claim 9 wherein said optical sensor means comprises: a radiation detector; and means for sequentially activating the radiation detector for generating a plurality of output signals, each of the output signals being expressive of the detected radiation at a point along said substantially linear, one-dimensional image.
Claim 13
Dependent Claim 20 words
A vision system as defined in claim 10 wherein said substantially one-dimensional image is orientated substantially parallel to the surface.
Claim 14
Dependent Claim 19 words
A vision system as defined in claim 11 wherein said radiation detector comprises an array of visible radiation detectors.
Claim 15
Dependent Claim 19 words
A vision system as defined in claim 11 wherein said radiation detector comprises an array of infrared radiation detectors.
Claim 16
Dependent Claim 24 words
A vision system as defined in claim 9 wherein the first output signal is expressive of brightness values along the substantially one dimensional image.
Claim 17
Dependent Claim 24 words
A vision system as defined in claim 9 wherein the first output signal is expressive of color values along the substantially one dimensional image.
Claim 18
Dependent Claim 26 words
A vision system as defined in claim 9 wherein the first output signal is expressive of a polarization angle of radiation along the one dimensional image.
Claim 19
Dependent Claim 29 words
A vision system as defined in claim 9 wherein said positional relationship is an azimuth angle between said vehicle and at least one of said one or more features.
Claim 20
Dependent Claim 28 words
A vision system as defined in claim 9 wherein said positional relationship is a distance between said vehicle and at least one of said one or more features.
Claim 21
Dependent Claim 75 words
A vision system as defined in claim 9 wherein said vehicle comprises: drive means for moving said vehicle across a surface; and control means for controlling the operation of said drive means, said control means being coupled to said third output signal and responsive thereto for controlling the operation of said drive means at least in response to said positional relationship between said vehicle and the one or more features within the substantially one-dimensional image.
Claim 22
Dependent Claim 84 words
A vision system as defined in claim 19 wherein said vehicle further comprises: encoder means, coupled to said drive means and responsive to the operation thereof, for outputting to said control means a signal expressive of a distance travelled by said vehicle between a first and a second point on the surface; and means, coupled to said encoder means output signal, for outputting to said feature processing means a signal expressive of a velocity of said vehicle between the first and the second point.
Claim 23
Dependent Claim 205 words
A mobile robot comprising: platform means; drive means coupled to said platform means for moving said platform means relative to a surface; control means, coupled to said platform means, for providing control signals to said drive means for controlling the movement of said platform means; and vision means, coupled to said platform means, for generating vision signals related to one or more features within an environment through which said platform means moves, said vision means comprising: optical sensor means for generating a substantially linear, one dimensional image of an environment through which the robot moves, the environment including one or more features, said sensor means having a first output signal expressive of edge boundaries of the one or features appearing within the substantially one dimensional image; signal processing means coupled to said first output signal for processing said signal for detecting the edge boundaries associated with the one or more features, said signal processing means having a second output signal expressive at least of the detected edge boundaries; and feature processing means coupled to said second output signal for generating a third output signal expressive at least of a positional relationship between the robot and the one or more features within the field of view.
Claim 24
Dependent Claim 205 words
A mobile robot comprising: platform means; drive means coupled to said platform means for moving said platform means relative to a surface; control means, coupled to said platform means, for providing control signals to said drive means for controlling the movement of said platform means; and vision means, coupled to said platform means, for generating vision signals related to one or more features within an environment through which said platform means moves, said vision means comprising: optical sensor means for generating a substantially linear, one dimensional image of an environment through which the robot moves, the environment including one or more features, said sensor means having a first output signal expressive of edge boundaries of the one or features appearing within the substantially one dimensional image; signal processing means coupled to said first output signal for processing said signal for detecting the edge boundaries associated with the one or more features, said signal processing means having a second output signal expressive at least of the detected edge boundaries; and feature processing means coupled to said second output signal for generating a third output signal expressive at least of a positional relationship between the robot and the one or more features within the field of view.
Claim 25
Dependent Claim 52 words
A mobile robot as defined in claim 21 wherein said optical sensor means comprises: a radiation detector; and means for sequentially activating the radiation detector for generating a plurality of output signals, each of the output signals being expressive of the detected radiation at a point along said substantially linear, one-dimensional image.
Claim 26
Dependent Claim 25 words
A mobile robot as defined in claim 22 wherein said substantially one-dimensional image is orientated substantially parallel to a surface over which the robot moves.
Claim 27
Dependent Claim 19 words
A mobile robot as defined in claim 23 wherein said optical sensor means comprises an array of radiation detectors.
Claim 28
Dependent Claim 82 words
A mobile robot as defined in claim 21 and further comprising: encoder means, coupled to said drive means and responsive to the operation thereof, for outputting to said control means a signal expressive of a distance travelled by said robot between a first and a second point on the surface; and means, coupled to said encoder means output signal, for outputting to said feature processing means a signal expressive of a velocity of said robot between the first and the second point.
Claim 29
Dependent Claim 32 words
A mobile robot as defined in claim 21 wherein the optical sensor means further comprises a cylindrical lens disposed in front of said radiation detector for emphasizing vertical components of said features.
Claim 30
Dependent Claim 277 words
For a vehicle moving over a surface at a velocity along a path, a method of determining an x-y position of an object disposed relative to the surface where x is a distance to the object parallel to the path and y is a distance to the object perpendicular to the path, comprising the steps of: at a first time t.sub.(i) viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a first position of the object within the one dimensional image relative to a first position within the one-dimensional image which coincides with the path; converting the difference between the first image position and the first path position to a tangent of an angle (A), where A is the angle between the object and the path at time t.sub.(i) ; at a second time t.sub.(i+1) viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a second position of the object within the one dimensional image relative to a second position within the one-dimensional image which coincides with the path; converting the difference between the second image position and the second path position to a tangent of an angle (B), where B is the angle between the object and the path at time t.sub.(i+1) ; and calculating the distance x in accordance with the equation x=r*tan(B)/(tan(B)-tan(A)); and calculating the distance y in accordance with the equation y=x*tan(A) where r=u*t, where t is the difference in time between t.sub.(i) and t.sub.(i+1).
Claim 31
Dependent Claim 277 words
For a vehicle moving over a surface at a velocity along a path, a method of determining an x-y position of an object disposed relative to the surface where x is a distance to the object parallel to the path and y is a distance to the object perpendicular to the path, comprising the steps of: at a first time t.sub.(i) viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a first position of the object within the one dimensional image relative to a first position within the one-dimensional image which coincides with the path; converting the difference between the first image position and the first path position to a tangent of an angle (A), where A is the angle between the object and the path at time t.sub.(i) ; at a second time t.sub.(i+1) viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a second position of the object within the one dimensional image relative to a second position within the one-dimensional image which coincides with the path; converting the difference between the second image position and the second path position to a tangent of an angle (B), where B is the angle between the object and the path at time t.sub.(i+1) ; and calculating the distance x in accordance with the equation x=r*tan(B)/(tan(B)-tan(A)); and calculating the distance y in accordance with the equation y=x*tan(A) where r=u*t, where t is the difference in time between t.sub.(i) and t.sub.(i+1).
Claim 32
Dependent Claim 186 words
A binocular vision system for a vehicle comprising: optical sensor means for detecting radiation emanating from one or more features within an environment of a vehicle, said sensor means generating two substantially one-dimensional images of the environment, the images being substantially parallel one to another and each having an image output signal expressive of a characteristic of the detected radiation at a plurality of points along the associated substantially one dimensional image, said vehicle being disposed upon a surface and said one-dimensional images being disposed at a predetermined orientation to the surface; signal processing means coupled to said image output signals for processing said signals for detecting a component or components of each of said image output signals associated with said one or more features, said signal processing means having an output signal expressive at least of the detected component or components of the image output signals; and feature processing means coupled to said signal processing means output signal for generating an output signal expressive at least of a positional relationship between said vehicle and the one or more features within the environment of the vehicle.
Claim 33
Dependent Claim 186 words
A binocular vision system for a vehicle comprising: optical sensor means for detecting radiation emanating from one or more features within an environment of a vehicle, said sensor means generating two substantially one-dimensional images of the environment, the images being substantially parallel one to another and each having an image output signal expressive of a characteristic of the detected radiation at a plurality of points along the associated substantially one dimensional image, said vehicle being disposed upon a surface and said one-dimensional images being disposed at a predetermined orientation to the surface; signal processing means coupled to said image output signals for processing said signals for detecting a component or components of each of said image output signals associated with said one or more features, said signal processing means having an output signal expressive at least of the detected component or components of the image output signals; and feature processing means coupled to said signal processing means output signal for generating an output signal expressive at least of a positional relationship between said vehicle and the one or more features within the environment of the vehicle.
Claim 34
Dependent Claim 55 words
A binocular vision system as defined in claim 28 wherein said optical sensor means comprises: a radiation detector; and means for sequentially activating the radiation detector for generating a plurality of output signals, each of the output signals being expressive of the radiation at a point along at least one of said substantially one-dimensional images.
Claim 35
Dependent Claim 23 words
A binocular vision system as defined in claim 28 wherein each of said substantially one-dimensional images is orientated substantially parallel to the surface.
Claim 36
Dependent Claim 40 words
A binocular vision system as defined in claim 28 wherein said optical sensor means comprises a first and a second array of radiation detectors, the first and second arrays being substantially linear arrays which are disposed parallel one to another.
Claim 37
Dependent Claim 21 words
A binocular vision system as defined in claim 28 wherein said optical sensor means comprises an array of infrared radiation detectors.
Claim 38
Dependent Claim 192 words
For a vehicle moving over a surface along a path, a method of determining an x-y position of an object disposed relative to the surface where x o is an unknown distance to the object parallel to the path and y is an unknown distance to the object perpendicular to the path, comprising the steps of: viewing the object from a first viewpoint and from a second viewpoint to generate two substantially one-dimensional images of the object, the substantially one dimensional images being orientated in a substantially parallel manner one to another and also with the surface; determining a position (p) of the object within each of the one dimensional images relative to a position within each of the one-dimensional images which coincides with the path; calculating the distance x o in accordance with the equation x o =D/(p1-p2); and calculating the distance y in accordance with the equation y=D*p1/(p1-p2); where p1 and p2 are each the determined position within each of the fields of view in perspective projection of the object onto the substantially one dimensional image and wherein D is a distance between the first viewpoint and the second viewpoint.
Claim 39
Dependent Claim 192 words
For a vehicle moving over a surface along a path, a method of determining an x-y position of an object disposed relative to the surface where x o is an unknown distance to the object parallel to the path and y is an unknown distance to the object perpendicular to the path, comprising the steps of: viewing the object from a first viewpoint and from a second viewpoint to generate two substantially one-dimensional images of the object, the substantially one dimensional images being orientated in a substantially parallel manner one to another and also with the surface; determining a position (p) of the object within each of the one dimensional images relative to a position within each of the one-dimensional images which coincides with the path; calculating the distance x o in accordance with the equation x o =D/(p1-p2); and calculating the distance y in accordance with the equation y=D*p1/(p1-p2); where p1 and p2 are each the determined position within each of the fields of view in perspective projection of the object onto the substantially one dimensional image and wherein D is a distance between the first viewpoint and the second viewpoint.
Claim 40
Dependent Claim 132 words
For a vehicle moving over a surface at a velocity along a path, a method of determining for an object disposed relative to the surface an azimuth angle of the object relative to the path, comprising the steps of: at a first time t.sub.(i) viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a first position of the object within the one dimensional image relative to a first position within the one-dimensional image which coincides with the path; and converting the difference between the first image position and the first path position to a tangent of an angle (A), where A is the angle between the object and the path at time t.sub.(i).
Claim 41
Dependent Claim 132 words
For a vehicle moving over a surface at a velocity along a path, a method of determining for an object disposed relative to the surface an azimuth angle of the object relative to the path, comprising the steps of: at a first time t.sub.(i) viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a first position of the object within the one dimensional image relative to a first position within the one-dimensional image which coincides with the path; and converting the difference between the first image position and the first path position to a tangent of an angle (A), where A is the angle between the object and the path at time t.sub.(i).
Claim 42
Dependent Claim 168 words
For a vehicle moving over a surface at a velocity along a path, a method of determining an x-y position of an object disposed relative to the surface where x o is an unknown distance to the object parallel to the path and y is an unknown distance to the object perpendicular to the path, comprising the steps of: viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a position of the object within the one dimensional image relative to a position within the one-dimensional image which coincides with the path; determining the velocity (v) of the vehicle along the path; and calculating the distance x o in accordance with the equation x o =v*p/(dp/dt); and calculating the distance y in accordance with the equation y=v*p /(dp/dt); where p is a position within the field of view in perspective projection of the object onto the substantially one dimensional image.
Claim 43
Dependent Claim 168 words
For a vehicle moving over a surface at a velocity along a path, a method of determining an x-y position of an object disposed relative to the surface where x o is an unknown distance to the object parallel to the path and y is an unknown distance to the object perpendicular to the path, comprising the steps of: viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a position of the object within the one dimensional image relative to a position within the one-dimensional image which coincides with the path; determining the velocity (v) of the vehicle along the path; and calculating the distance x o in accordance with the equation x o =v*p/(dp/dt); and calculating the distance y in accordance with the equation y=v*p /(dp/dt); where p is a position within the field of view in perspective projection of the object onto the substantially one dimensional image.
Claim 44
Dependent Claim 177 words
For a vehicle moving over a surface at a velocity along a path, a method of determining an x-y position of an object disposed relative to the surface where x o is an unknown distance to the object parallel to the path and y is an unknown distance to the object perpendicular to the path, comprising the steps of: viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a position of the object within the one dimensional image relative to a position within the one-dimensional image which coincides with the path; determining the velocity (v) of the vehicle along the path; and calculating the distance x o in accordance with the equation x o =v/(dq/dt); and calculating the distance y in accordance with the equation y=(v*exp(q))/(dq/dt); where q is a natural logarithm of p and wherein p is a determined position within the field of view in perspective projection of the object onto the substantially one dimensional image.
Claim 45
Dependent Claim 177 words
For a vehicle moving over a surface at a velocity along a path, a method of determining an x-y position of an object disposed relative to the surface where x o is an unknown distance to the object parallel to the path and y is an unknown distance to the object perpendicular to the path, comprising the steps of: viewing the object to generate a substantially one-dimensional image of the object, the substantially one dimensional image being orientated in a substantially parallel manner with the surface; determining a position of the object within the one dimensional image relative to a position within the one-dimensional image which coincides with the path; determining the velocity (v) of the vehicle along the path; and calculating the distance x o in accordance with the equation x o =v/(dq/dt); and calculating the distance y in accordance with the equation y=(v*exp(q))/(dq/dt); where q is a natural logarithm of p and wherein p is a determined position within the field of view in perspective projection of the object onto the substantially one dimensional image.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1993-02-26 1993-08-28 1994-02-27 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1997-02-26 1997-08-28 1998-02-27 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2001-02-26 2001-08-28 2002-02-27 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag