US6977630B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Mobility assist device
Assignee: University of Minnesota Twin Cities
•
Filing: 2000-07-18
•
Granted: 2005-12-20
•
Expires: 2020-07-18
Abstract
Abstract The present invention is directed to a visual mobility assist device which provides a conformal, augmented display to assist a moving body. When the moving body is a motor vehicle, for instance (although it can be substantially any other body), the present invention assists the driver in either lane keeping or collision avoidance, or both. The system can display objects such as lane boundaries, targets, other navigational and guidance elements or objects, or a variety of other indicators, in proper perspective, to assist the driver.
Inventors
- 👤 Max Donath
- 👤 Craig R. Shankwitz
- 👤 Heon Min Lim
- 👤 Bryan Newstrom
- 👤 Alec Gorjestani
- 👤 Sameer Pardy
- 👤 Lee Alexander
- 👤 Pi-Ming Cheng
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 11:43
CPC Classifications
G; G01; G01C; G01C21/00; G01C21/26; G01C21/34; G01C21/36; G01C21/3626; G01C21/365; B; B60; B60R; B60R2300/00; B60R2300/20; B60R2300/205; B60R2300/30; B60R2300/301; B60R2300/302; B60R2300/304; B60R2300/305; B60R2300/307; B60R2300/60; B60R2300/80; B60R2300/804; B60R2300/8093; B60T; B60T2201/00; B60T2201/08; B60T2201/086
Claims Analysis
Total Claims: 55
Claim 1
Independent Claim
85 words
A mobile assist device for use with a motorized vehicle having an operating position at which an operator controls the vehicle, the device comprising: a data storage system containing stored objects each defining a location of corresponding real world objects; and a display configured to display virtual images representing the stored objects in a position that generates a visual effect of the virtual images being projected on the corresponding real world objects when the virtual images are viewed by the operator in the operating position.
Claim 2
Dependent Claim
85 words
A mobile assist device for use with a motorized vehicle having an operating position at which an operator controls the vehicle, the device comprising: a data storage system containing stored objects each defining a location of corresponding real world objects; and a display configured to display virtual images representing the stored objects in a position that generates a visual effect of the virtual images being projected on the corresponding real world objects when the virtual images are viewed by the operator in the operating position.
Claim 3
Dependent Claim
53 words
The device of claim 1 , wherein: the stored objects define a location of lane boundaries of a road; and the virtual images presented on the display include a line that substantially overlays the lane boundary of the road corresponding to the stored objects when viewed by the operator in the operating position.
Claim 4
Dependent Claim
32 words
The device of claim 2 , wherein the stored objects correspond to at least one of a center lane boundary, a left lane boundary, and a right lane boundary of the road.
Claim 5
Dependent Claim
19 words
The device of claim 1 , wherein the display includes a screen on which the virtual images are displayed.
Claim 6
Dependent Claim
15 words
The device of claim 4 , wherein the screen comprises a liquid crystal display film.
Claim 7
Dependent Claim
99 words
A mobility assist device for use with a motorized vehicle having an operating position at which an operator controls the motorized vehicle, the device comprising: a data storage system; object data contained in the data storage system, the object data including location information of a real world object in a three dimensional coordinate system; and a display attached to the motorized vehicle and including a graphical image that is positioned to produce a visual effect of the graphical image being projected on the corresponding real world object when viewed from a perspective of the operator in the operating position.
Claim 8
Dependent Claim
99 words
A mobility assist device for use with a motorized vehicle having an operating position at which an operator controls the motorized vehicle, the device comprising: a data storage system; object data contained in the data storage system, the object data including location information of a real world object in a three dimensional coordinate system; and a display attached to the motorized vehicle and including a graphical image that is positioned to produce a visual effect of the graphical image being projected on the corresponding real world object when viewed from a perspective of the operator in the operating position.
Claim 9
Dependent Claim
32 words
The device of claim 6 , wherein the graphical image is positioned in line with a line of sight between the operator in the operating position and the corresponding real world object.
Claim 10
Dependent Claim
33 words
The device of claim 6 , wherein a size of the graphical image changes in response to a change in the position of the operating position relative to the corresponding real world object.
Claim 11
Dependent Claim
27 words
The device of claim 8 , wherein the size of the graphical image becomes smaller as the operating position moves away from the corresponding real world object.
Claim 12
Dependent Claim
26 words
The device of claim 8 , wherein the size of the graphical image becomes larger as the operating position moves toward the corresponding real world object.
Claim 13
Dependent Claim
18 words
The device of claim 6 , wherein the graphical image is representative of the corresponding real world object.
Claim 14
Dependent Claim
60 words
The device of claim 11 , wherein the real world object includes a lane marking on a road and the graphical image includes a line having a shape that substantially matches the shape of the lane marking such that it appears to be projected on the lane marking when viewed from the perspective of the operator in the operating position.
Claim 15
Dependent Claim
18 words
The device of claim 11 , wherein the graphical image corresponds to a lane marking on a road.
Claim 16
Dependent Claim
25 words
The device of claim 11 , wherein the corresponding real world object is located adjacent to a road on which the motorized vehicle is located.
Claim 17
Dependent Claim
48 words
The device of claim 14 , wherein the corresponding real world object includes a guardrail alongside the road, and the graphical image includes a representation of the guardrail, which appears to be projected on the guardrail when viewed from the perspective of the operator in the operating position.
Claim 18
Dependent Claim
19 words
The device of claim 6 , wherein the display includes a screen on which the graphical image is presented.
Claim 19
Dependent Claim
22 words
The device of claim 16 , wherein the screen is positioned between a window of the motorized vehicle and the operating position.
Claim 20
Dependent Claim
11 words
The device of claim 17 , wherein the screen is transparent.
Claim 21
Dependent Claim
17 words
The device of claim 18 including a projector configured to project the graphical image onto the screen.
Claim 22
Dependent Claim
37 words
The device of claim 6 , wherein the position of the graphical image is based on the object data, a location of the operating position, and a location of the display in the three dimensional coordinate system.
Claim 23
Dependent Claim
63 words
The device of claim 6 including an object detection system configured to detect objects outside of the motorized vehicle that are within a field of view of the operator, wherein the display includes tracking graphical images that are positioned in the display to produce a visual effect of being projected on the real world objects that are detected by the object detection system.
Claim 24
Dependent Claim
96 words
A mobility assist device for use with a motorized vehicle having an operating position at which an operator controls the motorized vehicle, the device comprising: a data storage system; objects data contained in the data storage system, the objects data including location information of real world objects in a three dimensional coordinate system; and a display attached to the motorized vehicle and including graphical images that are positioned in the display such that they appear to be projected on the corresponding real world objects when viewed from a perspective of the operator in the operating position.
Claim 25
Dependent Claim
96 words
A mobility assist device for use with a motorized vehicle having an operating position at which an operator controls the motorized vehicle, the device comprising: a data storage system; objects data contained in the data storage system, the objects data including location information of real world objects in a three dimensional coordinate system; and a display attached to the motorized vehicle and including graphical images that are positioned in the display such that they appear to be projected on the corresponding real world objects when viewed from a perspective of the operator in the operating position.
Claim 26
Dependent Claim
32 words
The device of claim 22 , wherein the graphical images are positioned in line with a line of sight between the operator in the operating position and the corresponding real world objects.
Claim 27
Dependent Claim
33 words
The device of claim 12 , wherein a size of the graphical images changes in response to a change in the position of the operating position relative to the corresponding real world objects.
Claim 28
Dependent Claim
27 words
The device of claim 24 , wherein the size of the graphical images becomes smaller as the operating position moves away from the corresponding real world objects.
Claim 29
Dependent Claim
26 words
The device of claim 24 , wherein the size of the graphical images becomes larger as the operating position moves toward the corresponding real world objects.
Claim 30
Dependent Claim
18 words
The device of claim 22 , wherein the graphical images are representative of the corresponding real world objects.
Claim 31
Dependent Claim
75 words
The device of claim 27 , wherein the real world objects include first and second lane markings on a road and the graphical images include first and second lines having a shape that substantially matches a shape of the first and second lane markings, respectively, such that the first and second lines appear to be projected on the first and second lane markings when viewed from the perspective of the operator in the operating position.
Claim 32
Dependent Claim
19 words
The device of claim 27 , wherein the graphical images correspond to real world lane markings of a road.
Claim 33
Dependent Claim
29 words
The device of claim 27 , wherein the corresponding real world objects include an object that is located adjacent to a road on which the motorized vehicle is located.
Claim 34
Dependent Claim
52 words
The device of claim 30 , wherein the corresponding real world object located adjacent the road includes a guardrail alongside the road, and the graphical images include a representation of the guardrail, which appears to be projected on the guardrail when viewed from the perspective of the operator in the operating position.
Claim 35
Dependent Claim
19 words
The device of claim 22 , wherein the display includes a screen on which the graphical image is presented.
Claim 36
Dependent Claim
22 words
The device of claim 32 , wherein the screen is positioned between a window of the motorized vehicle and the operating position.
Claim 37
Dependent Claim
11 words
The device of claim 32 , wherein the screen is transparent.
Claim 38
Dependent Claim
17 words
The device of claim 32 including a projector configured to project the graphical image onto the screen.
Claim 39
Dependent Claim
37 words
The device of claim 22 , wherein the positions of the graphical images are based on the objects data, a location of the operating position, and a location of the display in the three dimensional coordinate system.
Claim 40
Dependent Claim
124 words
A mobility assist device comprising: a motorized vehicle having an operating position at which an operator controls the motorized vehicle; a data storage system accessible from the motorized vehicle; objects data contained in a data storage system, the objects data including location information of real world objects in a three dimensional coordinate system; and a display attached to the motorized vehicle and including graphical images that are displayed in a position such that they appear to be projected on the corresponding real world objects when viewed by the operator in the operating position, wherein the positions of the graphical images are based on the objects data, a location of the operating position, and a location of the display in the three dimensional coordinate system.
Claim 41
Dependent Claim
124 words
A mobility assist device comprising: a motorized vehicle having an operating position at which an operator controls the motorized vehicle; a data storage system accessible from the motorized vehicle; objects data contained in a data storage system, the objects data including location information of real world objects in a three dimensional coordinate system; and a display attached to the motorized vehicle and including graphical images that are displayed in a position such that they appear to be projected on the corresponding real world objects when viewed by the operator in the operating position, wherein the positions of the graphical images are based on the objects data, a location of the operating position, and a location of the display in the three dimensional coordinate system.
Claim 42
Dependent Claim
31 words
The device of claim 37 , wherein the motorized vehicle is an automobile and the real world objects correspond to features of a road on which the motorized vehicle is located.
Claim 43
Dependent Claim
32 words
The device of claim 37 , wherein the graphical images are positioned in line with a line of sight between the operator in the operating position and the corresponding real world objects.
Claim 44
Dependent Claim
33 words
The device of claim 37 , wherein a size of the graphical images changes in response to a change in the position of the operating position relative to the corresponding real world objects.
Claim 45
Dependent Claim
27 words
The device of claim 40 , wherein the size of the graphical images becomes smaller as the operating position moves away from the corresponding real world objects.
Claim 46
Dependent Claim
26 words
The device of claim 40 , wherein the size of the graphical images becomes larger as the operating position moves toward the corresponding real world objects.
Claim 47
Dependent Claim
18 words
The device of claim 37 , wherein the graphical images are representative of the corresponding real world objects.
Claim 48
Dependent Claim
75 words
The device of claim 43 , wherein the real world objects include first and second lane markings on a road and the graphical images include first and second lines having a shape that substantially matches a shape of the first and second lane markings, respectively, such that the first and second lines appear to be projected on the first and second lane markings when viewed from the perspective of the operator in the operating position.
Claim 49
Dependent Claim
19 words
The device of claim 43 , wherein the graphical images correspond to real world lane markings of a road.
Claim 50
Dependent Claim
29 words
The device of claim 43 , wherein the corresponding real world objects include an object that is located adjacent to a road on which the motorized vehicle is located.
Claim 51
Dependent Claim
52 words
The device of claim 46 , wherein the corresponding real world object located adjacent the road includes a guardrail alongside the road, and the graphical images include a representation of the guardrail, which appears to be projected on the guardrail when viewed from the perspective of the operator in the operating position.
Claim 52
Dependent Claim
18 words
The device of claim 37 wherein the display includes a screen on which the graphical image is presented.
Claim 53
Dependent Claim
22 words
The device of claim 48 , wherein the screen is positioned between a window of the motorized vehicle and the operating position.
Claim 54
Dependent Claim
11 words
The device of claim 48 , wherein the screen is transparent.
Claim 55
Dependent Claim
17 words
The device of claim 48 including a projector configured to project the graphical image onto the screen.
References Cited (Backward Citations)
US4120566A
Cited
US5231379A
Cited
US5291338A
Cited
US5214757A
Cited
US5499325A
Cited
US5517419A
Cited
US6226389B1
Cited
US5497271A
Cited
US5734358A
Cited
US5414439A
Cited
US5966132A
Cited
US5808566A
Cited
US5848373A
Cited
US5543789A
Cited
US6104316A
Cited
US6107944A
Cited
US5951620A
Cited
US5872526A
Cited
US5953722A
Cited
US6308177B1
Cited
US6361321B1
Cited
US5999878A
Cited
US6272431B1
Cited
US5926117A
Cited
US6047234A
Cited
US6405132B1
Cited
US6370475B1
Cited
US6289278B1
Cited
US6038559A
Cited
US6192314B1
Cited
US6298303B1
Cited
US6486856B1
Cited
US6184823B1
Cited
US6212474B1
Cited
US6208934B1
Cited
US6166698A
Cited
US6161071A
Cited
US6218934B1
Cited
US6122593A
Cited
US6249742B1
Cited
US6438491B1
Cited
WO2001011388A1
Cited
US6385539B1
Cited
US6188957B1
Cited
EP1096229A1
Cited
US6314365B1
Cited
US6278942B1
Cited
US6253151B1
Cited
US6314367B1
Cited
US20020184236A1
Cited
US20040066376A1
Cited
US20030023614A1
Cited
US6526352B1
Cited
US20030128182A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-12-19 | 2009-06-20 | 2009-12-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-12-19 | 2013-06-20 | 2013-12-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-12-19 | 2017-06-20 | 2017-12-20 | $7700.00 | Window Closed / Lapsed |