← Back to Patent Explorer
US8527199B1 Active / In Force US ⏱️ 5.5 years remaining

Automatic collection of quality control statistics for maps used in autonomous driving

Assignee: Waymo LLC
•
Filing: 2012-05-17
•
Granted: 2013-09-03
•
Expires: 2032-05-17
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Disclosed herein are methods and apparatus for generating accurate maps for autonomous vehicles. A map is stored at a computing device associated with a vehicle. The vehicle can be operated in a partially-autonomous mode, where the computing device can generate driving directions for manual execution along a route based on the map. The computing device can be configured to receive and store information related to features and a quality of driving along the route. The map can be updated and quality control statistics can be determined based on the stored information. The updated map can be promoted based on the quality control statistics. In response to promoting the updated map, the computing device can store the promoted map and enable the vehicle to operate in the autonomous-operation mode using the promoted map.

Inventors

  • 👤 Donald Jason Burnette
  • 👤 Andrew Hughes Chatham
  • 👤 Matthew Paul McNaughton

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-01 23:23
CPC Classifications
G; G01; G01C; G01C21/00; G01C21/38; G01C21/3804; G01C21/3833; G01C21/3848; G01C21/3807; G01C21/3815; G01C21/3822; G01C21/3837; G08; G08G; G08G1/00; G08G1/01; G08G1/0104; G08G1/0108; G08G1/0112; G08G1/0125; G08G1/0129; G08G1/0137; G08G1/0141

Claims Analysis

Total Claims: 24
Claim 1
Independent Claim 231 words
A method, comprising: storing a map at a computing device associated with a vehicle, wherein the vehicle is configured to operate in a non-autonomous mode, a partially-autonomous mode, and an autonomous-operation mode, and wherein the map comprises information about a plurality of roads and a plurality of features; operating the vehicle in the partially-autonomous mode, wherein operating the vehicle in the partially-autonomous mode comprises: (i) generating driving directions for manual execution along a route based on the map, (ii) receiving information related to features of the route and to a quality of driving along the route, the plurality of features including at least some of the features of the route, and (iii) storing the information related to the features of the route and to the quality of driving along the route; updating the map based on the stored information related to the features of the route and to the quality of driving along the route; determining one or more quality control statistics based on the stored information related to the features of the route and to the quality of driving along the route; determining whether to publish the updated map based on the one or more quality control statistics; and in response to determining to publish the updated map: storing the published map in the computing device, and enabling operation of the vehicle in the autonomous-operation mode using the published map.
Claim 2
Independent Claim 231 words
A method, comprising: storing a map at a computing device associated with a vehicle, wherein the vehicle is configured to operate in a non-autonomous mode, a partially-autonomous mode, and an autonomous-operation mode, and wherein the map comprises information about a plurality of roads and a plurality of features; operating the vehicle in the partially-autonomous mode, wherein operating the vehicle in the partially-autonomous mode comprises: (i) generating driving directions for manual execution along a route based on the map, (ii) receiving information related to features of the route and to a quality of driving along the route, the plurality of features including at least some of the features of the route, and (iii) storing the information related to the features of the route and to the quality of driving along the route; updating the map based on the stored information related to the features of the route and to the quality of driving along the route; determining one or more quality control statistics based on the stored information related to the features of the route and to the quality of driving along the route; determining whether to publish the updated map based on the one or more quality control statistics; and in response to determining to publish the updated map: storing the published map in the computing device, and enabling operation of the vehicle in the autonomous-operation mode using the published map.
Claim 3
Dependent Claim 30 words
The method of claim 1 , wherein enabling operation of the vehicle in the autonomous-operation mode using the published map comprises enabling operation of the vehicle without a human driver.
Claim 4
Dependent Claim 87 words
The method of claim 1 , wherein determining whether to publish the updated map based on the one or more quality control statistics comprises: operating the vehicle in the autonomous-operation mode, wherein operating the vehicle in the autonomous-operation mode comprises: generating driving directions for automatic execution based on the map and receiving safety-driver feedback on the automatic execution from a trained safety driver in the vehicle; and determining whether to publish the updated map based on the one or more quality control statistics and the safety-driver feedback.
Claim 5
Dependent Claim 15 words
The method of claim 1 , wherein the plurality of features comprise a lane-center-location feature.
Claim 6
Dependent Claim 31 words
The method of claim 1 , wherein the plurality of features comprise a speed-limit feature, and wherein the speed-limit feature specifies a maximum speed for at least part of the route.
Claim 7
Dependent Claim 23 words
The method of claim 4 , wherein the speed-limit feature further specifies a minimum speed for the at least part of the route.
Claim 8
Dependent Claim 22 words
The method of claim 1 , wherein the plurality of features comprises a feature related to allowing or inhibiting changes in direction.
Claim 9
Dependent Claim 18 words
The method of claim 1 , wherein the map comprises imagery of at least part of the route.
Claim 10
Dependent Claim 36 words
The method of claim 1 , wherein the stored information related to the features of the route and the quality of driving along the route comprises an annotation about the quality of driving along the route.
Claim 11
Dependent Claim 18 words
The method of claim 9 , wherein the annotation comprises an indication that a lane marker was violated.
Claim 12
Dependent Claim 19 words
The method of claim 9 , wherein the annotation comprises an indication that a traffic control signal was ignored.
Claim 13
Dependent Claim 68 words
The method of claim 9 , wherein one traversal of the route is N miles long with N>0, wherein during one traversal of the route A annotations are added to the stored information related to features of the route and related to the quality of driving along the route with A≧0, and wherein the one or more quality control statistics comprise a quality control statistic based on A/N.
Claim 14
Dependent Claim 255 words
An article of manufacture including a non-transitory computer-readable storage medium having instructions stored thereon that, when executed by a processor, cause the processor to perform functions comprising: storing a map at a computing device associated with a vehicle, wherein the vehicle is configured to operate in a non-autonomous mode, a partially-autonomous mode, and an autonomous-operation mode, and wherein the map comprises information about a plurality of roads and a plurality of features; operating the vehicle in the partially-autonomous mode, wherein operating the vehicle in the partially-autonomous mode comprises: (i) generating driving directions for manual execution along a route based on the map, (ii) receiving information related to features of the route and to a quality of driving along the route, the plurality of features including at least some of the features of the route, and (iii) storing the information related to the features of the route and to the quality of driving along the route; updating the map based on the stored information related to the features of the route and to the quality of driving along the route; determining one or more quality control statistics based on the stored information related to the features of the route and to the quality of driving along the route; determining whether to publish the updated map based on the one or more quality control statistics; and in response to determining to publish the updated map: storing the published map in the computing device, and enabling operation of the vehicle in the autonomous-operation mode using the published map.
Claim 15
Dependent Claim 255 words
An article of manufacture including a non-transitory computer-readable storage medium having instructions stored thereon that, when executed by a processor, cause the processor to perform functions comprising: storing a map at a computing device associated with a vehicle, wherein the vehicle is configured to operate in a non-autonomous mode, a partially-autonomous mode, and an autonomous-operation mode, and wherein the map comprises information about a plurality of roads and a plurality of features; operating the vehicle in the partially-autonomous mode, wherein operating the vehicle in the partially-autonomous mode comprises: (i) generating driving directions for manual execution along a route based on the map, (ii) receiving information related to features of the route and to a quality of driving along the route, the plurality of features including at least some of the features of the route, and (iii) storing the information related to the features of the route and to the quality of driving along the route; updating the map based on the stored information related to the features of the route and to the quality of driving along the route; determining one or more quality control statistics based on the stored information related to the features of the route and to the quality of driving along the route; determining whether to publish the updated map based on the one or more quality control statistics; and in response to determining to publish the updated map: storing the published map in the computing device, and enabling operation of the vehicle in the autonomous-operation mode using the published map.
Claim 16
Dependent Claim 32 words
The article of manufacture of claim 13 , wherein enabling operation of the vehicle in the autonomous-operation mode using the published map comprises enabling operation of the vehicle without a human driver.
Claim 17
Dependent Claim 30 words
The article of manufacture of claim 13 , wherein the plurality of features comprise a lane-center-location feature, and wherein the lane-center-location feature is based on one or more lane-edge features.
Claim 18
Dependent Claim 33 words
The article of manufacture of claim 13 , wherein the plurality of features comprise a speed-limit feature, and wherein the speed-limit feature specifies a maximum speed for at least part of the route.
Claim 19
Dependent Claim 21 words
The article of manufacture of claim 13 , wherein the plurality of features comprises one or more images of the route.
Claim 20
Dependent Claim 47 words
The article of manufacture of claim 13 , wherein the stored information comprises an annotation about the quality of driving along the route, and wherein the annotation comprises an indication that a lane marker was violated and/or comprises an indication that a traffic control signal was ignored.
Claim 21
Dependent Claim 70 words
The article of manufacture of claim 13 , wherein one traversal of the route is N miles long with N>0, wherein during one traversal of the route A annotations are added to the stored information related to features of the route and related to the quality of driving along the route with A≧0, and wherein the one or more quality control statistics comprise a quality control statistic based on A/N.
Claim 22
Dependent Claim 253 words
A computing device, comprising: a processor; and a non-transitory computer-readable storage medium, configured to store instructions that, when executed by the processor, cause the computing device to perform functions, comprising: select a map for a vehicle, wherein the vehicle is configured to operate in a non-autonomous mode, a partially-autonomous mode, and an autonomous-operation mode, and wherein the map comprises information about a plurality of roads and a plurality of features, operating the vehicle in the partially-autonomous mode, wherein operating the vehicle in the partially-autonomous mode comprises: (i) generating driving directions for manual execution along a route based on the map, (ii) receiving information related to features of the route and to a quality of driving along the route, the plurality of features including at least some of the features of the route, and (iii) storing the information related to the features of the route and to the quality of driving along the route; updating the map based on the stored information related to the features of the route and to the quality of driving along the route, determining one or more quality control statistics based on the stored information related to the features of the route and to the quality of driving along the route, determining whether to publish the updated map based on the one or more quality control statistics, and in response to determining to publish the updated map: storing the published map in the computing device, and enabling operation of the vehicle in the autonomous-operation mode using the published map.
Claim 23
Dependent Claim 253 words
A computing device, comprising: a processor; and a non-transitory computer-readable storage medium, configured to store instructions that, when executed by the processor, cause the computing device to perform functions, comprising: select a map for a vehicle, wherein the vehicle is configured to operate in a non-autonomous mode, a partially-autonomous mode, and an autonomous-operation mode, and wherein the map comprises information about a plurality of roads and a plurality of features, operating the vehicle in the partially-autonomous mode, wherein operating the vehicle in the partially-autonomous mode comprises: (i) generating driving directions for manual execution along a route based on the map, (ii) receiving information related to features of the route and to a quality of driving along the route, the plurality of features including at least some of the features of the route, and (iii) storing the information related to the features of the route and to the quality of driving along the route; updating the map based on the stored information related to the features of the route and to the quality of driving along the route, determining one or more quality control statistics based on the stored information related to the features of the route and to the quality of driving along the route, determining whether to publish the updated map based on the one or more quality control statistics, and in response to determining to publish the updated map: storing the published map in the computing device, and enabling operation of the vehicle in the autonomous-operation mode using the published map.
Claim 24
Dependent Claim 19 words
The computing device of claim 20 , wherein the map comprises imagery of at least part of the route.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2016-09-02 2017-03-04 2017-09-03 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2020-09-02 2021-03-04 2021-09-03 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2024-09-02 2025-03-04 2025-09-03 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag