US5706355A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method of analyzing sequences of road images, device for implementing it and its application to detecting obstacles
Assignee: Thales SA
•
Filing: 1996-09-19
•
Granted: 1998-01-06
•
Expires: 2016-09-19
Abstract
Abstract A method and system of analyzing sequences of road images taken by a camera carried on board of a vehicle. A luminance signal of the road images from which contours of the road are extracted is generated. An analysis of color video signals based on the fact that the colorimetric components of a road region in an image do not include a green or red dominant is then combined with the luminance signal processing, in order to confirm, with good reliability, the limits of the road in the image on the basis of the contours. A mask of the road is then established. This method and system are applicable, in particular, to detecting obstacles on the road, and the information which it generates may be combined with information originating from other detectors in an obstacle detection system applicable to motor vehicle traffic.
Inventors
- 👤 Stephane Raboisson
- 👤 Gilles Even
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 21:18
CPC Classifications
G; G01; G01S; G01S13/00; G01S13/86; G01S13/867; G05; G05D; G05D1/00; G05D1/02; G05D1/021; G05D1/0231; G05D1/0242; G05D1/0246; G05D1/0257; G06; G06T; G06T7/00; G06T7/10; G06T7/12; G08; G08G; G08G1/00; G08G1/16; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30248; G06T2207/30252; G06T2207/30256; G06T2207/30261
Claims Analysis
Total Claims: 10
Claim 1
Independent Claim
163 words
A method of analyzing sequences of image video signals, taken by a camera on board a vehicle, for extracting a contour of a road from the image video signals, comprising the steps of: analyzing luminance information of the image video signals to extract contours and regions from the image video signals to generate a mask signal of the road; analyzing color information of the image video signals comprising the substeps of: determining average blue, red and green components for points in the image video signals; comparing the average blue components with the average red and green components for the points in the image video signals; and determining points at which a deviation between the average blue components and the average red or green components in the image video signals exceeds a first predetermined threshold; and combining the mask signal of the road from the analyzed luminance information with the determined points from the analyzed color information to extract the contour of the road.
Claim 2
Independent Claim
163 words
A method of analyzing sequences of image video signals, taken by a camera on board a vehicle, for extracting a contour of a road from the image video signals, comprising the steps of: analyzing luminance information of the image video signals to extract contours and regions from the image video signals to generate a mask signal of the road; analyzing color information of the image video signals comprising the substeps of: determining average blue, red and green components for points in the image video signals; comparing the average blue components with the average red and green components for the points in the image video signals; and determining points at which a deviation between the average blue components and the average red or green components in the image video signals exceeds a first predetermined threshold; and combining the mask signal of the road from the analyzed luminance information with the determined points from the analyzed color information to extract the contour of the road.
Claim 3
Dependent Claim
124 words
The method according to claim 1, wherein the step of analyzing the luminance information further comprising the substeps of: calculating gradients of the luminance information of the image video signals, the gradients having amplitudes; forming an image of contours formed of a plurality of image points from the amplitudes of the gradients of the luminance information; generating energy values of the energy of each of the plurality of image points based on the image of contours; thresholding the energy values of each of the plurality of image points by comparing the energy values with a second predetermined threshold, and retaining only the energy values which exceed the second predetermined threshold, the mask signal of the road being generated based on the retained energy values.
Claim 4
Dependent Claim
23 words
The method according to claim 1, wherein the steps of analyzing the luminance information and analyzing the chrominance information are executed in parallel.
Claim 5
Dependent Claim
23 words
The method according to claim 1, wherein the steps of analyzing the luminance information and analyzing the chrominance information are executed in parallel.
Claim 6
Independent Claim
178 words
A system of analyzing sequences of image video signals, taken by a camera on board a vehicle, for extracting a contour of a road from the image video signals, comprising: first analyzing means for analyzing luminance information of the image video signals to extract contours and regions from the image video signals to generate a mask signal of the road; second analyzing means for analyzing color information of the image video signals, the second analyzing means comprising, means for determining average blue, red and green components for points in the image video signals, means for comparing the average blue components with the average red and green components for the points in the image video signals, and means for determining points at which a deviation between the average blue components and the average red or green components in the image video signals exceeds a first predetermined threshold; and combining means for combining the mask signal of the road from the analyzed luminance information with the determined points from the analyzed color information to extract the contour of the road.
Claim 7
Independent Claim
178 words
A system of analyzing sequences of image video signals, taken by a camera on board a vehicle, for extracting a contour of a road from the image video signals, comprising: first analyzing means for analyzing luminance information of the image video signals to extract contours and regions from the image video signals to generate a mask signal of the road; second analyzing means for analyzing color information of the image video signals, the second analyzing means comprising, means for determining average blue, red and green components for points in the image video signals, means for comparing the average blue components with the average red and green components for the points in the image video signals, and means for determining points at which a deviation between the average blue components and the average red or green components in the image video signals exceeds a first predetermined threshold; and combining means for combining the mask signal of the road from the analyzed luminance information with the determined points from the analyzed color information to extract the contour of the road.
Claim 8
Dependent Claim
136 words
A system according to claim 5, wherein the analyzing means for analyzing the luminance information further comprises: calculating means for calculating gradients of the luminance information of the image video signals, the gradients having amplitudes, the amplitudes of the gradients constituting an image of contours formed of a plurality of image points from the amplitudes of the gradients of the luminance information, and for generating energy values of the energy of each of the plurality of image points based on the image of contours; and thresholding means for thresholding the energy values of each of the plurality of image points by comparing the energy values with a second predetermined threshold, and retaining only the energy values which exceed the second predetermined threshold, the mask signal of the road being generated based on the retained energy values.
Claim 9
Dependent Claim
29 words
The method according to claim 6, wherein the first analyzing means for analyzing the luminance information and the second analyzing means for analyzing the chrominance information operate in parallel.
Claim 10
Dependent Claim
29 words
The method according to claim 5, wherein the first analyzing means for analyzing the luminance information and the second analyzing means for analyzing the chrominance information operate in parallel.
References Cited (Backward Citations)
US4630109A
Cited
US4926346A
Cited
US4797738A
Cited
EP0361914A2
Cited
US5122957A
Cited
US4970653A
Cited
US5247583A
Cited
US5220508A
Cited
US5172423A
Cited
US5307419A
Cited
US5301239A
Cited
US5535314A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-01-05 | 2001-07-07 | 2002-01-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-01-05 | 2005-07-07 | 2006-01-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-01-05 | 2009-07-07 | 2010-01-06 | $7700.00 | Window Closed / Lapsed |