US6829388B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System of detecting road white line, method for detecting road white line and storage medium storing program for detecting road white line
Assignee: NEC Corp
•
Filing: 2000-09-05
•
Granted: 2004-12-07
•
Expires: 2020-09-05
Abstract
Abstract A system and method are provided which are capable of reliably and effectively detecting a white line in an upper region of a road image by dividing the road image into, at least, two regions positioned up and down and using a result from a detection of the white line in a lowest region where the road image is less affected by noise. When a road surface is planar, both intersections of straight lines, by which left and right white lines are approximated, in a lowest region out of regions, positioned up and down, obtained by dividing a road image containing left and right white lines drawn in parallel on the road surface and intersections of straight lines, by which left and right white lines are approximated in an upper region of out of the two regions existing on one horizontal line. The left and right first straight lines, by which the left and right white lines are approximated, are detected in the lowest region and a horizontal line is calculated from a first vanishing point being the intersection of the left and right straight lines, and based on a characteristic that the intersection of the left and right straight lines, by which the left and right white lines are approximated, are approximated in the upper region, existing on the horizontal line, the intersection is detected and straight lines, by which the left and right white lines are approximated, is obtained in the upper region.
Inventors
- 👤 Kazuyuki Sakurai
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-08 04:18
CPC Classifications
G; G06; G06V; G06V20/00; G06V20/50; G06V20/56; G06V20/588; G06T; G06T7/00; G06T7/10; G06T7/12; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30248; G06T2207/30252; G06T2207/30256
Claims Analysis
Total Claims: 27
Claim 1
Independent Claim
165 words
A road marking line detecting system for processing a road image to detect a left side edge marking line and a right side edge marking line of a traveling lane in said road image, said system comprising: first means for detecting first left and right straight lines by which the left and the right marking lines are approximated in a lowest region of at least two regions positioned up and down on said road image, the regions obtained by dividing said road image; second means for calculating a horizontal line in a region other than said lowest region in said road image from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and third means for detecting second straight lines, by which the left and the right marking lines are approximated in a region other than said lowest region, by detecting an intersection of said second left and right straight lines on the horizontal line.
Claim 2
Dependent Claim
165 words
A road marking line detecting system for processing a road image to detect a left side edge marking line and a right side edge marking line of a traveling lane in said road image, said system comprising: first means for detecting first left and right straight lines by which the left and the right marking lines are approximated in a lowest region of at least two regions positioned up and down on said road image, the regions obtained by dividing said road image; second means for calculating a horizontal line in a region other than said lowest region in said road image from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and third means for detecting second straight lines, by which the left and the right marking lines are approximated in a region other than said lowest region, by detecting an intersection of said second left and right straight lines on the horizontal line.
Claim 3
Dependent Claim
80 words
The road marking line detecting system according to claim 1 , wherein said third means comprises means for detecting a second vanishing point on said horizontal line in a region adjacent to said lowest region in said road image, based on intercepts at lowest ends of the second left and right straight lines on said first left and right straight lines, said second vanishing point being the intersection of said second left and right straight lines on said horizontal line.
Claim 4
Dependent Claim
81 words
The road white line detecting system according to claim 2 , wherein said third means comprises means for predicting an intersection of third left and right straight lines in an upper region other than said lowest region and not adjacent to said lowest region in said road image, based on an amount of displacement on said horizontal line between intersections of straight lines by which left and right marking lines in two or more regions below said upper region are approximated.
Claim 5
Dependent Claim
198 words
The road marking line detecting system according to claim 3 , further comprising a means for extracting, from said road image, a sequence of points existing on the left and the right marking lines as a sequence of marking line featuring points, together with a marking line filter value showing similarity to said marking line featuring point and wherein said first means comprises a means for detecting straight lines by which said sequence of marking line featuring points is approximated using a least squares method, with weight assigned to said marking line filter value, for left and right sides, as line approximation of marking lines and wherein said third means comprises means for detecting an intersection, on said horizontal line, of left and right second straight lines by which said sequence of marking line featuring points in said region being adjacent to said lowest region is approximated using said least squares method, for both left and right sides, with weight assigned to said marking line filter value and using upper end points, in the lowest region, of said left and right first straight lines as intercepts at lowest ends in said region being adjacent to said lowest region.
Claim 6
Dependent Claim
153 words
A road marking line detecting method for processing a road image to detect a left edge marking line and a right edge marking line of a travelling lane in said road image, said method comprising: detecting first left and right straight lines, by which the left marking line and the right marking line are approximated in a lowest region of at least two regions positioned up and down on said road image, the regions obtained by dividing said road image; calculating a horizontal line from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and detecting second left and right straight lines, by which the left and right marking lines are approximated in an upper region, the upper region being a region other than said lowest region, by detecting an intersection of the second left and right straight lines on said horizontal line.
Claim 7
Dependent Claim
153 words
A road marking line detecting method for processing a road image to detect a left edge marking line and a right edge marking line of a travelling lane in said road image, said method comprising: detecting first left and right straight lines, by which the left marking line and the right marking line are approximated in a lowest region of at least two regions positioned up and down on said road image, the regions obtained by dividing said road image; calculating a horizontal line from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and detecting second left and right straight lines, by which the left and right marking lines are approximated in an upper region, the upper region being a region other than said lowest region, by detecting an intersection of the second left and right straight lines on said horizontal line.
Claim 8
Dependent Claim
113 words
The road marking line detecting method according to claim 5 , wherein said detecting second left and right straight lines comprises detecting a second vanishing point on said horizontal line based on a characteristic that at least in an upper region adjacent to said lowest region, intercepts at lowest ends of second left and right straight lines exist on said first left and right straight lines and that said second vanishing point is the intersection of said second left and right straight lines on said horizontal line, the left and the right marking lines in said region adjacent to said lowest region being approximated based on the second left and right straight lines.
Claim 9
Dependent Claim
97 words
The road marking line detecting method according to claim 6 , wherein said detecting second left and right straight lines comprises a step of predicting an intersection of straight lines by which the left and the right marking lines are approximated, in an upper region other than said lowest region in said road image and not being adjacent to said lowest region, based on an amount of displacement, on said horizontal line, between intersections of straight lines by which the left and the right marking lines in two or more regions below said upper region are approximated.
Claim 10
Dependent Claim
209 words
The road marking line detecting method according to claim 7 , further comprising a step of extracting a sequence of points existing on the left and the right marking line image, from said road image, together with a marking line filter value showing similarity to said marking line featuring points as a sequence of marking line featuring points, and wherein said detecting first left and right straight lines comprises a step of detecting straight lines by which said sequence of marking line featuring points is approximated using said least squares method, with weight assigned to said marking line filter value, as line approximation for left and right sides and wherein said detecting second left and right straight lines comprises a step of detecting an intersection, on said horizontal line, of left and right second straight lines by which said sequence of marking line featuring points in said region being adjacent to said lowest region is approximated by using said least squares method, for both left and right sides, with weight assigned to said marking line filter value, and using upper end points of said left and right first straight lines in said lowest region as intercepts at their lowest ends in said region being adjacent to said lowest region.
Claim 11
Dependent Claim
181 words
A machine readable storage medium storing a program for processing a road image to detect a left edge road marking line and a right edge road marking line of a travelling lane in the road image said program configured to cause a computer to carry out: (a) detecting first left and right straight lines by which the left marking line and the right marking line are approximated in a lowest region of at least two regions positioned up and down on a road image, the regions obtained by dividing said road image; (b) calculating a horizontal line from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and (c) detecting second straight lines by which the left and the right marking lines are approximated in a region other than said lowest region, by detecting an intersection on said horizontal line of the second left and right straight lines by which the left and the right marking lines are approximated in said region other than said lowest region in said road image.
Claim 12
Dependent Claim
181 words
A machine readable storage medium storing a program for processing a road image to detect a left edge road marking line and a right edge road marking line of a travelling lane in the road image said program configured to cause a computer to carry out: (a) detecting first left and right straight lines by which the left marking line and the right marking line are approximated in a lowest region of at least two regions positioned up and down on a road image, the regions obtained by dividing said road image; (b) calculating a horizontal line from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and (c) detecting second straight lines by which the left and the right marking lines are approximated in a region other than said lowest region, by detecting an intersection on said horizontal line of the second left and right straight lines by which the left and the right marking lines are approximated in said region other than said lowest region in said road image.
Claim 13
Dependent Claim
117 words
The storage medium storing the program for detecting the road marking line according to claim 9 , wherein said step (c) comprises detecting a second vanishing point on said horizontal line based on a characteristic that, at least, in a region adjacent to said lowest region of regions other than said lowest region in said road image, intercepts at lowest ends of second left and right straight lines, by which the left and the right marking lines in said region adjacent to said lowest region are approximated, exist on said first left and right straight lines and that said second vanishing point is an intersection on said horizontal line of said second left and right straight lines.
Claim 14
Dependent Claim
98 words
The storage medium storing the program for detecting the road marking line according to claim 10 , wherein said step (c) comprises a step of predicting an intersection of straight lines by which the left and the right marking lines are approximated, in an upper region other than said lowest region in said road image and not being adjacent to said lowest region, based on an amount of displacement, on said horizontal line, between intersections of straight lines by which the left and the right marking lines in two or more regions below said upper regions are approximated.
Claim 15
Dependent Claim
216 words
The storage medium storing the program for detecting the road marking line according to claim 10 , wherein said program comprises a program to cause said computer to carry out a step of extracting, from said road image, a sequence of points existing on the left and the right marking lines as a sequence of marking line featuring points, together with a marking line filter value showing similarity to said marking line featuring points and wherein said step (a) comprises process of detecting straight lines by which said sequence of marking line featuring points is approximated using a least squares method, with weight assigned to said marking line filter value, for left and right sides, as line approximation of marking lines and wherein said step (c) comprises a process of detecting an intersection, on said horizontal line, of left and right second straight lines by which said sequence of marking line featuring points in said region being adjacent to said lowest region is approximated, using said least squares method, for both left and right sides, with weight assigned to said marking line filter value and using upper end points, in said lowest region, of said left and right first straight lines as intercepts at their lowest ends in said region being adjacent to said lowest region.
Claim 16
Dependent Claim
178 words
A road marking line detecting system for processing a road image to detect a left edge marking line and a right edge marking line of a travelling lane in said road image, said system comprising a computer and a program causing said computer to carry: (a) detecting first left and right straight lines, by which the left marking line and the right marking line is approximated in a lowest region of at least two regions positioned up and down in said road image obtained by dividing said road image; (b) calculating a horizontal line from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and (c) detecting second straight lines by which the left and the right marking lines are approximated in a region other than said lowest region, by detecting on said horizontal line an intersection of the second left and right straight lines, by which the left and the right marking lines are approximated in said region other than said lowest region in said road image.
Claim 17
Dependent Claim
178 words
A road marking line detecting system for processing a road image to detect a left edge marking line and a right edge marking line of a travelling lane in said road image, said system comprising a computer and a program causing said computer to carry: (a) detecting first left and right straight lines, by which the left marking line and the right marking line is approximated in a lowest region of at least two regions positioned up and down in said road image obtained by dividing said road image; (b) calculating a horizontal line from a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; and (c) detecting second straight lines by which the left and the right marking lines are approximated in a region other than said lowest region, by detecting on said horizontal line an intersection of the second left and right straight lines, by which the left and the right marking lines are approximated in said region other than said lowest region in said road image.
Claim 18
Dependent Claim
118 words
The road marking line detecting system according to claim 13 , wherein said step (c) comprises a step of detecting a second vanishing point on said horizontal line based on a characteristic that, at least, in a region being adjacent to said lowest region out of regions other than said lowest region in said road image, intercepts at lowest ends of left and right second straight lines by which the left and the right marking lines in said region being adjacent to said lowest region are approximated, exist on said left and right first straight lines and that said second vanishing point being an intersection of said left and right second straight lines exists on said horizontal line.
Claim 19
Dependent Claim
92 words
The road marking line detecting system according to claim 13 , wherein said step (c) comprises a step of predicting an intersection of straight lines by which the left and the right marking lines are approximated, in an upper region other than said lowest region in said road image and not being adjacent to said lowest region, based on an amount of displacement, on said horizontal line, between intersections of straight lines by which the left and the right marking lines in two or more regions below said upper regions are approximated.
Claim 20
Dependent Claim
209 words
The road marking line detecting system according to claim 13 , wherein said program comprises a program to cause said computer to carry out a step of extracting, from said road image, a sequence of points existing on left and right marking lines as a sequence of marking line featuring points, together with a marking line filter value showing similarity to said marking line featuring points and wherein said step (a) comprises a process of detecting straight lines by which said sequence of marking line featuring points is approximated using a least squares method, with weight assigned to said marking line filter value, for left and right sides, as line approximation of marking lines and wherein said step (c) comprises a process of detecting an intersection, on said horizontal line, of left and right second straight lines by which said sequence of marking line featuring points in said region being adjacent to said lowest region is approximated, using said least squares method, for both left and right sides, with weight assigned to said marking line filter value and using upper end points, in said lowest region, of said left and right first straight lines as intercepts at their lowest ends in said region being adjacent to said lowest region.
Claim 21
Dependent Claim
183 words
A road marking line detecting system for processing a road image to detect a virtual left edge marking line and a virtual right edge marking line indicating a travelling lane in said road image, said system including a computer and a program causing said computer to carry out: (a) detecting first left and right first straight lines by which left and right virtual marking lines are approximated in a lowest region of at least two regions positioned up and down on a road image obtained by dividing said road image; (b) calculating a horizontal line from a first vanishing point, the vanishing point being an intersection of said first left and right straight lines; and (c) detecting second left and right straight lines by which the left and the right virtual marking lines are approximated in a region other than said lowest region, by detecting on said horizontal line an intersection of the second left and right straight lines, by which the left and the right virtual marking lines are approximated in said region other than said lowest region in said road image.
Claim 22
Dependent Claim
183 words
A road marking line detecting system for processing a road image to detect a virtual left edge marking line and a virtual right edge marking line indicating a travelling lane in said road image, said system including a computer and a program causing said computer to carry out: (a) detecting first left and right first straight lines by which left and right virtual marking lines are approximated in a lowest region of at least two regions positioned up and down on a road image obtained by dividing said road image; (b) calculating a horizontal line from a first vanishing point, the vanishing point being an intersection of said first left and right straight lines; and (c) detecting second left and right straight lines by which the left and the right virtual marking lines are approximated in a region other than said lowest region, by detecting on said horizontal line an intersection of the second left and right straight lines, by which the left and the right virtual marking lines are approximated in said region other than said lowest region in said road image.
Claim 23
Dependent Claim
113 words
The road marking line detecting system according to claim 17 , wherein said step (c) comprises detecting a second vanishing point on said horizontal line based on a characteristic that, at least, in a region adjacent to said lowest region of regions other than said lowest region in said road image, intercepts at lowest ends of the second left and right straight lines, by which the left and the right virtual marking lines in said region being adjacent to said lowest region are approximated, exist on said first left and right straight lines, said second vanishing point being the intersection of said second left and right second straight lines on said horizontal line.
Claim 24
Dependent Claim
94 words
The road marking line detecting system according to claim 17 , wherein said step (c) comprises a step of predicting an intersection of straight lines by which the left and the right virtual marking lines are approximated, in an upper region other than said lowest region in said road image and not being adjacent to said lowest region, based on an amount of displacement, on said horizontal line, between intersections of straight lines by which the left and the right virtual marking lines in two or more regions below said upper regions are approximated.
Claim 25
Dependent Claim
207 words
A road image processor to detect marking lines based on a road image for determining a travelling lane, said processor comprising: a featuring point extractor configured to construct first left and right straight lines, by which a left marking line and a right marking line are approximated in a lowest region of at least two regions on the road image, the regions obtained by dividing the road image into the lowest region and at least one upper region; a horizontal line calculator configured to calculate a horizontal line near an upper bound of an upper region in the road image, based on a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; an upper region straight line detector configured to detect second left and right straight lines, by which the left marking line and the right marking lines are approximated in the upper region, based on intercepts at the terminal points near a bound of the lowest region of the first left straight line and the first right straight line and based on an intersection of the second left straight line and the second right straight line on the horizontal line, the intersection being a second vanishing point.
Claim 26
Dependent Claim
207 words
A road image processor to detect marking lines based on a road image for determining a travelling lane, said processor comprising: a featuring point extractor configured to construct first left and right straight lines, by which a left marking line and a right marking line are approximated in a lowest region of at least two regions on the road image, the regions obtained by dividing the road image into the lowest region and at least one upper region; a horizontal line calculator configured to calculate a horizontal line near an upper bound of an upper region in the road image, based on a first vanishing point, the first vanishing point being an intersection of said first left and right straight lines; an upper region straight line detector configured to detect second left and right straight lines, by which the left marking line and the right marking lines are approximated in the upper region, based on intercepts at the terminal points near a bound of the lowest region of the first left straight line and the first right straight line and based on an intersection of the second left straight line and the second right straight line on the horizontal line, the intersection being a second vanishing point.
Claim 27
Dependent Claim
87 words
The road image processor of claim 20 , wherein said upper region straight line detector further comprises a vanishing point detector configured to predict another vanishing point at an intersection of third straight lines by which the left marking line and the right marking line are approximated in an upper region other than an upper region adjacent to said lowest region, based on an amount of displacement on the horizontal line, between intersections of second left and right straight lines and first left and right straight lines.
References Cited (Backward Citations)
US5359666A
Cited
JPH05347000A
Cited
JPH0624035A
Cited
US5555555A
Cited
EP0626655A2
Cited
JPH0778234A
Cited
US5739848A
Cited
US6493458B2
Cited
US6163022A
Cited
US6546118B1
Cited
US6549642B1
Cited
US6593960B1
Cited
US6590521B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-12-07 | 2008-06-07 | 2008-12-07 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-12-07 | 2012-06-07 | 2012-12-07 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-12-07 | 2016-06-07 | 2016-12-07 | $7700.00 | Window Closed / Lapsed |