US5987174A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image processing apparatus for vehicles
Assignee: Hitachi Ltd
•
Filing: 1996-04-25
•
Granted: 1999-11-16
•
Expires: 2016-04-25
Abstract
Abstract An image pickup unit (2) mounted on a vehicle shoots an image in front thereof to attain image information. An edge pixel extraction section (40202 to 40206) scans the obtained image information for each line and then checks boundaries between a particular color and the other colors to extract pixels having the particular color as edge pixels. Moreover, a candidate line extraction section (40208 to 40212) references position coordinates of the extracted edge pixels such that assuming the edge pixels to be classified to configure straight lines, the edge pixels are coupled with each other to configure straight lines according to the classification so as to obtain the straight lines as candidate lines. Thereafter, a line selection section (40212) selects a left line and a right line in front of the vehicle from the plural candidate lines, thereby attaining the left and right lines.
Inventors
- 👤 Kazuto Nakamura
- 👤 Kazuaki Takano
- 👤 Tatsuhiko Monji
- 👤 Eiryo Ondo
- 👤 Yasunari Tanaka
- 👤 Kazuhiko Hanawa
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 05:07
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/10; G06T7/12; G06V; G06V10/00; G06V10/40; G06V10/44; G06V10/56; G06V20/00; G06V20/50; G06V20/56; G06V20/588; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/30; G06T2207/30248; G06T2207/30252; G06T2207/30256
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
205 words
An image processing apparatus, comprising: image pickup means mounted on a vehicle for shooting an image in front of the vehicle to attain image information; edge pixel extraction means for scanning for each line the image information of an image in front of the vehicle obtained through the shooting operation by the image pickup means, checking boundaries between a particular color and other colors, and extracting pixels having the particular color as edge pixels; candidate line extraction means for referencing position coordinates of the extracted edge pixels, assuming the edge pixels to be classified into straight lines, obtaining straight lines by coupling the edge pixels corresponding to respective results of the classification, and setting the obtained straight lines as candidate lines wherein multiple candidate lines are obtained for at least one of a left and a right line; line selection means for selecting the left line and the right line in front of the vehicle from the candidate lines; and wherein the line selection means includes means for selecting two of the candidate lines which have the largest numbers of edge pixels on the left and right sides of the image information of the vehicle as the left and right lines of the vehicle, respectively.
Claim 2
Dependent Claim
205 words
An image processing apparatus, comprising: image pickup means mounted on a vehicle for shooting an image in front of the vehicle to attain image information; edge pixel extraction means for scanning for each line the image information of an image in front of the vehicle obtained through the shooting operation by the image pickup means, checking boundaries between a particular color and other colors, and extracting pixels having the particular color as edge pixels; candidate line extraction means for referencing position coordinates of the extracted edge pixels, assuming the edge pixels to be classified into straight lines, obtaining straight lines by coupling the edge pixels corresponding to respective results of the classification, and setting the obtained straight lines as candidate lines wherein multiple candidate lines are obtained for at least one of a left and a right line; line selection means for selecting the left line and the right line in front of the vehicle from the candidate lines; and wherein the line selection means includes means for selecting two of the candidate lines which have the largest numbers of edge pixels on the left and right sides of the image information of the vehicle as the left and right lines of the vehicle, respectively.
Claim 3
Dependent Claim
42 words
An image processing apparatus according to claim 1, wherein the line selection means includes means operative in an operation to select the left and right lines for selecting as the left and right lines two candidate lines satisfying a particular positional relationship.
Claim 4
Dependent Claim
74 words
An image processing apparatus according to claim 2, wherein the line selection means includes means operative in an operation to select the left and right lines by assuming a particular horizontal line which is parallel to a horizontal direction of the front image information and which has a particular length for selecting as the left and right lines two candidate lines arranged to be brought into contact with both ends of the horizontal line.
Claim 5
Dependent Claim
269 words
An image processing apparatus, comprising: image pickup means mounted on a vehicle for shooting an image in front of the vehicle to attain image information; edge pixel extraction means for scanning for each line the image information of an image in front of the vehicle obtained through the shooting operation by the image pickup means, checking boundaries between a particular color and other colors, and extracting pixels having the particular color as edge pixels; candidate line extraction means for referencing position coordinates of the extracted edge pixels, assuming the edge pixels to be classified into straight lines, obtaining straight lines by coupling the edge pixels corresponding to respective results of the classification, and setting the obtained straight lines as candidate lines wherein multiple candidate lines are obtained for at least one of a left and a right line; line selection means for selecting the left line and the right line in front of the vehicle from the candidate lines; and wherein the line selection means includes means for selecting as one of the lines of the vehicle, namely, a selection line, one of the candidate lines having the largest number of edge pixels on the left or right side of the image information and selecting, in an operation to select the other line by assuming a particular horizontal line which is parallel to a horizontal direction of the front image information and which has a particular length, as the other line a candidate line arranged to be brought into contact with an end of the horizontal line when the selection line is most close to the other end thereof.
Claim 6
Dependent Claim
269 words
An image processing apparatus, comprising: image pickup means mounted on a vehicle for shooting an image in front of the vehicle to attain image information; edge pixel extraction means for scanning for each line the image information of an image in front of the vehicle obtained through the shooting operation by the image pickup means, checking boundaries between a particular color and other colors, and extracting pixels having the particular color as edge pixels; candidate line extraction means for referencing position coordinates of the extracted edge pixels, assuming the edge pixels to be classified into straight lines, obtaining straight lines by coupling the edge pixels corresponding to respective results of the classification, and setting the obtained straight lines as candidate lines wherein multiple candidate lines are obtained for at least one of a left and a right line; line selection means for selecting the left line and the right line in front of the vehicle from the candidate lines; and wherein the line selection means includes means for selecting as one of the lines of the vehicle, namely, a selection line, one of the candidate lines having the largest number of edge pixels on the left or right side of the image information and selecting, in an operation to select the other line by assuming a particular horizontal line which is parallel to a horizontal direction of the front image information and which has a particular length, as the other line a candidate line arranged to be brought into contact with an end of the horizontal line when the selection line is most close to the other end thereof.
Claim 7
Dependent Claim
169 words
An image processing apparatus for identifying a line of vehicle disposed on a running road surface according to color image data of the road surface, comprising: color image pickup means for shooting an image in front of a vehicle along a running direction thereof; edge pixel extraction means for scanning for each line the image data of an image in front of the vehicle obtained through the shooting operation by the color image pickup means, checking boundaries between a particular color and other colors, obtaining pixels having the particular color as edge pixels, and extracting pixels satisfying a particular extraction color condition from the obtained edge pixels; color sampling means for sampling color data of the decided pixels from a single screen of the image data; extraction condition decision means for determining the extraction color condition according to the sampled color data; and line image extraction means for attaining as a line of the vehicle a line image configured by coupling the extracted edge pixels into a straight line.
Claim 8
Dependent Claim
169 words
An image processing apparatus for identifying a line of vehicle disposed on a running road surface according to color image data of the road surface, comprising: color image pickup means for shooting an image in front of a vehicle along a running direction thereof; edge pixel extraction means for scanning for each line the image data of an image in front of the vehicle obtained through the shooting operation by the color image pickup means, checking boundaries between a particular color and other colors, obtaining pixels having the particular color as edge pixels, and extracting pixels satisfying a particular extraction color condition from the obtained edge pixels; color sampling means for sampling color data of the decided pixels from a single screen of the image data; extraction condition decision means for determining the extraction color condition according to the sampled color data; and line image extraction means for attaining as a line of the vehicle a line image configured by coupling the extracted edge pixels into a straight line.
Claim 9
Dependent Claim
31 words
An image processing apparatus according to claim 5, wherein the extraction color condition means includes means for deciding the sample pixel positions according to road surface data representing the recognized line.
Claim 10
Dependent Claim
66 words
An image processing apparatus according to claim 5, further including: means for deciding an illumination environment of the running road surface according to the sampled color data; and means responsive to a result of the decision for controlling a state of an iris of an optical system disposed in the color image pickup means and a color conversion gain of an image data processing system thereof.
Claim 11
Dependent Claim
36 words
An image processing apparatus according to claim 5, further including means for updating the extraction color condition according to a state of the sampled color data and a number of pixels satisfying the extraction color condition.
Claim 12
Dependent Claim
70 words
An image processing apparatus according to claim 5, wherein the line selection means includes means for selecting, in an operation to select either one of the left and right lines by assuming a central perpendicular line of front image information, as a line of the vehicle, one of the candidate lines which has the largest number of edge pixels on the left or right side of the central perpendicular line.
Claim 13
Dependent Claim
42 words
An image processing apparatus according to claim 9, wherein the line selection means includes means operative in an operation to select the left and right lines for selecting as the left and right lines two candidate lines satisfying a particular positional relationship.
Claim 14
Dependent Claim
74 words
An image processing apparatus according to claim 10, wherein the line selection means includes means operative in an operation to select the left and right lines by assuming a particular horizontal line which is parallel to a horizontal direction of the front image information and which has a particular length for selecting as the left and right lines two candidate lines arranged to be brought into contact with both ends of the horizontal line.
Claim 15
Dependent Claim
129 words
An image processing apparatus according to claim 9, wherein the line selection means includes means for selecting as one of the lines of the vehicle, namely, a selection line by assuming a central perpendicular line of front image information, one of the candidate lines having the largest number of edge pixels on the left or right side of the central perpendicular line and selecting, in an operation to select the other line by assuming a particular horizontal line which is parallel to a horizontal direction of the front image information and which has a particular length, as the other line a candidate line arranged to be brought into contact with an end of the horizontal line when the selection line is brought into contact with the other end thereof.
Claim 16
Dependent Claim
220 words
An image processing apparatus, comprising: image pickup means for shooting an image to attain image information; image magnification process means for magnifying a size of the obtained image information; edge pixel coordinate sense means for scanning for each line the magnified image information, checking boundaries between a particular color and other colors, and extracting pixels on the boundaries, and obtaining position coordinates of the extracted edge pixels; edge pixel coordinate conversion means for converting the position coordinates of the extracted edge pixels into coordinates before the magnification process; line image extraction means for referencing the converted coordinates of the edge pixels and coupling the edge pixels into a straight line, thereby attaining a line image; and magnifying condition storage means for storing therein a zoom rate as a magnitude of magnification of the image information and a magnification center coordinate indicating a reference position for the execution of the magnification process of the image information, the magnification factor and the magnification center coordinate being defined for each horizontal line, wherein the image magnification process means includes means for referencing storage contents in the magnifying condition storage means and magnifying for each horizontal line the size of the image information with the magnification center coordinate set to a center of magnification according to a magnification factor indicated by the zoom rate.
Claim 17
Dependent Claim
220 words
An image processing apparatus, comprising: image pickup means for shooting an image to attain image information; image magnification process means for magnifying a size of the obtained image information; edge pixel coordinate sense means for scanning for each line the magnified image information, checking boundaries between a particular color and other colors, and extracting pixels on the boundaries, and obtaining position coordinates of the extracted edge pixels; edge pixel coordinate conversion means for converting the position coordinates of the extracted edge pixels into coordinates before the magnification process; line image extraction means for referencing the converted coordinates of the edge pixels and coupling the edge pixels into a straight line, thereby attaining a line image; and magnifying condition storage means for storing therein a zoom rate as a magnitude of magnification of the image information and a magnification center coordinate indicating a reference position for the execution of the magnification process of the image information, the magnification factor and the magnification center coordinate being defined for each horizontal line, wherein the image magnification process means includes means for referencing storage contents in the magnifying condition storage means and magnifying for each horizontal line the size of the image information with the magnification center coordinate set to a center of magnification according to a magnification factor indicated by the zoom rate.
Claim 18
Dependent Claim
27 words
An image processing apparatus according to claim 13, wherein the image magnification process means includes means for magnifying the obtained image information only in the horizontal direction.
Claim 19
Dependent Claim
29 words
An image processing apparatus according to claim 13, wherein the magnifying condition storage means stores therein values of the zoom rate, the values continuously varying for each horizontal line.
Claim 20
Dependent Claim
55 words
An image processing apparatus according to claim 13, wherein the line extraction means includes means for obtaining, as the magnification center coordinate of each horizontal line, a center position of a vehicle running lane enclosed with the left and right lines in each horizontal line and storing the coordinate in the magnifying condition storage means.
Claim 21
Dependent Claim
60 words
An image processing apparatus according to claim 13, wherein the magnifying condition storage means beforehand stores therein values of the zoom rate, the value for horizontal lines existing above a particular horizontal line in the perpendicular direction being different from that for horizontal lines including the particular horizontal line and existing below the particular horizontal line in the perpendicular direction.
Claim 22
Dependent Claim
29 words
An image processing apparatus according to claim 14, wherein the magnifying condition storage means stores therein values of the zoom rate, the values continuously varying for each horizontal line.
Claim 23
Dependent Claim
63 words
An image processing apparatus according to claim 14, wherein the line extraction means includes means responsive to the coordinate data of extracted lines obtained by the process in a previous line extraction cycle for attaining a zoom rate and a magnification center coordinate for each horizontal line and storing the zoom rate and the magnification center coordinate in the magnifying condition storage means.
Claim 24
Dependent Claim
65 words
An image processing apparatus according to claim 14, wherein the line extraction means includes means for obtaining, according to a value obtained by dividing a predetermined screen width by a width of a vehicle running lane enclosed with the left and right lines in each horizontal line, the zoom rate for each horizontal line and storing the zoom rate in the magnifying condition storage means.
Claim 25
Dependent Claim
55 words
An image processing apparatus according to claim 15, wherein the line extraction means includes means for obtaining, as the magnification center coordinate of each horizontal line, a center position of a vehicle running lane enclosed with the left and right lines in each horizontal line and storing the coordinate in the magnifying condition storage means.
Claim 26
Dependent Claim
60 words
An image processing apparatus according to claim 14, wherein the magnifying condition storage means beforehand stores therein values of the zoom rate, the value for horizontal lines existing above a particular horizontal line in the perpendicular direction being different from that for horizontal lines including the particular horizontal line and existing below the particular horizontal line in the perpendicular direction.
Claim 27
Dependent Claim
228 words
An image processing apparatus, comprising: image pickup means mounted on a vehicle for shooting an image in front thereof to attain image information; image magnification process means for magnifying a size of the obtained image information; edge pixel coordinate sense means for scanning for each line the magnified image information, checking boundaries between a particular color and other colors, and extracting pixels on the boundaries, and obtaining position coordinates of the extracted edge pixels; edge coordinate conversion means for converting the position coordinates of the extracted edge pixels into coordinates before the magnification process; and line extraction means for referencing the converted coordinates of the edge pixels and coupling the edge pixels into a straight line, thereby attaining the left and right lines and magnifying condition storage means for storing therein a zoom rate as a magnitude of magnification of the image information and a magnification center coordinate indicating a reference position for the execution of the magnification process of the image information, the zoom rate and the magnification center coordinate being defined for each horizontal line, wherein the image magnification process means includes means for referencing storage contents in the magnifying condition storage means and magnifying for each horizontal line the size of the image information with the magnification center coordinate set to a center of magnification according to a magnification factor indicated by the zoom rate.
Claim 28
Dependent Claim
228 words
An image processing apparatus, comprising: image pickup means mounted on a vehicle for shooting an image in front thereof to attain image information; image magnification process means for magnifying a size of the obtained image information; edge pixel coordinate sense means for scanning for each line the magnified image information, checking boundaries between a particular color and other colors, and extracting pixels on the boundaries, and obtaining position coordinates of the extracted edge pixels; edge coordinate conversion means for converting the position coordinates of the extracted edge pixels into coordinates before the magnification process; and line extraction means for referencing the converted coordinates of the edge pixels and coupling the edge pixels into a straight line, thereby attaining the left and right lines and magnifying condition storage means for storing therein a zoom rate as a magnitude of magnification of the image information and a magnification center coordinate indicating a reference position for the execution of the magnification process of the image information, the zoom rate and the magnification center coordinate being defined for each horizontal line, wherein the image magnification process means includes means for referencing storage contents in the magnifying condition storage means and magnifying for each horizontal line the size of the image information with the magnification center coordinate set to a center of magnification according to a magnification factor indicated by the zoom rate.
Claim 29
Dependent Claim
63 words
An image processing apparatus according to claim 23, wherein the line extraction means includes means responsive to the coordinate data of extracted lines obtained by the process in a previous line extraction cycle for attaining a zoom rate and a magnification center coordinate for each horizontal line and storing the zoom rate and the magnification center coordinate in the magnifying condition storage means.
Claim 30
Dependent Claim
65 words
An image processing apparatus according to claim 23, wherein the line extraction means includes means for obtaining, according to a value obtained by dividing a predetermined screen width by a width of a vehicle running lane enclosed with the left and right lines in each horizontal line, the zoom rate for each horizontal line and storing the zoom rate in the magnifying condition storage means.
Claim 31
Dependent Claim
27 words
An image processing apparatus according to claim 23, wherein the image magnification process means includes means for magnifying the obtained image information only in the horizontal direction.
Claim 32
Dependent Claim
29 words
An image processing apparatus according to claim 23, wherein the magnifying condition storage means stores therein values of the zoom rate, the values continuously varying for each horizontal line.
Claim 33
Dependent Claim
55 words
An image processing apparatus according to claim 23, wherein the line extraction means includes means for obtaining, as the magnification center coordinate of each horizontal line, a center position of a vehicle running lane enclosed with the left and right lines in each horizontal line and storing the coordinate in the magnifying condition storage means.
Claim 34
Dependent Claim
60 words
An image processing apparatus according to claim 23, wherein the magnifying condition storage means beforehand stores therein values of the zoom rate, the value for horizontal lines existing above a particular horizontal line in the perpendicular direction being different from that for horizontal lines including the particular horizontal line and existing below the particular horizontal line in the perpendicular direction.
References Cited (Backward Citations)
JPS62221800A
Cited
EP0390583A2
Cited
JPH03194670A
Cited
JPH04134503A
Cited
US5307419A
Cited
JPH04273587A
Cited
JPH06124340A
Cited
JPH06229760A
Cited
US5555312A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-11-15 | 2003-05-17 | 2003-11-16 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-11-15 | 2007-05-17 | 2007-11-16 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-11-15 | 2011-05-17 | 2011-11-16 | $7700.00 | Window Closed / Lapsed |