US5923027A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Moisture sensor and windshield fog detector using an image sensor
Assignee: Gentex Corp
•
Filing: 1997-09-16
•
Granted: 1999-07-13
•
Expires: 2017-09-16
Abstract
Abstract A control system for automatically detecting moisture on the windshield of a vehicle. The automatic moisture detecting system includes an optical system for imaging a portion of the windshield on to an image array sensor, such as a CMOS active pixel sensor. The voltages of each of the pixels which represents the illumination level is converted to a corresponding gray scale value by an analog digital converter. The gray scale values corresponding to the image are stored in memory. The spatial frequency composition of the gray scale values are analyzed to determine the amount of rain present. In order to provide a control signal to control the operation of the windshield wipers of the vehicle as a function of the amount of moisture present. The system is also adapted to detect the level of fog both on the interior of the windshield as well as the exterior of the windshield. By providing a system for automatically detecting the presence of fog on the interior and exterior of the windshield, serious performance limitations of known automatic rain sensors are eliminated.
Inventors
- 👤 Joseph S. Stam
- 👤 Jon H. Bechtel
- 👤 John K. Roberts
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 19:31
CPC Classifications
G; G06; G06V; G06V20/00; G06V20/50; G06V20/56; B; B60; B60S; B60S1/00; B60S1/02; B60S1/04; B60S1/06; B60S1/08; B60S1/0818; B60S1/0822; B60S1/0833; B60S1/0844; B60S1/0874; B60S1/0885; B60S1/0888; G06T; G06T7/00; G06T7/40; G06T7/41; G06T7/42; H; H04; H04N; H04N23/00; G06T2207/00; G06T2207/20; G06T2207/20048; G06T2207/20056; G06T2207/30; G06T2207/30248; G06T2207/30252; Y; Y10; Y10S; Y10S15/00; Y10S15/15; Y10S318/00; Y10S318/02
Claims Analysis
Total Claims: 47
Claim 1
Independent Claim
76 words
A system for detecting moisture on a surface comprising: an image sensor; an optical system operable to image a portion of the surface onto the image sensor, to focus objects at the surface onto the image sensor, and to blur objects away from the surface; and a processor in communication with the image sensor, the processor operative to determine spatial composition of the image whereby a signal may be generated based on the determined spatial composition.
Claim 2
Independent Claim
76 words
A system for detecting moisture on a surface comprising: an image sensor; an optical system operable to image a portion of the surface onto the image sensor, to focus objects at the surface onto the image sensor, and to blur objects away from the surface; and a processor in communication with the image sensor, the processor operative to determine spatial composition of the image whereby a signal may be generated based on the determined spatial composition.
Claim 3
Dependent Claim
18 words
The system for detecting moisture on a surface as in claim 1, the surface comprising a vehicle window.
Claim 4
Dependent Claim
43 words
The system for detecting moisture on a surface as in claim 1, the system further comprising an electrochromic window disposed between the surface and the imaging optical system, the electrochromic window operative to reduce the amount of light imaged by the image sensor.
Claim 5
Dependent Claim
21 words
The system for detecting moisture on a surface as in claim 1, the image sensor comprising a CMOS active pixel sensor.
Claim 6
Dependent Claim
54 words
The system for detecting moisture on a surface as in claim 1, the image sensor comprised of a plurality of pixel sensors, each pixel sensor operative to produce an analog signal indicative of a pixel illumination level, the system further comprising an analog-to-digital converter for determining a gray scale value from the illumination level.
Claim 7
Dependent Claim
33 words
The system for detecting moisture on a surface as in claim 5, the image sensor having a variable integration time, the system operable to control the variable integration time of the image sensor.
Claim 8
Dependent Claim
32 words
The system for detecting moisture on a surface as in claim 5, the processor operable to determine image spatial composition by high pass digital filtering of a set of gray scale values.
Claim 9
Dependent Claim
23 words
The system for detecting moisture on a surface as in claim 7, wherein high pass digital filtering is accomplished using a Laplacian filter.
Claim 10
Dependent Claim
26 words
The system for detecting moisture on a surface as in claim 1, the system further including an illuminator to illuminate the imaged portion of the window.
Claim 11
Dependent Claim
64 words
The system for detecting moisture on a surface as in claim 1, the vehicle having a wiper for wiping the surface along a path, the wiper driven by a wiper motor, the system further comprising a wiper motor control in communication with the processor and the wiper motor, wherein the generated signal is based on the determined spatial composition used to control the wiper.
Claim 12
Dependent Claim
49 words
The system for detecting moisture on a surface as in claim 10 wherein the imaged portion of the surface includes the path of the wiper and the processor is further operable to determine if the wiper is in the imaged portion of the surface using the determined spatial composition.
Claim 13
Dependent Claim
59 words
The system for detecting moisture on a surface as in claim 11 wherein the processor is further operative to (a) acquire an image of the surface after the wiper has cleared the imaged portion of the surface; and (b) to determine a zero point using the image acquired after the wiper has cleared the imaged portion of the surface.
Claim 14
Dependent Claim
35 words
The system for detecting moisture on a surface as in claim 11 wherein the processor is further operative to suspend operation of the wiper if the wiper has not been detected within a time frame.
Claim 15
Dependent Claim
26 words
The system for detecting moisture on a surface as in claim 10, the system further comprising a driver on/off sensitivity control in communication with the processor.
Claim 16
Dependent Claim
97 words
The system for detecting moisture on a surface as in claim 1, the system further comprising a light source in communication with the processor for projecting a light spot at the imaged portion of the surface in communication with the processor, the processor further operable to turn on the light source, obtain a first image of the surface with the light source on, turn off the light source, obtain a second image of the surface with the light source off, and determine if moisture is present on the surface using the first image and the second image.
Claim 17
Dependent Claim
19 words
The system for detecting moisture on a surface as in claim 15 wherein the moisture comprises fog or frost.
Claim 18
Dependent Claim
39 words
The system for detecting moisture on a surface as in claim 15 wherein the light source is positioned such that, when moisture is present on the surface, the light spot is reflected into the image sensor field of view.
Claim 19
Dependent Claim
40 words
The system for detecting moisture on a surface as in claim 15 wherein the light source is positioned such that, when moisture is not present on the surface, the light spot is reflected into the image sensor field of view.
Claim 20
Dependent Claim
100 words
The system for detecting moisture on a surface as in claim 15 wherein the surface comprises a window, the window having an interior side and an exterior side, the light source positioned such that the light spot reflected into the image sensor field of view from the interior side is located at a different position on the image sensor than the light spot reflected from the exterior side, the processor further operative to determine the location of moisture on either the interior side or the exterior side from the position of the reflected light spot in the image sensor output.
Claim 21
Dependent Claim
32 words
The system for detecting moisture on a surface as in claim 15 wherein the processor is further operative to create a filtered image containing high frequency components of the image sensor output.
Claim 22
Dependent Claim
22 words
The system for detecting moisture on a surface as in claim 15 wherein the light source comprises a visible light emitting diode.
Claim 23
Dependent Claim
22 words
The system for detecting moisture on a surface as in claim 15 wherein the light source comprises an infrared light emitting diode.
Claim 24
Dependent Claim
58 words
The system for detecting moisture on a surface as in claim 15, the vehicle having a means for clearing frost or fog from the surface, the system further comprising a control in communication with the processor and the clearing means, the processor further operative to control moisture clearing based on the determined presence of moisture on the surface.
Claim 25
Independent Claim
172 words
A system for detecting moisture on a window, the window having an interior surface and an exterior surface, the system comprising: a light source projecting a light spot onto the window; an image sensor; an imaging optical system operable to image a portion of the window including the projected light spot onto the image sensor, to focus objects on the window onto the image sensor, and to blur objects away from the window, wherein the light source is positioned such that the light spot reflected into the image sensor field of view from the interior surface is located at a different position on the image sensor than the light spot reflected from the exterior surface; and a processor in communication with the image sensor and the light source, the processor operative to determine the presence of moisture and to determine the location of moisture on either the interior surface or the exterior surface, whereby a signal may be generated based on the determined presence of moisture and the determined location of moisture.
Claim 26
Independent Claim
172 words
A system for detecting moisture on a window, the window having an interior surface and an exterior surface, the system comprising: a light source projecting a light spot onto the window; an image sensor; an imaging optical system operable to image a portion of the window including the projected light spot onto the image sensor, to focus objects on the window onto the image sensor, and to blur objects away from the window, wherein the light source is positioned such that the light spot reflected into the image sensor field of view from the interior surface is located at a different position on the image sensor than the light spot reflected from the exterior surface; and a processor in communication with the image sensor and the light source, the processor operative to determine the presence of moisture and to determine the location of moisture on either the interior surface or the exterior surface, whereby a signal may be generated based on the determined presence of moisture and the determined location of moisture.
Claim 27
Dependent Claim
61 words
The system for detecting moisture on a window as in claim 24, the light source positioned relative to the window and the imaging optical system such that, when moisture is present on at least one of the interior surface and the exterior surface, the light spot is reflected from the window, through the imaging optical system, and onto the image sensor.
Claim 28
Dependent Claim
53 words
The system for detecting moisture on a window as in claim 24, the light source positioned relative to the window and the imaging optical system such that, when moisture is present on at least one of the interior surface and the exterior surface, the light spot is not reflected onto the image sensor.
Claim 29
Dependent Claim
22 words
The system for detecting moisture on a window as in claim 24 wherein the light source comprises a visible light emitting diode.
Claim 30
Dependent Claim
22 words
The system for detecting moisture on a window as in claim 24 wherein the light source comprises an infrared light emitting diode.
Claim 31
Dependent Claim
59 words
The system for detecting moisture on a window as in claim 24, the vehicle having a means for clearing fog or frost from the window, the system further comprising a control in communication with the processor and the clearing means, the processor further operative to control the clearing means based on the determined presence of moisture on the window.
Claim 32
Dependent Claim
27 words
The system for detecting moisture on a window as in claim 24, the processor further operable to extract high spatial frequency components of the image sensor output.
Claim 33
Independent Claim
60 words
A method for detecting moisture on a surface comprising: acquiring an image of a portion of the surface, the image having objects on the surface in focus and objects away from the surface blurred; generating a signal corresponding to the acquired image; determining spatial high frequency components of the signal; and determining the moisture using the spatial high frequency components.
Claim 34
Independent Claim
60 words
A method for detecting moisture on a surface comprising: acquiring an image of a portion of the surface, the image having objects on the surface in focus and objects away from the surface blurred; generating a signal corresponding to the acquired image; determining spatial high frequency components of the signal; and determining the moisture using the spatial high frequency components.
Claim 35
Dependent Claim
21 words
The method for detecting moisture on a surface as in claim 31 wherein generating the signal comprises digitizing the acquired image.
Claim 36
Dependent Claim
38 words
The method for detecting moisture on a surface as in claim 31 further comprising: determining if a radiative loading greater than a threshold is imaged; and temporarily reducing the radiative loading greater than the threshold from the image.
Claim 37
Dependent Claim
48 words
The method for detecting moisture on a surface as in claim 31 further comprising: determining the amount of light integrated by an image sensor having a variable light integration time; and controlling the variable integration time of the image sensor based on the determined amount of integrated light.
Claim 38
Dependent Claim
31 words
The method for detecting moisture on a surface as in claim 31 wherein determining spatial high frequency components of the digitized signal comprises high pass digital filtering of the digitized signal.
Claim 39
Dependent Claim
23 words
The method for determining moisture on a surface as in claim 31 wherein the high pass digital filtering is accomplished using Laplacian filtering.
Claim 40
Dependent Claim
21 words
The method for detecting moisture on a surface as in claim 31 further comprising illuminating the imaged portion of the surface.
Claim 41
Dependent Claim
54 words
The method for detecting moisture on a surface as in claim 31, the vehicle including a wiper for wiping the surface along a path, the imaged portion of the surface including the path of the wiper wherein the method further comprises detecting the presence of the wiper in the imaged portion of the surface.
Claim 42
Dependent Claim
67 words
The method for detecting moisture on a surface as in claim 38 wherein detecting the presence of the wiper comprises determining if a plurality of high frequency components in the direction of wiper travel through the imaged portion of the surface are greater than a plurality of high frequency components in a direction normal to the direction of wiper travel through the imaged portion of the surface.
Claim 43
Dependent Claim
28 words
The method for detecting moisture on a surface as in claim 39 further comprising controlling the rate of the wiper based on the determined signal representative of moisture.
Claim 44
Dependent Claim
31 words
The method for detecting moisture on a surface as in claim 40 further comprising preventing further operation of the wiper if the wiper has not been detected within a time frame.
Claim 45
Independent Claim
153 words
A method for detecting moisture on a surface, the vehicle having at least one wiper for wiping the surface, the vehicle including an image sensor operable to image the surface in a region covered by the at least one wiper, the method comprising: acquiring an image of the surface, the image having objects at the surface in focus and objects away from the surface blurred; determining a sum, the sum comprising a Laplacian for each pixel; determining a difference of a zero calibration subtracted from the sum; repeating the steps of acquiring the image, determining the sum, and determining the difference if the difference is less than a threshold, otherwise actuating at least one wiper; determining that the at least one actuated wiper has wiped the imaged region of the surface; and determining as the zero calibration the Laplacian of an image taken after the imaged region of the surface has been wiped.
Claim 46
Independent Claim
153 words
A method for detecting moisture on a surface, the vehicle having at least one wiper for wiping the surface, the vehicle including an image sensor operable to image the surface in a region covered by the at least one wiper, the method comprising: acquiring an image of the surface, the image having objects at the surface in focus and objects away from the surface blurred; determining a sum, the sum comprising a Laplacian for each pixel; determining a difference of a zero calibration subtracted from the sum; repeating the steps of acquiring the image, determining the sum, and determining the difference if the difference is less than a threshold, otherwise actuating at least one wiper; determining that the at least one actuated wiper has wiped the imaged region of the surface; and determining as the zero calibration the Laplacian of an image taken after the imaged region of the surface has been wiped.
Claim 47
Dependent Claim
187 words
The method for detecting moisture on a surface as in claim 42 wherein determining that the at least one wiper has wiped the imaged region of the surface comprises: acquiring an image of the surface, the image having objects at the surface in focus and objects away from the surface blurred; determining a first filtered image by passing the image of the surface through a first one-dimensional high pass filter, the one dimension in the direction of wiper travel through the image of the surface; determining a second filtered image by passing the image of the surface through a second one-dimensional high pass filter, the one dimension in the direction normal to the direction of wiper travel through the image of the surface; repeating the steps of acquiring an image of the surface, determining a first filtered image, and determining a second filtered image if a first sum of values of the first filtered image is not greater than a second sum of values of the second filtered image, otherwise delaying for a time to allow the wiper to pass out of the image of the surface.
References Cited (Backward Citations)
GB2056059A
Cited
US4867561A
Cited
US4798956A
Cited
US4859867A
Cited
US4871917A
Cited
US4916374A
Cited
US4973844A
Cited
EP0479169A2
Cited
US5276389A
Cited
US5313072A
Cited
US5796094A
Cited
US5498866A
Cited
US5386111A
Cited
JPH07286130A
Cited
US5796106A
Cited
DE4424454A1
Cited
US5661303A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-07-12 | 2003-01-11 | 2003-07-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-07-12 | 2007-01-11 | 2007-07-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-07-12 | 2011-01-11 | 2011-07-13 | $7700.00 | Window Closed / Lapsed |