US6370260B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Near-IR human detector
Assignee: Honeywell Inc
•
Filing: 1999-09-03
•
Granted: 2002-04-09
•
Expires: 2019-09-03
Abstract
Abstract An infrared detector having two cameras for viewing a scene to detect humans. The cameras focus the scene on their respective pixel arrays. One array is designed with a filter to be sensitive to light from 0.8 to 1.4 microns and the array of the other camera is designed with a filter to be sensitive from 1.4 microns to 2.2 microns. The arrays are co-registered spacially and temporally relative to the viewed scene and pixel transmission dynamics. The spectral powers of the pixels from both arrays are difference weighted and fused into one set of pixels. The fused pixels are thresholded into another set of pixels that have one of two values-black or white. These pixels are entered into a visual display that shows a segment image of a human if in the viewed scene.
Inventors
- 👤 Ioannis Pavlidis
- 👤 Peter F. Symosek
- 👤 Bernard S. Fritz
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 17:55
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V10/00; G06V10/10; G06V10/12; G06V10/14; G06V10/143
Claims Analysis
Total Claims: 41
Claim 1
Independent Claim
159 words
A human detector for use in detecting a human in a scene, the detector comprising: a first camera sensitive to a first band of wavelengths within a reflected infrared radiation range and operable to provide a first image output representative of the scene; a second camera sensitive to a second band of wavelengths within the reflected infrared radiation range and operable to provide a second image output representative of the scene; a fuser connected to said first and second cameras operable on the first image output and the second image output to provide a fused image output having an increased contrast between a human and a background in the scene; a thresholder connected to said fuser operable on the fused image output for use in segmenting a detected human from the scene, the thresholder providing a thresholded output; and an image indicator connected to said thresholder and operable on the thresholded output to detect a human in the scene.
Claim 2
Dependent Claim
159 words
A human detector for use in detecting a human in a scene, the detector comprising: a first camera sensitive to a first band of wavelengths within a reflected infrared radiation range and operable to provide a first image output representative of the scene; a second camera sensitive to a second band of wavelengths within the reflected infrared radiation range and operable to provide a second image output representative of the scene; a fuser connected to said first and second cameras operable on the first image output and the second image output to provide a fused image output having an increased contrast between a human and a background in the scene; a thresholder connected to said fuser operable on the fused image output for use in segmenting a detected human from the scene, the thresholder providing a thresholded output; and an image indicator connected to said thresholder and operable on the thresholded output to detect a human in the scene.
Claim 3
Dependent Claim
16 words
The detector of claim 1 , wherein said first and second cameras have the same fields-of-view.
Claim 4
Dependent Claim
36 words
The detector of claim 2 , wherein: said first camera has its field of view focused on a first sensing array; and said second camera has its field of view focused on a second sensing array.
Claim 5
Dependent Claim
76 words
The detector of claim 3 , wherein: the first sensing array comprises m×n pixels; the second sensing array comprises m×n pixels; each pixel of said first sensing array is designated as (i,j) 1 , where i ranges from 1 to m and j ranges from 1 to n; and each pixel of said second sensing array is designated as (i,j) 2 , where i ranges from 1 to m and j ranges from 1 to n.
Claim 6
Dependent Claim
42 words
The detector of claim 4 , wherein: a spectral power of a pixel from the first sensing array is designated as P(i,j) 1 ; and a spectral power of a pixel from the second sensing array is designated as P(i,j) 2 .
Claim 7
Dependent Claim
68 words
The detector of claim 5 , wherein: said fuser fuses the spectral power P(i,j) 1 of each pixel of the first sensing array with the spectral power P(i,j) 2 of each corresponding pixel of the second sensing array; and an output of said fuser is a spectral power of each fused pixel P(i,j) f that is a fusion of the spectral powers P(i,j) 1 and P(i,j) 2 .
Claim 8
Dependent Claim
19 words
The detector of claim 6 , wherein: P(i,j) f =P(i,j) 1 −C*P(i,j) 2 ; and C is a constant.
Claim 9
Dependent Claim
29 words
The detector of claim 7 , wherein said thresholder processes the spectral power P(i,j) f of each fused pixel into a spectral power P(i,j) t of a threshold pixel.
Claim 10
Dependent Claim
36 words
The detector of claim 8 , wherein: P(i,j) t is equal to a first value or a second value; the first value is a minimum spectral power; and the second value is a maximum spectral power.
Claim 11
Dependent Claim
41 words
The detector of claim 9 , wherein: P(i,j) t is equal to the first value if P(i,j) f is below a threshold value; and P(i,j) t is equal to the second value if P (i,j) f is above the threshold value.
Claim 12
Dependent Claim
21 words
The detector of claim 10 , wherein a wavelength between the first and second bands of wavelengths is about 1.4 microns.
Claim 13
Dependent Claim
46 words
The detector of claim 11 , wherein: a histogram reveals a numerical distribution of pixels over a range of spectral powers P (i,j) f for each frame; and the threshold value is a spectral power selected between two most populous distributions of pixels on the histogram.
Claim 14
Dependent Claim
20 words
The detector of claim 12 , wherein C is selected according to lighting conditions of a scene within the fields-of-view.
Claim 15
Dependent Claim
15 words
The detector of claim 13 , further comprising an image indicator connected to said thresholder.
Claim 16
Dependent Claim
33 words
The detector of claim 14 , wherein: the first band of wavelengths is between about 0.8 and 1.4 microns; and the second band of wavelengths is between about 1.4 microns and 2.2 microns.
Claim 17
Dependent Claim
170 words
A human detector comprising: first camera means for sensing radiation of a scene within a first band of wavelengths in a reflected infrared radiation range; second camera means for sensing radiation of the scene within a second band of wavelengths in the reflected infrared radiation range; fusing means connected to said first and second camera means for fusing spectral powers P(i,j) 1 of pixels (i,j) 1 from said first camera means with spectral powers P(i,j) 2 of corresponding pixels (i,j) 2 from said second camera means, resulting in fused spectral powers P(i,j) f ; and thresholding means, connected to said fusing means, for thresholding fused spectral powers P(i,j) f from said fusing means, resulting in threshold spectral powers P(i,j) t ; and wherein: the scene is focused by said first camera means on a first sensing array having m×n pixels; the scene is focused by said second camera means on a second sensing array having m×n pixels; each pixel is located at ith row and jth column; 0<i≦m; and 0<j≦n.
Claim 18
Dependent Claim
170 words
A human detector comprising: first camera means for sensing radiation of a scene within a first band of wavelengths in a reflected infrared radiation range; second camera means for sensing radiation of the scene within a second band of wavelengths in the reflected infrared radiation range; fusing means connected to said first and second camera means for fusing spectral powers P(i,j) 1 of pixels (i,j) 1 from said first camera means with spectral powers P(i,j) 2 of corresponding pixels (i,j) 2 from said second camera means, resulting in fused spectral powers P(i,j) f ; and thresholding means, connected to said fusing means, for thresholding fused spectral powers P(i,j) f from said fusing means, resulting in threshold spectral powers P(i,j) t ; and wherein: the scene is focused by said first camera means on a first sensing array having m×n pixels; the scene is focused by said second camera means on a second sensing array having m×n pixels; each pixel is located at ith row and jth column; 0<i≦m; and 0<j≦n.
Claim 19
Dependent Claim
18 words
The detector of claim 16 , further comprising indicating means for displaying a segmented image of the scene.
Claim 20
Dependent Claim
28 words
The detector of claim 16 , wherein: P(i,j) f =P(i,j) 1 −C*P(i,j) 2 ; and C is a constant determined according to a lighting condition of the scene.
Claim 21
Dependent Claim
41 words
The detector of claim 18 , wherein: P(i,j) t =V 1 if P(i,j) f >T; P(i,j) t =V 2 if P(i,j) f <T; V 1 is a first value; V 2 is a second value, and T is a threshold value.
Claim 22
Dependent Claim
21 words
The detector of claim 19 , wherein T is determined by a spectral power distribution of fused pixels (i,j) f .
Claim 23
Dependent Claim
21 words
The detector of claim 20 , wherein a wavelength between the first and second bands of wavelengths is about 1.4 microns.
Claim 24
Dependent Claim
33 words
The detector of claim 21 , wherein: the first band of wavelengths is between about 0.8 and 1.4 microns; and the second band of wavelengths is between about 1.4 microns and 2.2 microns.
Claim 25
Independent Claim
151 words
A method for detecting humans, comprising: focusing a scene on a first m×n pixel array that is sensitive to light of a first bandwidth within a reflected infrared radiation range; focusing the scene on a second m×n pixel array that is sensitive to light of a second bandwidth within the reflected infrared radiation range; fusing a spectral power P(i,j) 1 of each pixel of the first m×n pixel array with a spectral power P(i,j) 2 of each corresponding pixel of the second m×n pixel array, to result in a spectral power P(i,j) f of a fused pixel, respectively; thresholding the spectral power P(i,j) f of each fused pixel into a first value if the spectral power is greater than a threshold value; and; thresholding the spectral power P(i,j) f of each fused pixel into a second value if the spectral power is less than the threshold value; wherein: 0<i≦m; and 0<j≦n.
Claim 26
Independent Claim
151 words
A method for detecting humans, comprising: focusing a scene on a first m×n pixel array that is sensitive to light of a first bandwidth within a reflected infrared radiation range; focusing the scene on a second m×n pixel array that is sensitive to light of a second bandwidth within the reflected infrared radiation range; fusing a spectral power P(i,j) 1 of each pixel of the first m×n pixel array with a spectral power P(i,j) 2 of each corresponding pixel of the second m×n pixel array, to result in a spectral power P(i,j) f of a fused pixel, respectively; thresholding the spectral power P(i,j) f of each fused pixel into a first value if the spectral power is greater than a threshold value; and; thresholding the spectral power P(i,j) f of each fused pixel into a second value if the spectral power is less than the threshold value; wherein: 0<i≦m; and 0<j≦n.
Claim 27
Dependent Claim
27 words
The method of claim 23 , wherein: P(i,j) f =P(i,j) 1 −C*P(i,j) 2 ; and C is a constant dependent upon a lighting condition of the scene.
Claim 28
Dependent Claim
54 words
The method of claim 24 , wherein: P(i,j) t =V 1 if P(i,j) f >T; P(i,j) t =V 2 if P(i,j) f <T; V 1 is a first value; V 2 is a second value; and T is a threshold value dependent upon a distribution of spectral powers P(i,j) f of the fused pixels.
Claim 29
Dependent Claim
21 words
The method of claim 25 , wherein a wavelength between the first and second bandwidths is about 1 . 4 microns.
Claim 30
Dependent Claim
25 words
The method of claim 26 , further comprising displaying a segmented image with the first and second values of the threshold pixels (i,j) t .
Claim 31
Dependent Claim
29 words
The method of claim 27 , wherein: the first bandwidth is between about 0.8 and 1.4 microns; and the second bandwidth is between about 1.4 microns and 2.2 microns.
Claim 32
Independent Claim
94 words
A method for detecting humans in a scene, the method comprising: focusing a scene on a first m×n pixel array that is sensitive to light of a first bandwidth within a reflected infrared radiation range to provide a first image output representative of the scene; focusing the scene on a second m×n pixel array that is sensitive to light of a second bandwidth within the reflected infrared radiation range to provide a second image output representative of the scene; and using the first and second image outputs to detect a human in the scene.
Claim 33
Independent Claim
94 words
A method for detecting humans in a scene, the method comprising: focusing a scene on a first m×n pixel array that is sensitive to light of a first bandwidth within a reflected infrared radiation range to provide a first image output representative of the scene; focusing the scene on a second m×n pixel array that is sensitive to light of a second bandwidth within the reflected infrared radiation range to provide a second image output representative of the scene; and using the first and second image outputs to detect a human in the scene.
Claim 34
Dependent Claim
63 words
The method of claim 29 , wherein using the first and second image outputs to detect a human in the scene comprises fusing spectral power of the pixels of the first image output with spectral power of corresponding pixels of the second image output to provide a fused image output having an increased contrast between a human and a background in the scene.
Claim 35
Dependent Claim
48 words
The method of claim 30 , wherein using the first and second image outputs to detect a human in the scene further comprises segmenting the human from the scene by comparing the spectral power of each pixel of the fused image output to one or more threshold values.
Claim 36
Dependent Claim
15 words
The method of claim 31 , wherein the method further comprises displaying a segmented image.
Claim 37
Dependent Claim
19 words
The method of claim 29 , wherein a wavelength between the first and second bandwidths is about 1.4 microns.
Claim 38
Dependent Claim
29 words
The method of claim 29 , wherein the first bandwidth is between about 0.8 and 1.4 microns and the second bandwidth is between about 1.4 microns and 2.2 microns.
Claim 39
Dependent Claim
45 words
The method of claim 29 , wherein a difference in reflectance for human skin in the first bandwidth relative to the second bandwidth is greater than a difference in reflectance for objects other than human skin in the first bandwidth relative to the second bandwidth.
Claim 40
Dependent Claim
58 words
The method of claim 35 , wherein using the first and second image outputs to detect a human in the scene comprises performing a weighted difference calculation of spectral power of the pixels of the first image output with spectral power of corresponding pixels of the second image output resulting in a weighted difference output for the pixels.
Claim 41
Dependent Claim
53 words
The method of claim 36 , wherein using the first and second image outputs to detect a human in the scene further comprises comparing the weighted difference output for the pixels to one or more threshold values to differentiate pixels representative of human skin from pixels representative of objects other than human skin.
References Cited (Backward Citations)
US4520504A
Cited
US4500784A
Cited
US5013917A
Cited
US5221919A
Cited
US5703367A
Cited
US5940139A
Cited
US6002505A
Cited
US5900942A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-04-08 | 2005-10-08 | 2006-04-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-04-08 | 2009-10-08 | 2010-04-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-04-08 | 2013-10-08 | 2014-04-09 | $7700.00 | Window Closed / Lapsed |