Patent US7062085B2 successfully refreshed from Google Patents.
US7062085B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method for detecting subject matter regions in images
Assignee: Monument Peak Ventures LLC
•
Filing: 2001-09-13
•
Granted: 2006-06-13
•
Expires: 2021-09-13
Abstract
Abstract Disclosed is a method for detecting subject matter regions in a digital color image having pixels of (red, green, blue) values, comprising the steps of: assigning to each pixel a belief value as belonging to the subject matter region based on color and texture features; forming spatially contiguous candidate subject matter regions by thresholding the belief values; analyzing the spatially contiguous regions based on one or more unique characteristics of the subject matter to determine the probability that a region belongs to the subject matter; and generating a map of detected subject matter regions and associated probability that the regions belongs to the subject matter.
Inventors
- 👤 Jiebo Luo
- 👤 Amit Singhal
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:51
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/10; G06T7/11; G06T7/168; G06T7/90; G06V; G06V10/00; G06V10/20; G06V10/28; G06V20/00; G06V20/35; G06V20/38; G06T2207/00; G06T2207/20; G06T2207/20048; G06T2207/20064; G06T2207/20084
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
107 words
A method for detecting subject matter regions in a digital color image having pixels of (red, green, blue) values, comprising the steps of: a) assigning to each pixel a belief value as belonging to the subject matter region based on color and texture features; b) forming spatially contiguous candidate subject matter regions by thresholding the belief values; c) analyzing the spatially contiguous regions based on one or more unique characteristics of the subject matter to determine the probability that a region belongs to the subject matter; and d) generating a map of detected subject matter regions and associated probability that the regions belongs to the subject matter.
Claim 2
Independent Claim
107 words
A method for detecting subject matter regions in a digital color image having pixels of (red, green, blue) values, comprising the steps of: a) assigning to each pixel a belief value as belonging to the subject matter region based on color and texture features; b) forming spatially contiguous candidate subject matter regions by thresholding the belief values; c) analyzing the spatially contiguous regions based on one or more unique characteristics of the subject matter to determine the probability that a region belongs to the subject matter; and d) generating a map of detected subject matter regions and associated probability that the regions belongs to the subject matter.
Claim 3
Dependent Claim
97 words
The method claimed in claim 1 , wherein the subject matter is cloudy or overcast sky and step of analyzing the spatially contiguous regions includes the steps of: c1) computing an open space map containing spatially contiguous regions of low activity; c2) comparing the spatially contiguous regions of low activity with the spatially contiguous candidate subject matter regions; c3) labeling those candidate regions that have significant overlap with the low activity regions as subject matter regions; and c4) labeling those candidate regions that do not have any overlap with the low activity regions as subject matter regions.
Claim 4
Dependent Claim
88 words
The method claimed in claim 1 , wherein the subject matter is cloudy sky and step of assigning to each pixel a belief value includes the steps of: a1) calculating one luminance value and two chrominance values from the (red, green, blue) values of each pixel in the digital color image; a2) calculating a normalized luminance feature as a ratio of the luminance value and a maximum luminance value of the entire digital color image; and a3) calculating two chrominance features as equal to the two chrominance values.
Claim 5
Dependent Claim
52 words
The method claimed in claim 1 , wherein the step of assigning to each pixel a belief value includes the steps of: a1) calculating a luminance value from (red, green, blue) values of each pixel in the digital color image; and a2) calculating a plurality of texture features using the luminance values.
Claim 6
Dependent Claim
27 words
The method claimed in claim 4 , wherein the texture features are coefficients derived from a wavelet transform based on multiresolution analysis of the digital color image.
Claim 7
Dependent Claim
115 words
The method claimed in claim 1 , wherein the step of forming spatially contiguous candidate subject matter regions by thresholding the belief values includes the steps of: b1) producing a subject matter belief map using subject matter belief values of all the pixels in the image; b2) computing gradient values from the subject matter belief map; b3) selecting pixels having gradient values greater than a predetermined value; b4) forming a histogram of subject matter belief values using only the selected pixels from the previous step; b5) locating a valley point in the histogram; and b6) determining the subject matter belief threshold as the subject matter belief value at the located valley point of the histogram.
Claim 8
Dependent Claim
81 words
The method claimed in claim 1 , wherein the subject matter is lawn grass, snow field, sand or standing water and step of analyzing the spatially contiguous regions includes the steps of: c1) computing an open space map containing spatially contiguous regions of low activity; c2) comparing the spatially contiguous regions of low activity with the spatially contiguous candidate subject matter regions; and c3) labeling those candidate regions that have significant overlap with the low activity regions as subject matter regions.
Claim 9
Dependent Claim
23 words
The method claimed in claim 2 , wherein the step of assigning the pixel belief value is performed with a trained neural network.
Claim 10
Dependent Claim
23 words
The method claimed in claim 7 , wherein the step of assigning the pixel belief value is performed with a trained neural network.
Claim 11
Dependent Claim
24 words
The method claimed in claim 1 , further comprising the step of: e) performing image classification using the map of detected subject matter regions.
Claim 12
Dependent Claim
24 words
The method claimed in claim 1 , further comprising the step of: e) determining image orientation using the map of detected subject matter regions.
Claim 13
Dependent Claim
29 words
The method claimed in claim 1 , further comprising the step of: e) automatically generating album pages having similar subject matter using the map of detected subject matter regions.
Claim 14
Dependent Claim
28 words
The method claimed in claim 1 , further comprising the step of: e) determining a main subject of the image using the map of detected subject matter regions.
Claim 15
Dependent Claim
26 words
The method claimed in claim 1 , further comprising the step of: e) determining background of the image using the map of detected subject matter regions.
Claim 16
Dependent Claim
32 words
The method claimed in claim 1 , further comprising the step of: e) retrieving images having similar subject matter from an image data base using the map of detected subject matter regions.
Claim 17
Dependent Claim
25 words
The method claimed in claim 1 , further comprising the step of: e) selectively compressing the image using the map of detected subject matter regions.
Claim 18
Independent Claim
112 words
A system for detecting subject matter regions in a digital color image having pixels of (red, green, blue) values, comprising: a) means for assigning to each pixel a belief value as belonging to the subject matter region based on color and texture features; b) means for forming spatially contiguous candidate subject matter regions by thresholding the belief values; c) means for analyzing the spatially contiguous regions based on one or more unique characteristics of the subject matter to determine the probability that a region belongs to the subject matter; and d) means for generating a map of detected subject matter regions and associated probability that the regions belongs to the subject matter.
Claim 19
Independent Claim
112 words
A system for detecting subject matter regions in a digital color image having pixels of (red, green, blue) values, comprising: a) means for assigning to each pixel a belief value as belonging to the subject matter region based on color and texture features; b) means for forming spatially contiguous candidate subject matter regions by thresholding the belief values; c) means for analyzing the spatially contiguous regions based on one or more unique characteristics of the subject matter to determine the probability that a region belongs to the subject matter; and d) means for generating a map of detected subject matter regions and associated probability that the regions belongs to the subject matter.
Claim 20
Dependent Claim
105 words
The system claimed in claim 17 , wherein the subject matter is cloudy or overcast sky and the means for analyzing the spatially contiguous regions includes: c1) means for computing an open space map containing spatially contiguous regions of low activity; c2) means for comparing the spatially contiguous regions of low activity with the spatially contiguous candidate subject matter regions; c3) means for labeling those candidate regions that have significant overlap with the low activity regions as subject matter regions; and c4) means for labeling those candidate regions candidate regions that do not have any overlap with the low activity regions as subject matter regions.
Claim 21
Dependent Claim
92 words
The system claimed in claim 17 , wherein the subject matter is cloudy sky and the means for assigning to each pixel a belief value includes: a1) means for calculating one luminance value and two chrominance values from the (red, green, blue) values of each pixel in the digital color image; a2) means for calculating a normalized luminance feature as a ratio of the luminance value and a maximum luminance value of the entire digital color image; and a3) means for calculating two chrominance features as equal to the two chrominance values.
Claim 22
Dependent Claim
53 words
The system claimed in claim 17 , wherein the means for assigning to each pixel a belief value includes: a1) means for calculating a luminance value from (red, green, blue) values of each pixel in the digital color image; and a2) means for calculating a plurality of texture features using the luminance values.
Claim 23
Dependent Claim
27 words
The system claimed in claim 20 , wherein the texture features are coefficients derived from a wavelet transform based on multiresolution analysis of the digital color image.
Claim 24
Dependent Claim
124 words
The system claimed in claim 17 , wherein the means for forming spatially contiguous candidate subject matter regions by thresholding the belief values includes: b1) means for producing a subject matter belief map using subject matter belief values of all the pixels in the image; b2) means for computing gradient values from the subject matter belief map; b3) means for selecting pixels having gradient values greater than a predetermined value; b4) means for forming a histogram of subject matter belief values using only the selected pixels from the previous step; b5) means for locating a valley point in the histogram; and b6) means for determining the subject matter belief threshold as the subject matter belief value at the located valley point of the histogram.
Claim 25
Dependent Claim
85 words
The system claimed in claim 17 , wherein the subject matter is lawn grass, snow field, sand, or standing water and the means for analyzing the spatially contiguous regions includes: c1) means for computing an open space map containing spatially contiguous regions of low activity; c2) means for comparing the spatially contiguous regions of low activity with the spatially contiguous candidate subject matter regions; and c3) means for labeling those candidate regions that have significant overlap with the low activity regions as subject matter regions.
Claim 26
Dependent Claim
21 words
The system claimed in claim 17 , wherein the means for assigning the pixel belief value is a trained neural network.
Claim 27
Dependent Claim
21 words
The system claimed in claim 23 , wherein the means for assigning the pixel belief value is a trained neural network.
Claim 28
Dependent Claim
23 words
The system claimed in claim 17 , further comprising: e) means for performing image classification using the map of detected subject matter regions.
Claim 29
Dependent Claim
23 words
The system claimed in claim 17 , further comprising: e) means for determining image orientation using the map of detected subject matter regions.
Claim 30
Dependent Claim
28 words
The system claimed in claim 17 , further comprising: e) means for automatically generating album pages having similar subject matter using the map of detected subject matter regions.
Claim 31
Dependent Claim
27 words
The system claimed in claim 17 , further comprising: e) means for determining a main subject of the image using the map of detected subject matter regions.
Claim 32
Dependent Claim
25 words
The system claimed in claim 17 , further comprising: e) means for determining background of the image using the map of detected subject matter regions.
Claim 33
Dependent Claim
31 words
The system claimed in claim 17 , further comprising: e) means for retrieving images having similar subject matter from an image data base using the map of detected subject matter regions.
Claim 34
Dependent Claim
24 words
The system claimed in claim 17 , further comprising: e) means for selectively compressing the image using the map of detected subject matter regions.
References Cited (Backward Citations)
US5889578A
Cited
US5642443A
Cited
US5822453A
Cited
US5901245A
Cited
US6097470A
Cited
EP1017019A2
Cited
US6282317B1
Cited
US6408103B1
Cited
US6504951B1
Cited
US6654507B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-06-12 | 2009-12-12 | 2010-06-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-06-12 | 2013-12-12 | 2014-06-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-06-12 | 2017-12-12 | 2018-06-13 | $7700.00 | Window Closed / Lapsed |