US6512846B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Determining orientation of images containing blue sky
Assignee: Monument Peak Ventures LLC
•
Filing: 1999-11-29
•
Granted: 2003-01-28
•
Expires: 2019-11-29
Abstract
Abstract A method, image recognition system, computer program, etc., for determining image orientation. The invention classifies potential sky pixels in the image by color, identifies spatially contiguous regions of the potential sky pixels, identifies actual sky regions by eliminating ones of the spatially contiguous regions that have a texture above a predetermined texture threshold, computes desaturation gradients of the actual sky regions, classifies the image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of pixels within each of the actual sky regions, determines orientation of the image based on a polarity of the average horizontal and vertical desaturation gradients, and confirms that the actual sky regions are true sky regions by comparing the desaturation gradients with a predetermined desaturation gradient for sky.
Inventors
- 👤 Jiebo Luo
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 12:46
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/70; G06T7/73; G06V; G06V20/00; G06V20/10
Claims Analysis
Total Claims: 42
Claim 1
Independent Claim
123 words
A method of determining image orientation comprising: classifying potential sky pixels in said image by color; identifying spatially contiguous regions of said potential sky pixels; identifying actual sky regions by eliminating ones of said spatially contiguous regions that have a texture above a predetermined texture threshold; computing desaturation gradients of said actual sky regions; classifying said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of pixels within each of said actual sky regions; determining orientation of said image based on a polarity of said average horizontal and vertical desaturation gradients; and confirming that said actual sky regions are true sky regions by comparing said desaturation gradients with a predetermined desaturation gradient for sky.
Claim 2
Independent Claim
123 words
A method of determining image orientation comprising: classifying potential sky pixels in said image by color; identifying spatially contiguous regions of said potential sky pixels; identifying actual sky regions by eliminating ones of said spatially contiguous regions that have a texture above a predetermined texture threshold; computing desaturation gradients of said actual sky regions; classifying said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of pixels within each of said actual sky regions; determining orientation of said image based on a polarity of said average horizontal and vertical desaturation gradients; and confirming that said actual sky regions are true sky regions by comparing said desaturation gradients with a predetermined desaturation gradient for sky.
Claim 3
Dependent Claim
51 words
The method in claim 1 , further comprising maintaining only ones of said spatially contiguous regions as said actual sky regions which: have substantially dissimilar average horizontal and vertical gradients; have a color distribution which is consistent with a predetermined color distribution for sky; and contact a border of said image.
Claim 4
Dependent Claim
75 words
The method in claim 1 , wherein said classifying said image as one of portrait and landscape includes: classifying said image as said portrait if an absolute value of said average horizontal desaturation gradient is greater than an absolute value of said average vertical desaturation gradient; and classifying said image as said landscape if an absolute value of said average horizontal desaturation gradient is less than an absolute value of said average vertical desaturation gradient.
Claim 5
Dependent Claim
23 words
The method in claim 1 , wherein said desaturation gradients comprise desaturation gradients for red, green and blue trace components of said image.
Claim 6
Dependent Claim
35 words
The method in claim 1 , wherein said predetermined desaturation gradient for sky comprises, from horizon to zenith, a decrease in red and green light trace components and a substantially constant blue light trace component.
Claim 7
Dependent Claim
43 words
The method in claim 1 , wherein said classifying potential sky pixels in said image by color comprises: forming a belief map of sky color pixels; computing an adaptive threshold of sky color; and determining if said potential sky pixels exceed said threshold.
Claim 8
Dependent Claim
27 words
The method in claim 6 , wherein said computing of said adaptive threshold comprises identifying a first valley in a belief histogram derived from said belief map.
Claim 9
Dependent Claim
19 words
The method in claim 7 , wherein said belief map and said belief histogram are unique to said image.
Claim 10
Independent Claim
64 words
A method of determining image orientation comprising: classifying sky pixels in said image by color; computing desaturation gradients of said sky pixels; classifying said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of said sky pixels; and determining orientation of said image based on a polarity of said average horizontal and vertical desaturation gradients.
Claim 11
Independent Claim
64 words
A method of determining image orientation comprising: classifying sky pixels in said image by color; computing desaturation gradients of said sky pixels; classifying said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of said sky pixels; and determining orientation of said image based on a polarity of said average horizontal and vertical desaturation gradients.
Claim 12
Dependent Claim
38 words
The method in claim 9 , further comprising: identifying spatially contiguous regions of said sky pixels; and identifying actual sky regions by eliminating ones of said spatially contiguous regions that have a texture above a predetermined texture threshold.
Claim 13
Dependent Claim
30 words
The method in claim 10 , further comprising confirming that said actual sky regions are true sky regions by comparing said desaturation gradients with a predetermined desaturation gradient for sky.
Claim 14
Dependent Claim
52 words
The method in claim 10 , further comprising maintaining only ones of said spatially contiguous regions as said actual sky regions which: have substantially dissimilar average horizontal and vertical desaturation gradients; have a color distribution which is consistent with a predetermined color distribution for sky; and contact a border of said image.
Claim 15
Dependent Claim
75 words
The method in claim 9 , wherein said classifying said image as one of portrait and landscape includes: classifying said image as said portrait if an absolute value of said average horizontal desaturation gradient is greater than an absolute value of said average vertical desaturation gradient; and classifying said image as said landscape if an absolute value of said average horizontal desaturation gradient is less than an absolute value of said average vertical desaturation gradient.
Claim 16
Dependent Claim
23 words
The method in claim 9 , wherein said desaturation gradients comprise desaturation gradients for red, green and blue trace components of said image.
Claim 17
Dependent Claim
35 words
The method in claim 11 , wherein said predetermined desaturation gradient for sky comprises, from horizon to zenith, a decrease in red and green light trace components and a substantially constant blue light trace component.
Claim 18
Dependent Claim
42 words
The method in claim 9 , wherein said classifying sky pixels in said image by color comprises: forming a belief map of sky color pixels; computing an adaptive threshold of sky color; and determining if said sky color pixels exceed said threshold.
Claim 19
Dependent Claim
28 words
The method in claim 16 , wherein said computing of said adaptive threshold comprises identifying a first valley in a belief histogram derived from on said belief map.
Claim 20
Dependent Claim
19 words
The method in claim 17 , wherein said belief histogram and said belief map are unique to said image.
Claim 21
Dependent Claim
74 words
A image orientation identification system comprising: a color classifier classifying sky pixels in said image by color; a logic unit computing desaturation gradients of said sky pixels; a portrait/landscape classifier classifying said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of said sky pixels; and a comparator determining orientation of said image based on a polarity of said average horizontal and vertical desaturation gradients.
Claim 22
Dependent Claim
74 words
A image orientation identification system comprising: a color classifier classifying sky pixels in said image by color; a logic unit computing desaturation gradients of said sky pixels; a portrait/landscape classifier classifying said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of said sky pixels; and a comparator determining orientation of said image based on a polarity of said average horizontal and vertical desaturation gradients.
Claim 23
Dependent Claim
47 words
The image orientation identification system in claim 19 , further comprising: a second comparator identifying spatially contiguous regions of said sky pixels; and a third comparator identifying actual sky regions by eliminating ones of said spatially contiguous regions that have a texture above a predetermined texture threshold.
Claim 24
Dependent Claim
40 words
The image orientation identification system in claim 20 , further comprising a fourth comparator confirming that said actual sky regions are true sky regions by comparing desaturation gradients of said actual sky regions with a predetermined desaturation gradient for sky.
Claim 25
Dependent Claim
57 words
The image orientation identification system in claim 20 , wherein said third comparator only maintains ones of said spatially contiguous regions as said actual sky regions that: have substantially dissimilar average horizontal and vertical desaturation gradients; have a color distribution which is consistent with a predetermined color distribution for sky; and contact a border of said image.
Claim 26
Dependent Claim
70 words
The image orientation identification system in claim 19 , wherein said portrait/landscape classifier: classifies said image as said portrait if an absolute value of said average horizontal desaturation gradient is greater than an absolute value of said average vertical desaturation gradient; and classifies said image as said landscape if an absolute value of said average horizontal desaturation gradient is less than an absolute value of said average vertical desaturation gradient.
Claim 27
Dependent Claim
31 words
The image orientation identification system in claim 21 , wherein said desaturation gradients of said actual sky regions comprise desaturation gradients for red, green and blue trace components of said image.
Claim 28
Dependent Claim
38 words
The image orientation identification system in claim 21 , wherein said predetermined desaturation gradient for sky comprises, from horizon to zenith, a decrease in red and green light trace components and a substantially constant blue light trace component.
Claim 29
Dependent Claim
38 words
The image orientation identification system in claim 19 , wherein said color classifier: forms a belief map of sky color pixels; computes an adaptive threshold of sky color; and determines if said potential sky pixels exceed said threshold.
Claim 30
Dependent Claim
31 words
The image orientation identification system in claim 26 , wherein said color classifier computes said adaptive threshold by identifying a first valley on a belief histogram derived from said belief map.
Claim 31
Dependent Claim
21 words
The image orientation identification system in claim 27 , wherein belief histogram and said belief map are unique to said image.
Claim 32
Independent Claim
94 words
A method of using and a computer program running on a computer system to determine image orientation, said method comprising: using said computer program to classify sky pixels in said image by color; using said computer program to compute desaturation gradients of said sky pixels; using said computer program to classify said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of said sky pixels; and using said computer program to determine orientation of said image based on said average horizontal and vertical desaturation gradients.
Claim 33
Independent Claim
94 words
A method of using and a computer program running on a computer system to determine image orientation, said method comprising: using said computer program to classify sky pixels in said image by color; using said computer program to compute desaturation gradients of said sky pixels; using said computer program to classify said image as one of portrait and landscape based on average absolute values of horizontal and vertical desaturation gradient of said sky pixels; and using said computer program to determine orientation of said image based on said average horizontal and vertical desaturation gradients.
Claim 34
Dependent Claim
48 words
The method in claim 29 , further comprising: using said computer program to identify spatially contiguous regions of said sky pixels; and using said computer program to identify actual sky regions by eliminating ones of said spatially contiguous regions that have a texture above a predetermined texture threshold.
Claim 35
Dependent Claim
35 words
The method in claim 30 , further comprising using said computer program to confirm that said actual sky regions are true sky regions by comparing said desaturation gradients with a predetermined desaturation gradient for sky.
Claim 36
Dependent Claim
57 words
The method in claim 30 , further comprising using said computer program to maintain only ones of said spatially contiguous regions as said actual sky regions which: have substantially dissimilar average horizontal and vertical desaturation gradients; have a color distribution which is consistent with a predetermined color distribution for sky; and contact a border of said image.
Claim 37
Dependent Claim
90 words
The method in claim 29 , wherein said using said computer program to classify said image as one of portrait and landscape includes: using said computer program to classify said image as said portrait if an absolute value of said average horizontal desaturation gradient is greater than an absolute value of said average vertical desaturation gradient; and using said computer program to classify said image as said landscape if an absolute value of said average horizontal desaturation gradient is less than an absolute value of said average vertical desaturation gradient.
Claim 38
Dependent Claim
23 words
The method in claim 29 , wherein said desaturation gradients comprise desaturation gradients for red, green and blue trace components of said image.
Claim 39
Dependent Claim
35 words
The method in claim 31 , wherein said predetermined desaturation gradient for sky comprises, from horizon to zenith, a decrease in red and green light trace components and a substantially constant blue light trace component.
Claim 40
Dependent Claim
62 words
The method in claim 29 , wherein said using said computer program to classify sky pixels in said image by color comprises: using said computer program to form a belief map of sky color pixels; using said computer program to compute an adaptive threshold of sky color; and using said computer program to determine if said sky color pixels exceed said threshold.
Claim 41
Dependent Claim
37 words
The method in claim 36 , wherein said using said computer program to compute said adaptive threshold comprises using said computer program to identify a first valley in a belief histogram derived from on said belief map.
Claim 42
Dependent Claim
19 words
The method in claim 37 , wherein said belief histogram and said belief map are unique to said image.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-01-27 | 2006-07-29 | 2007-01-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-01-27 | 2010-07-29 | 2011-01-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-01-27 | 2014-07-29 | 2015-01-28 | $7700.00 | Window Closed / Lapsed |