US7352394B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image modification based on red-eye filter analysis
Assignee: Fotonation Ltd
•
Filing: 2004-02-04
•
Granted: 2008-04-01
•
Expires: 2024-02-04
Abstract
Abstract A digital camera has an integral flash and stores and displays a digital image. Under certain conditions, a flash photograph taken with the camera may result in a red-eye phenomenon due to a reflection within an eye of a subject of the photograph. A digital apparatus has a red-eye filter which analyzes the stored image for the red-eye phenomenon and modifies the stored image to eliminate the red-eye phenomenon by changing the red area to black. The modification of the image is enabled when a photograph is taken under conditions indicative of the red-eye phenomenon. The modification is subject to anti-falsing analysis which further examines the area around the red-eye area for indicia of the eye of the subject. The detection and correction can be optimized for performance and quality by operating on subsample versions of the image when appropriate.
Inventors
- 👤 Michael J. DeLuca
- 👤 Yury Prilutsky
- 👤 Eran Steinberg
- 👤 Peter Corcoran
- 👤 Alexei Pososin
- 👤 Petronel Bigioi
- 👤 Alexandru Drimbarean
- 👤 Adrian Capata
- 👤 Florin Nanu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:33
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/46; H04N1/56; H04N1/60; H04N1/62; G; G06; G06T; G06T5/00; G06T5/77; G06T7/00; G06T7/90; G06V; G06V40/00; G06V40/10; G06V40/18; G06V40/193; H04N1/624; H04N23/00; H04N23/70; H04N23/74; G06T2207/00; G06T2207/30; G06T2207/30216
Claims Analysis
Total Claims: 72
Claim 1
Independent Claim
60 words
A portable digital camera having no photographic film, comprising: (a) an integral flash for providing illumination during image acquisition; (b) a digital image capturing apparatus for acquiring an image; and (c) a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon based on an analysis of a subsample representation of selected regions of the image.
Claim 2
Dependent Claim
60 words
A portable digital camera having no photographic film, comprising: (a) an integral flash for providing illumination during image acquisition; (b) a digital image capturing apparatus for acquiring an image; and (c) a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon based on an analysis of a subsample representation of selected regions of the image.
Claim 3
Dependent Claim
19 words
The camera of claim 1 , wherein the analysis is performed at least in part for determining said area.
Claim 4
Dependent Claim
19 words
The camera of claim 1 , wherein the analysis is performed at least in part for determining said modifying.
Claim 5
Dependent Claim
18 words
The camera of claim 1 , wherein said selected regions of said acquired image comprise the entire image.
Claim 6
Dependent Claim
21 words
The camera of claim 1 , wherein said selected regions of said acquired image comprise multi resolution encoding of said image.
Claim 7
Dependent Claim
25 words
The camera of claim 1 , wherein at least one region of the entire image is not included among said selected regions of said image.
Claim 8
Dependent Claim
28 words
The camera of claim 1 , wherein said analysis is performed in part on a full resolution image and in part on a subsample resolution of said image.
Claim 9
Dependent Claim
17 words
The camera of claim 1 , further comprising a module for changing the degree of said subsampling.
Claim 10
Dependent Claim
17 words
The camera of claim 8 , wherein said changing the degree of said subsampling is determined empirically.
Claim 11
Dependent Claim
23 words
The camera of claim 8 , wherein said changing the degree of said subsampling is determined based on a size of said image.
Claim 12
Dependent Claim
26 words
The camera of claim 8 , wherein said changing the degree of said subsampling is determined based on a size of selected regions of the image.
Claim 13
Dependent Claim
36 words
The camera of claim 8 , wherein said changing the degree of said subsampling is determined based on data obtained from the camera relating to the settings of the camera at the time of image capture.
Claim 14
Dependent Claim
24 words
The camera of claim 12 , wherein the data obtained from the camera includes an aperture setting or focus of the camera, or both.
Claim 15
Dependent Claim
22 words
The camera of claim 12 , wherein the data obtained from the camera includes the distance of the subject from the camera.
Claim 16
Dependent Claim
20 words
The camera of claim 8 , wherein said changing the degree of said subsampling is determined based image metadata information.
Claim 17
Dependent Claim
20 words
The camera of claim 8 , wherein said modifying the area is performed including the full resolution of said image.
Claim 18
Dependent Claim
17 words
The camera of claim 8 , wherein said red-eye filter comprises of a plurality of sub filters.
Claim 19
Dependent Claim
77 words
The camera of claim 17 , wherein said subsampling for said sub filters operating on selected regions of said image is determined by one or more of the image size, suspected as red eye region size, filter computation complexity, empirical success rate of said sub filter, empirical false detection rate of said sub filter, falsing probability of said sub filter, relations between said suspected regions as red eye, results of previous analysis of other said sub filters.
Claim 20
Dependent Claim
24 words
The camera of claim 1 , further comprising memory for saving said image after applying said filter for modifying pixels as a modified image.
Claim 21
Dependent Claim
17 words
The camera of claim 1 , further comprising memory for saving said subsample representation of said image.
Claim 22
Dependent Claim
20 words
The camera of claim 1 , wherein said subsample representation of selected regions of said image is determined in hardware.
Claim 23
Dependent Claim
28 words
The camera of claim 1 , wherein said analysis is performed in part on the full resolution image and in part on a subsample resolution of said image.
Claim 24
Dependent Claim
16 words
The camera of claim 1 , further comprising means for changing the degree of said subsampling.
Claim 25
Dependent Claim
17 words
The camera of claim 23 , wherein said changing the degree of said subsampling is determined empirically.
Claim 26
Dependent Claim
23 words
The camera of claim 23 , wherein said changing the degree of said subsampling is determined based on a size of said image.
Claim 27
Dependent Claim
21 words
The camera of claim 23 , wherein said changing the degree of said subsampling is determined based on a region size.
Claim 28
Dependent Claim
25 words
The camera of claim 23 , wherein said changing the degree of said subsampling is determined based on a complexity of calculation for said filter.
Claim 29
Dependent Claim
15 words
The camera of claim 1 , wherein said subsample representation is determined using spline interpolation.
Claim 30
Dependent Claim
15 words
The camera of claim 1 , wherein said subsample representation is determined using bi-cubic interpolation.
Claim 31
Dependent Claim
20 words
The camera of claim 1 , wherein said modifying the area is performed on the full resolution of said image.
Claim 32
Dependent Claim
15 words
The camera of claim 1 , wherein said red-eye filter comprises a plurality of sub-filters.
Claim 33
Dependent Claim
75 words
The camera according to claim 31 , wherein said subsampling for said sub-filters operating on selected regions of said image is determined by one or more of the image size, a suspected red eye region size, filter computation complexity, empirical success rate of said sub-filter, empirical false detection rate of said sub-filter, falsing probability of said sub-filter, relations between said suspected red eye regions, or results of previous analysis of one or more other sub-filters.
Claim 34
Dependent Claim
68 words
The camera of claim 1 , further comprising: (d) a pixel locator for locating pixels having a color indicative of the red-eye phenomenon; (e) a shape analyzer for determining if a grouping of at least a portion of the pixels located by the pixel locator comprise a shape indicative of the red-eye phenomenon; and (f) a pixel modifier for modifying the color of the pixels within the grouping.
Claim 35
Dependent Claim
37 words
The camera of claim 33 , further comprising a falsing analyzer for further processing the image in a vicinity of the grouping for details indicative of an eye, and for enabling the pixel modifier in response thereto.
Claim 36
Dependent Claim
26 words
The camera of claim 33 , further comprising an exposure analyzer for determining if the image was acquired in a condition indicative of the red-eye phenomenon.
Claim 37
Dependent Claim
60 words
A portable digital camera having no photographic film, comprising: (a) an integral flash for providing illumination during image recording; (b) a digital image capturing apparatus for recording an image; and (c) a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon based on an analysis of a subsample representation of selected regions of the image.
Claim 38
Dependent Claim
60 words
A portable digital camera having no photographic film, comprising: (a) an integral flash for providing illumination during image recording; (b) a digital image capturing apparatus for recording an image; and (c) a red-eye filter for modifying an area within the image indicative of a red-eye phenomenon based on an analysis of a subsample representation of selected regions of the image.
Claim 39
Dependent Claim
19 words
The camera of claim 36 , wherein the analysis is performed at least in part for determining said area.
Claim 40
Dependent Claim
19 words
The camera of claim 36 , wherein the analysis is performed at least in part for determining said modifying.
Claim 41
Dependent Claim
18 words
The camera of claim 36 , wherein said selected regions of said recorded image comprise the entire image.
Claim 42
Dependent Claim
21 words
The camera of claim 36 , wherein said selected regions of said recorded image comprise multi resolution encoding of said image.
Claim 43
Dependent Claim
25 words
The camera of claim 36 , wherein at least one region of the entire image is not included among said selected regions of said image.
Claim 44
Dependent Claim
28 words
The camera of claim 36 , wherein said analysis is performed in part on a full resolution image and in part on a subsample resolution of said image.
Claim 45
Dependent Claim
17 words
The camera of claim 36 , further comprising a module for changing the degree of said subsampling.
Claim 46
Dependent Claim
17 words
The camera of claim 43 , wherein said changing the degree of said subsampling is determined empirically.
Claim 47
Dependent Claim
23 words
The camera of claim 43 , wherein said changing the degree of said subsampling is determined based on a size of said image.
Claim 48
Dependent Claim
26 words
The camera of claim 43 , wherein said changing the degree of said subsampling is determined based on a size of selected regions of the image.
Claim 49
Dependent Claim
36 words
The camera of claim 43 , wherein said changing the degree of said subsampling is determined based on data obtained from the camera relating to the settings of the camera at the time of image capture.
Claim 50
Dependent Claim
24 words
The camera of claim 47 , wherein the data obtained from the camera includes an aperture setting or focus of the camera, or both.
Claim 51
Dependent Claim
22 words
The camera of claim 47 , wherein the data obtained from the camera includes the distance of the subject from the camera.
Claim 52
Dependent Claim
20 words
The camera of claim 43 , wherein said changing the degree of said subsampling is determined based image metadata information.
Claim 53
Dependent Claim
20 words
The camera of claim 43 , wherein said modifying the area is performed including the full resolution of said image.
Claim 54
Dependent Claim
17 words
The camera of claim 43 , wherein said red-eye filter comprises of a plurality of sub filters.
Claim 55
Dependent Claim
77 words
The camera of claim 52 , wherein said subsampling for said sub filters operating on selected regions of said image is determined by one or more of the image size, suspected as red eye region size, filter computation complexity, empirical success rate of said sub filter, empirical false detection rate of said sub filter, falsing probability of said sub filter, relations between said suspected regions as red eye, results of previous analysis of other said sub filters.
Claim 56
Dependent Claim
25 words
The camera of claim 36 , further comprising memory for saving said digitized image after applying said filter for modifying pixels as a modified image.
Claim 57
Dependent Claim
17 words
The camera of claim 36 , further comprising memory for saving said subsample representation of said image.
Claim 58
Dependent Claim
20 words
The camera of claim 36 , wherein said subsample representation of selected regions of said image is determined in hardware.
Claim 59
Dependent Claim
28 words
The camera of claim 36 , wherein said analysis is performed in part on the full resolution image and in part on a subsample resolution of said image.
Claim 60
Dependent Claim
16 words
The camera of claim 36 , further comprising means for changing the degree of said subsampling.
Claim 61
Dependent Claim
17 words
The camera of claim 58 , wherein said changing the degree of said subsampling is determined empirically.
Claim 62
Dependent Claim
23 words
The camera of claim 58 , wherein said changing the degree of said subsampling is determined based on a size of said image.
Claim 63
Dependent Claim
21 words
The camera of claim 58 , wherein said changing the degree of said subsampling is determined based on a region size.
Claim 64
Dependent Claim
25 words
The camera of claim 58 , wherein said changing the degree of said subsampling is determined based on a complexity of calculation for said filter.
Claim 65
Dependent Claim
15 words
The camera of claim 36 , wherein said subsample representation is determined using spline interpolation.
Claim 66
Dependent Claim
15 words
The camera of claim 36 , wherein said subsample representation is determined using bi-cubic interpolation.
Claim 67
Dependent Claim
20 words
The camera of claim 36 , wherein said modifying the area is performed on the full resolution of said image.
Claim 68
Dependent Claim
15 words
The camera of claim 36 , wherein said red-eye filter comprises a plurality of sub-filters.
Claim 69
Dependent Claim
74 words
The camera of claim 66 , wherein said subsampling for said sub-filters operating on selected regions of said image is determined by one or more of the image size, a suspected red eye region size, filter computation complexity, empirical success rate of said sub-filter, empirical false detection rate of said sub-filter, falsing probability of said sub-filter, relations between said suspected red eye regions, or results of previous analysis of one or more other sub-filters.
Claim 70
Dependent Claim
68 words
The camera of claim 36 , further comprising: (d) a pixel locator for locating pixels having a color indicative of the red-eye phenomenon; (e) a shape analyzer for determining if a grouping of at least a portion of the pixels located by the pixel locator comprise a shape indicative of the red-eye phenomenon; and (f) a pixel modifier for modifying the color of the pixels within the grouping.
Claim 71
Dependent Claim
37 words
The camera of claim 68 , further comprising a falsing analyzer for further processing the image in a vicinity of the grouping for details indicative of an eye, and for enabling the pixel modifier in response thereto.
Claim 72
Dependent Claim
26 words
The camera of claim 68 , further comprising an exposure analyzer for determining if the image was recorded in a condition indicative of the red-eye phenomenon.
References Cited (Backward Citations)
US4285588A
Cited
US5202720A
Cited
US5016107A
Cited
US5070355A
Cited
US5130789A
Cited
JPH04192681A
Cited
US5452048A
Cited
US5974189A
Cited
US5432863A
Cited
US5748764A
Cited
US5781650A
Cited
US5537516A
Cited
US5991549A
Cited
US5751836A
Cited
US5805745A
Cited
US6006039A
Cited
US5862217A
Cited
US5862218A
Cited
US5990973A
Cited
US5847714A
Cited
US20030118216A1
Cited
US5761550A
Cited
EP0884694A1
Cited
US6204858B1
Cited
US6009209A
Cited
US5991594A
Cited
US6151403A
Cited
US6292574B1
Cited
US6252976B1
Cited
WO1999017254A1
Cited
US6407777B1
Cited
US7042505B1
Cited
US20040223063A1
Cited
US20050041121A1
Cited
EP0911759A2
Cited
US6016354A
Cited
US6035072A
Cited
US6278491B1
Cited
US20030202715A1
Cited
US20020041329A1
Cited
US6510520B1
Cited
US6275614B1
Cited
US6792161B1
Cited
US6134339A
Cited
JP2000134486A
Cited
US6433818B1
Cited
WO2001071421A1
Cited
US6728401B1
Cited
EP1199672A2
Cited
US6429924B1
Cited
WO2002045003A1
Cited
US20030025811A1
Cited
US20020093577A1
Cited
US20020131770A1
Cited
US20020136450A1
Cited
JP2002271808A
Cited
US20020159630A1
Cited
US20020176623A1
Cited
US20020141661A1
Cited
US20020150306A1
Cited
US20020172419A1
Cited
US20030007687A1
Cited
US6516154B1
Cited
US20030021478A1
Cited
EP1288858A1
Cited
US20030044070A1
Cited
US20030044178A1
Cited
EP1293933A1
Cited
US20030044063A1
Cited
US20030044177A1
Cited
EP1288859A1
Cited
EP1288860A1
Cited
WO2003026278A1
Cited
EP1296510A2
Cited
US20030095197A1
Cited
US20030058349A1
Cited
US6505003B1
Cited
US6501911B1
Cited
US6496655B1
Cited
US20030142285A1
Cited
WO2003071484A1
Cited
EP1429290A2
Cited
EP1478169A2
Cited
US20050031224A1
Cited
US20050140801A1
Cited
WO2005041558A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2011-04-01 | 2011-10-01 | 2012-04-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2015-04-01 | 2015-10-01 | 2016-04-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2019-04-01 | 2019-10-01 | 2020-04-01 | $7700.00 | Window Closed / Lapsed |