US6301440B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for automatically setting image acquisition controls
Assignee: Carl Zeiss AG
•
Filing: 2000-04-13
•
Granted: 2001-10-09
•
Expires: 2020-04-13
Abstract
Abstract A system and method use computer image processing for setting the parameters for an image acquisition device of a camera. The image parameters are set automatically by analyzing the image to be taken, and setting the controls according to the subject matter, in the same manner as an expert photographer would be able to. The system can run in a fully automatic mode choosing the best image parameters, or a “guided mode” where the user is prompted with choices where a number of alternate settings would be reasonable.
Inventors
- 👤 Rudolf M. Bolle
- 👤 Jonathan H. Connell
- 👤 Arun Hampapur
- 👤 Andrew W. Senior
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 17:45
CPC Classifications
G; G06; G06V; G06V20/00; G06V20/10; G06V10/00; G06V10/10; G06V10/12; G06V10/14; G06V10/147; H; H04; H04N; H04N23/00; H04N23/60; H04N23/64; H04N23/695
Claims Analysis
Total Claims: 59
Claim 1
Independent Claim
79 words
A system for automatically setting image acquisition controls of a camera, comprising: a temporary image acquisition unit which acquires a temporary image; a scene analysis unit which extracts information from said temporary image and generates a scene classification from said extracted information; a photographic expert unit which adjusts image capture parameters based on said scene classification; and a permanent image acquisition unit which acquires a permanent image based on the image capture parameters adjusted by said photographic expert unit.
Claim 2
Independent Claim
79 words
A system for automatically setting image acquisition controls of a camera, comprising: a temporary image acquisition unit which acquires a temporary image; a scene analysis unit which extracts information from said temporary image and generates a scene classification from said extracted information; a photographic expert unit which adjusts image capture parameters based on said scene classification; and a permanent image acquisition unit which acquires a permanent image based on the image capture parameters adjusted by said photographic expert unit.
Claim 3
Dependent Claim
22 words
The system of claim 1 , wherein the temporary image acquisition unit and the permanent image acquisition unit are a same unit.
Claim 4
Dependent Claim
54 words
The system of claim 1 , further comprising: a user interface to prompt a user of the camera and to receive input from the user in response to user prompts, wherein the photographic expert unit optionally runs in a “guided mode” where the user is prompted with choices of a number of alternate settings.
Claim 5
Dependent Claim
27 words
The system of claim 3 , wherein information corresponding to user-adjusted image capture parameters is supplied as feedback to the photographic expert unit through the user interface.
Claim 6
Dependent Claim
33 words
The system of claim 4 , wherein mapping between input characteristics and image parameters is learned automatically by the photographic expert unit observing settings input by the user for different kinds of images.
Claim 7
Dependent Claim
22 words
The system of claim 1 , wherein the photographic expert unit determines a subject based on extracted features within said scene classification.
Claim 8
Dependent Claim
19 words
The system of claim 6 , wherein the photographic expert unit chooses a proper exposure for said subject determined.
Claim 9
Dependent Claim
26 words
The system of claim 7 , wherein the photographic expert unit chooses a shutter speed and aperture combination based upon reflected light from said subject subject.
Claim 10
Dependent Claim
26 words
The system of claim 1 , further comprising: an illumination device and wherein the photographic expert unit controls the illumination device to compensate for poor illumination.
Claim 11
Dependent Claim
21 words
The system of claim 9 , wherein the photographic expert unit controls the illumination device to compensate for a back-lit subject.
Claim 12
Dependent Claim
19 words
The system of claim 1 , wherein a focal-length of a lens is one of the image capture parameters.
Claim 13
Dependent Claim
27 words
The system of claim 1 , wherein lighting of an imaged scene is analyzed by the photographic expert unit to determine exposure parameters of the acquired image.
Claim 14
Dependent Claim
29 words
The system of claim 1 , wherein distances of multiple objects in an imaged scene are used by the photographic expert unit to estimate optimal or candidate focus depths.
Claim 15
Dependent Claim
39 words
The system of claim 1 , wherein distances of objects in an imaged scene are used by The photogahic expert unit to estimate optimal or candidate settings for focus depth and aperture to obtain desirable depth of field characteristics.
Claim 16
Dependent Claim
30 words
The system of claim 1 , wherein speeds of objects in an image are estimated and used by the photographic expert unit to determine optimal or candidate exposure speed settings.
Claim 17
Dependent Claim
29 words
The system of claim 1 , wherein objects in the image are recognized and a style of photography is determined by the photographic expert unit based upon the objects.
Claim 18
Dependent Claim
20 words
The system of claim 1 , wherein the photographic expert unit includes a storage medium for storing said extracted information.
Claim 19
Dependent Claim
22 words
The system of claim 17 , wherein the extracted information includes at least one of image features, scene components, and imaging parameters.
Claim 20
Dependent Claim
18 words
The system of claim 17 , wherein the stored information is used for indexing at a later time.
Claim 21
Dependent Claim
18 words
The system of claim 19 , wherein the stored information includes time reference and duration of observed features.
Claim 22
Dependent Claim
36 words
The system of claim 1 , wherein the extracted information includes image features based on one or more of the following: depth segmentation, motion segmentation, illumination evaluation, color analysis, geometric features, texture analysis, and scale determination.
Claim 23
Dependent Claim
34 words
The system of claim 1 , wherein the extracted information includes scene components that include one or more of the following: human faces, people, buildings, vehicles, walls, furniture, vegetation, skyline, horizon, and ground plane.
Claim 24
Dependent Claim
47 words
The system of claim 1 , wherein said scene classification is one of a portrait, close-up portrait, group shot, action photo, natural landscape, cityscape, still-life, macro close-up, crowd scene, backlit object, motor sports, sea scene, athletic event, stage performance, silhouette, flowers, architectural landmark, animal, and night sky.
Claim 25
Dependent Claim
36 words
The system of claim 1 , wherein the image capture parameters include one or more of the following optical controls: focus distance, aperture, shutter speed, zoom or focal length, filter application, filter parameters and imager sensitivity.
Claim 26
Dependent Claim
18 words
The system of claim 1 , wherein the scene analysis unit determines a subject region of the image.
Claim 27
Dependent Claim
49 words
The system of claim 25 , wherein the scene analysis unit determines a subject region of the image based on one or more of the following: a flesh tone area, a geometric model of a face, an area with high motion, the closest region, and the most central region.
Claim 28
Dependent Claim
14 words
The system of claim 6 , wherein said determined subject is a human face.
Claim 29
Dependent Claim
26 words
The system of claim 27 , wherein color balance of the permanent image acquisition unit is altered to improve flesh tone color rendition in the face.
Claim 30
Dependent Claim
22 words
The system of claim 28 , wherein the face is differentially exposed relative to the remainder of the image to improve contrast.
Claim 31
Dependent Claim
22 words
The system of claim 1 , further comprising: at least one auxiliary non-imaging sensor supplying an input into the scene analysis unit.
Claim 32
Dependent Claim
57 words
The system of claim 30 , wherein the at least one auxiliary sensor includes one or more of the following: an accelerometer, a tilt sensor, an ambient light sensor, an ultraviolet light sensor, a temperature sensor, an optical triangulation unit, an ultrasonic range finder, an audio sensor, a motion sensor, a global positioning system and a compass.
Claim 33
Dependent Claim
20 words
The system of claim 1 , further comprising: a controllable mechanical pointing system coupled to the permanent image acquisition device.
Claim 34
Dependent Claim
22 words
The system of claim 1 , wherein the photographic expert unit determines a shutter speed to eliminate blurring due to camera shake.
Claim 35
Dependent Claim
27 words
The system of claim 1 , wherein the photographic expert unit determines an exact time at which to acquire the permanent image based on the scene classification.
Claim 36
Dependent Claim
44 words
The system of claim 1 , further comprising: a user interface which informs a user of the camera of the scene classification and allowing the user to either confirm this scene classification or override the photographic expert unit and choose a different scene classification.
Claim 37
Dependent Claim
29 words
The system of claim 35 , wherein the scene analysis unit learns an improved mapping between the extracted features and said scene classification based on feedback from the user.
Claim 38
Dependent Claim
32 words
The system of claim 1 , further comprising; a user interface which informs a user of the camera of the image parameters selected and allows the user to optionally override these parameters.
Claim 39
Dependent Claim
24 words
The system of claim 1 , further comprising: a user interface which informs a user of the camera of anomalous situations and/or non-optimal settings.
Claim 40
Dependent Claim
42 words
The system of claim 1 , wherein said scene analysis unit generates a plurality of hypotheses of scene classifications, and wherein said system further comprises: a scene arbitration unit which selects said scene classification from said plurality of hypotheses of scene classifications.
Claim 41
Dependent Claim
34 words
The system of claim 39 , wherein said scene arbitration unit selects said scene classification from said plurality of hypotheses of scene classifications based on one of a rulesbased, statistical, or neural network-based process.
Claim 42
Dependent Claim
31 words
The system of claim 40 , wherein said rules-based or statistical process selecting said scene classification as an optimal one of said hypotheses of scene classifications based on said extracted information.
Claim 43
Dependent Claim
84 words
A computer implemented method for automatically setting image acquisition controls of a camera, said method comprising the steps of: acquiring a temporary image; extracting at least one of image features and scene components from said temporary image; generating a scene classification from said at least one of the extracted image features and scene components; adjusting image capture parameters based on the scene classification generated in said generating step; and acquiring a permanent image based on the image capture parameters adjusted in said adjusting step.
Claim 44
Dependent Claim
84 words
A computer implemented method for automatically setting image acquisition controls of a camera, said method comprising the steps of: acquiring a temporary image; extracting at least one of image features and scene components from said temporary image; generating a scene classification from said at least one of the extracted image features and scene components; adjusting image capture parameters based on the scene classification generated in said generating step; and acquiring a permanent image based on the image capture parameters adjusted in said adjusting step.
Claim 45
Dependent Claim
44 words
The method of claim 42 , further comprising: prompting a user of the camera with choices of a number of alternate settings; and receiving input from the user in response to user prompts, wherein the photographic expert unit optionally runs in a “guided mode.”
Claim 46
Dependent Claim
16 words
The method of claim 43 , further comprising: receiving user feedback to adjust image capture parameters.
Claim 47
Dependent Claim
29 words
The method of claim 44 , further comprising: automatically learning mapping between input characteristics and image parameters by observing settings input by the user for different kinds of images.
Claim 48
Dependent Claim
20 words
The method of claim 42 , further comprising: determining an intended subjected based on extracted features from the scene classification.
Claim 49
Dependent Claim
25 words
the method of claim 46 , further comprising: choosing a proper focus distance for a subject region of an image of the determined intended subject.
Claim 50
Dependent Claim
24 words
The method of claim 46 , further comprising: choosing a proper exposure for a subject region of an image of the determined intended subject.
Claim 51
Dependent Claim
24 words
The method of claim 48 , further comprising: choosing a shutter speed and aperture combination based upon reflected light from the determined intended subject.
Claim 52
Dependent Claim
29 words
The method of claim 42 , further comprising: generating a plurality of hypotheses of scene classifications; and selecting said scene classification from said plurality of hypotheses of scene classifications.
Claim 53
Dependent Claim
19 words
The method of claim 50 , further comprising: requesting a scene classification choice from a user of the camera.
Claim 54
Dependent Claim
29 words
The method of claim 50 , wherein said scene classification is selected from said plurality of hypotheses of scene classifications based on one of a rules-based or statistical process.
Claim 55
Dependent Claim
20 words
The method of claim 42 , further comprising: saving said scene classification and imaging parameter information associated with an image.
Claim 56
Dependent Claim
39 words
The method of claim 52 , wherein said rules-based or statistical process selects said scene classification as an optimal one of said hypotheses of scene classifications based on at least one of said extracted image features and scene components.
Claim 57
Independent Claim
111 words
A system for automatically setting image acquisition controls of a camera, comprising: a temporary image acquisition unit for acquiring a temporary image; a permanent image acquisition unit with controllable image capture parameters for the acquisition of a permanent image; a scene analysis unit for receiving input from the temporary image acquisition unit, extracting image features and scene components, and using these to generate a parameterized scene classification; and a photographic expert unit for receiving said scene classification from the scene analysis unit and generating as an output image capture parameters, wherein the photographic expert unit adjusts the image capture parameters of the permanent image acquisition unit based on the scene classification.
Claim 58
Independent Claim
111 words
A system for automatically setting image acquisition controls of a camera, comprising: a temporary image acquisition unit for acquiring a temporary image; a permanent image acquisition unit with controllable image capture parameters for the acquisition of a permanent image; a scene analysis unit for receiving input from the temporary image acquisition unit, extracting image features and scene components, and using these to generate a parameterized scene classification; and a photographic expert unit for receiving said scene classification from the scene analysis unit and generating as an output image capture parameters, wherein the photographic expert unit adjusts the image capture parameters of the permanent image acquisition unit based on the scene classification.
Claim 59
Dependent Claim
31 words
The system for automatically setting image acquisition controls of a camera as recited in claim 55 , wherein the temporary image acquisition unit and the permanent image acquisition unit are same.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-10-08 | 2005-04-09 | 2005-10-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-10-08 | 2009-04-09 | 2009-10-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-10-08 | 2013-04-09 | 2013-10-09 | $7700.00 | Window Closed / Lapsed |