US7206022B2 — Camera system with eye monitoring

Claim 1

Independent Claim 282 words

A camera system comprising: an image capture system for capturing an archival image of a scene during an archival image capture sequence including a composition phase before an image capture phase during which the archival image is captured; an eye monitoring system adapted to determine eye information from including a direction of the gaze of an eye of a user; a source of context information; and a controller adapted to use the eye monitoring system to determine eye information from which a path of eye gaze direction can be determined that represents a path of eye gaze direction during a range of different times during the archival image capture sequence; and to store the eye information and context information during the archival image capture sequence and to associate the stored information with the archival image captured during the archival image capture sequence; wherein the controller causes the image capture system to capture a set of evaluation images during the composition phase of the archival image capture sequence and the source of context information comprises an image processor adapted to determine image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images and wherein the controller causes the image capture system to capture a set of evaluation images during the archival image capture sequence; and, wherein said image processor adapted to determine information characterizing changes in the field of view of the archival image capture system by assembling a composite image mapping all portions of the scene imaged by any of the set of captured evaluation images and said processor records eye gaze information in relation to the assembled composite.

Claim 2

Dependent Claim 282 words

A camera system comprising: an image capture system for capturing an archival image of a scene during an archival image capture sequence including a composition phase before an image capture phase during which the archival image is captured; an eye monitoring system adapted to determine eye information from including a direction of the gaze of an eye of a user; a source of context information; and a controller adapted to use the eye monitoring system to determine eye information from which a path of eye gaze direction can be determined that represents a path of eye gaze direction during a range of different times during the archival image capture sequence; and to store the eye information and context information during the archival image capture sequence and to associate the stored information with the archival image captured during the archival image capture sequence; wherein the controller causes the image capture system to capture a set of evaluation images during the composition phase of the archival image capture sequence and the source of context information comprises an image processor adapted to determine image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images and wherein the controller causes the image capture system to capture a set of evaluation images during the archival image capture sequence; and, wherein said image processor adapted to determine information characterizing changes in the field of view of the archival image capture system by assembling a composite image mapping all portions of the scene imaged by any of the set of captured evaluation images and said processor records eye gaze information in relation to the assembled composite.

Claim 3

Dependent Claim 33 words

The camera system of claim 1 , wherein the eye information determined by the eye monitoring system further includes information characterizing changes in the diameter of the pupil during the image capture sequence.

Claim 4

Dependent Claim 28 words

The camera system of claim 1 , wherein the eye information determined by the eye monitoring system further includes information characterizing eye temperature during the image capture sequence.

Claim 5

Dependent Claim 38 words

The camera system of claim 1 , wherein the controller determines eye information further includes data from which the amount of dwell time at each location, or the acceleration of eye gaze position during movement can be determined.

Claim 6

Dependent Claim 27 words

The camera system of claim 1 , wherein the eye information determined by the eye monitoring system further includes eye information from both eyes of the user.

Claim 7

Dependent Claim 37 words

The camera system of claim 5 , wherein the controller is further adapted to determine focus distance information during the image capture sequence based upon parallax differences between the eye gaze direction of both eyes of observer.

Claim 8

Dependent Claim 30 words

The camera system of claim 5 , wherein the controller is further adapted to compare eye gaze direction information determined from monitoring of both eyes of the observer for validation.

Claim 9

Dependent Claim 55 words

The camera system of claim 1 , further comprising an input transducer adapted to generate signals in response to manual input from a user of the camera system and wherein said controller is adapted to store input transducer information during the image capture sequence and to associate the input transducer information with the scene image.

Claim 10

Dependent Claim 36 words

The camera system of claim 1 , wherein the image capture system is a digital image capture system operable to form evaluation images during image composition and further comprising a display to present the evaluation images.

Claim 11

Dependent Claim 39 words

The camera system of claim 1 , further comprising an additional image capture system adapted to store scene images on a photosensitive medium and having a write head to optically record the stored eye information on the photosensitive medium.

Claim 12

Dependent Claim 46 words

The camera system of claim 1 , wherein the controller stores the eye information apart from the scene image and the controller associates the scene image with the eye information by recording data with the scene image which can be used to locate the eye information.

Claim 13

Dependent Claim 26 words

The camera system of claim 1 , wherein the source of context information comprises a location detector adapted to determine where the archival image was captured.

Claim 14

Dependent Claim 69 words

The camera system of claim 1 , wherein the controller causes the image capture system to capture a set of evaluation images during a composition phase of the archival image capture sequence and the source of context information comprises an image processor adapted to determine image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images.

Claim 15

Dependent Claim 75 words

The camera system of claim 1 , wherein the controller causes the image capture system to capture a set of evaluation images during a composition phase of the archival image capture sequence and the source of context information comprises an image processor adapted to determine image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images to locate fiducials in the image.

Claim 16

Dependent Claim 63 words

The camera system of claim 1 , wherein said controller comprises said source of context information and said controller is adapted to cause the image capture system to capture evaluation images during the image capture sequence and to store the captured evaluation images in association with the captured archival image with said evaluation images being captured at different times than said archival image.

Claim 17

Dependent Claim 51 words

The camera system of claim 1 , wherein the source of context information comprises a manual input and the controller monitors the manual input during the image capture sequence and associates information characterizing changes in the status of the manual input during the image capture process with the captured archival image.

Claim 18

Dependent Claim 31 words

The camera system of claim 16 , wherein the image capture system comprises a taking lens unit having an adjustable zoom setting and the manual input comprises a zoom setting input.

Claim 19

Dependent Claim 45 words

The camera system of claim 16 , wherein the image capture system comprises a taking lens unit having an adjustable zoom setting and the manual input comprises a zoom setting input with the controller adjusting the eye gaze information based upon the zoom setting input.

Claim 20

Dependent Claim 18 words

The camera system of claim 1 , wherein the source of context data comprises a scene brightness detector.

Claim 21

Dependent Claim 49 words

The camera system of claim 1 , wherein the image capture system captures the archival image in the form of a digital archival image signal and the controller stores the electronic archival image signal in association with the eye movement data signal and the context information in digital form.

Claim 22

Dependent Claim 42 words

The camera system of claim 1 , further comprising an archival image capture system that captures the archival image on a photosensitive element and further comprising a recording head for optically recording the eye information and context information on the photosensitive element.

Claim 23

Dependent Claim 42 words

The camera system of claim 1 , further comprising an archival capture system that captures images on a photosensitive element and the archival image capture system comprises a film data recorder for recording the eye information and context information onto the film.

Claim 24

Dependent Claim 50 words

The camera system of claim 1 , wherein the eye monitoring system comprises an optical system that presents light from the scene to form an image of the scene at an eye of an observer and an eye camera that captures images of the eye during the image capture sequence.

Claim 25

Dependent Claim 42 words

The camera system of claim 23 , wherein a beam splitter is disposed in the optical path between the scene and the eye of the observer, with the beam splitter adapted to deflect an image of the eye to the eye camera.

Claim 26

Dependent Claim 28 words

The camera system of claim 23 , wherein the eye monitoring system further comprises an image processor to examine the eye images and to determine eye gaze direction.

Claim 27

Dependent Claim 36 words

The camera of claim 23 , wherein the eye monitoring system comprises an eye camera that further detects pupil dilation and wherein the controller is further adapted to incorporate pupil dilation information in the eye information.

Claim 28

Dependent Claim 134 words

The camera system of claim 1 , wherein said processor is further adapted to perform an evaluation image capture sequence during composition and wherein an evaluation image display is adapted to present captured evaluation images to a display space for observation by a user and wherein the user can observe the scene either directly or through the display, an eye imager capturing images of the display space and wherein said controller is further adapted to receive images from the eye imager and to map the eye gaze direction of an eye of the user relative to the scene both when the eye in the display space is directed at the scene directly or at the scene as displayed on the display in order to determine eye information characterizing eye gaze direction of the eye.

Claim 29

Dependent Claim 32 words

The camera system of claim 27 , further comprising a beam splitter interposed between the display and the eye with the beam splitter reflecting light from the eye onto the eye imager.

Claim 30

Dependent Claim 18 words

The camera system of claim 1 , wherein the camera system is incorporated into a set of glasses.

Claim 31

Independent Claim 227 words

A method for operating a camera system comprising the steps of: capturing an archival image of a scene during an archival image capture sequence including a composition phase before an image capture phase during which the archival image is captured; obtaining context information; determining eye information including a direction of the gaze of an eye of a user from which a path of eye gaze direction can be determined that represents a path of eye gaze direction during a range of different times during the archival image capture sequence; storing the eye information and context information during the archival image capture sequence; and associating the stored eye information and context information with the archival image captured during the archival image capture sequence; wherein a set of evaluation images is captured during the composition phase of the archival image capture sequence and the step of obtaining context information comprises determining image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images and, wherein the image information characterizing changes in the field of view of the archival image capture system is determined by assembling a composite image mapping all portions of the scene imaged by any of the set of captured evaluation images and the eye gaze information is mapped in relation to the assembled composite.

Claim 32

Independent Claim 227 words

A method for operating a camera system comprising the steps of: capturing an archival image of a scene during an archival image capture sequence including a composition phase before an image capture phase during which the archival image is captured; obtaining context information; determining eye information including a direction of the gaze of an eye of a user from which a path of eye gaze direction can be determined that represents a path of eye gaze direction during a range of different times during the archival image capture sequence; storing the eye information and context information during the archival image capture sequence; and associating the stored eye information and context information with the archival image captured during the archival image capture sequence; wherein a set of evaluation images is captured during the composition phase of the archival image capture sequence and the step of obtaining context information comprises determining image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images and, wherein the image information characterizing changes in the field of view of the archival image capture system is determined by assembling a composite image mapping all portions of the scene imaged by any of the set of captured evaluation images and the eye gaze information is mapped in relation to the assembled composite.

Claim 33

Dependent Claim 27 words

The method of claim 30 , further comprising the step of storing the eye gaze information with the archival image in a memory outside of the camera.

Claim 34

Dependent Claim 49 words

The method of claim 30 , wherein the step of monitoring eye information includes monitoring a diameter of a pupil of the eye, and wherein the step of determining eye information includes determining a pattern of changes in pupil diameter during the composition phase and the image capture phase.

Claim 35

Dependent Claim 83 words

The method of claim 30 , further comprising the steps of forming an evaluation image corresponding to the captured archival image and presenting the evaluation image to the user of the camera system; monitoring eye information including eye gaze information during presentation of the evaluation image; and determining further eye information representing a pattern of changes in eye gaze direction during presentation of the evaluation image over a time period after capture of the archival image and wherein the evaluation image is presented.

Claim 36

Dependent Claim 33 words

The method of claim 30 , wherein the camera system has a user interface adapted to receive user inputs and the step of determining context information comprises monitoring changes in the user inputs.

Claim 37

Independent Claim 243 words

A method for operating a camera system comprising the steps of: means for capturing an archival image of a scene during an archival image capture sequence including a composition phase before an image capture phase during which the archival image is captured; means for using an eye monitoring system to determine eye information including a direction of the gaze of an eye of a user from which a path of eye gaze direction can be determined that represents a path of eye gaze direction during a range of different times during the archival image capture sequence; means for obtaining context information; means for storing the eye information and context information during the archival image capture sequence; and means for associating the stored eye information and context information with the archival image captured during the archival image capture sequence; wherein a set of evaluation images is captured during the composition phase of the archival image capture sequence and the step of obtaining context information comprises determining image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images and, wherein the image information characterizing changes in the field of view of the archival image capture system is determined by assembling a composite image mapping all portions of the scene imaged by any of the set of captured evaluation images and the eye gaze information is mapped in relation to the assembled composite.

Claim 38

Independent Claim 243 words

A method for operating a camera system comprising the steps of: means for capturing an archival image of a scene during an archival image capture sequence including a composition phase before an image capture phase during which the archival image is captured; means for using an eye monitoring system to determine eye information including a direction of the gaze of an eye of a user from which a path of eye gaze direction can be determined that represents a path of eye gaze direction during a range of different times during the archival image capture sequence; means for obtaining context information; means for storing the eye information and context information during the archival image capture sequence; and means for associating the stored eye information and context information with the archival image captured during the archival image capture sequence; wherein a set of evaluation images is captured during the composition phase of the archival image capture sequence and the step of obtaining context information comprises determining image information characterizing changes in the composition of the scene during the composition phase based on image analysis of the set of evaluation images and, wherein the image information characterizing changes in the field of view of the archival image capture system is determined by assembling a composite image mapping all portions of the scene imaged by any of the set of captured evaluation images and the eye gaze information is mapped in relation to the assembled composite.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	2010-04-16	2010-10-16	2011-04-17	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2014-04-16	2014-10-16	2015-04-17	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2018-04-16	2018-10-16	2019-04-17	$7700.00	Window Closed / Lapsed

Camera system with eye monitoring

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag