US7558408B1 — Classification system for consumer digital images…

Claim 1

Independent Claim 404 words

A processor-based image acquisition and processing system comprising a lens and image sensor for acquiring a digital image, a processor, and one or more digital data storage media having digitally-embedded programming instruction therein, the processor operating according to the digitally-embedded programming instructions and communicating with the one or more digital data storage media for classifying and archiving images including face regions that are acquired with an image acquisition device, the programming instructions comprising: a face detection module for identifying a group of pixels corresponding to a face region within digital image data acquired by the acquisition device; a normalization module for generating a normalized face region from said face region; face recognition module for extracting a set of values of face classifier parameters from said normalized face region, said set of face classifier parameter values being collectively known as a faceprint associated with said normalized face region; a workflow module for comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, and for determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, and for associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints; a database module for archiving the data according to the associating by the workflow module within one or more digital data storage media; and a set of user interface modules for obtaining user input in the classifying of faceprints and their associated normalized face regions and parent images; and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining by the workflow module comprises a further confirmation to determine whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of an identity match and at least one determination that the identities do not match.

Claim 2

Dependent Claim 404 words

A processor-based image acquisition and processing system comprising a lens and image sensor for acquiring a digital image, a processor, and one or more digital data storage media having digitally-embedded programming instruction therein, the processor operating according to the digitally-embedded programming instructions and communicating with the one or more digital data storage media for classifying and archiving images including face regions that are acquired with an image acquisition device, the programming instructions comprising: a face detection module for identifying a group of pixels corresponding to a face region within digital image data acquired by the acquisition device; a normalization module for generating a normalized face region from said face region; face recognition module for extracting a set of values of face classifier parameters from said normalized face region, said set of face classifier parameter values being collectively known as a faceprint associated with said normalized face region; a workflow module for comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, and for determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, and for associating the new faceprint and normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints; a database module for archiving the data according to the associating by the workflow module within one or more digital data storage media; and a set of user interface modules for obtaining user input in the classifying of faceprints and their associated normalized face regions and parent images; and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining by the workflow module comprises a further confirmation to determine whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of an identity match and at least one determination that the identities do not match.

Claim 3

Dependent Claim 31 words

The system of claim 1 , wherein the archiving further for enabling further comparisons with further faceprints and for recalling the faceprints and their associated normalized face regions and parent images.

Claim 4

Dependent Claim 38 words

The system of claim 1 , wherein the archiving further comprises grouping the new faceprint with a new or prior face class defined by sets of face classifier parameter boundary values corresponding to the new or known identity.

Claim 5

Dependent Claim 33 words

The system of claim 1 , wherein the identifying by the face detection module further comprises presenting a thumbnail representation of a face candidate region, and receiving user input relevant to the identifying.

Claim 6

Dependent Claim 50 words

The system of claim 1 , wherein the comparing by the face recognition module further comprises presenting to the user one or more previously-archived faceprints, or thumbnails thereof, previously determined to correspond to one or more known identities, and receiving user input relevant to the comparison with the new faceprint.

Claim 7

Dependent Claim 40 words

The system of claim 1 , wherein the programming instructions further comprise providing interactive access to the user of data associated with the identities, faceprints, associated normalized face regions or parent images acquired with a digital camera, or combinations thereof.

Claim 8

Dependent Claim 37 words

The system of claim 6 , wherein the data comprises identity data, relationship data, personal data, group membership data, events and occasions data, location-based data, image category data or data stored within image metadata, or combinations thereof.

Claim 9

Dependent Claim 21 words

The system of claim 6 , wherein the data comprises image data, identity data or face recognition data, or combinations thereof.

Claim 10

Dependent Claim 32 words

The system of claim 1 , wherein the programming instructions comprise instructions for receiving data management editing from the user regarding image data, identity data or face recognition data, or combinations thereof.

Claim 11

Dependent Claim 32 words

The system of claim 1 , wherein the programming instructions comprise instructions for receiving data management editing from the user regarding statistical thresholds utilized in the comparing by the face recognition module.

Claim 12

Dependent Claim 31 words

The system of claim 10 , wherein the programming instructions further comprise instructions for receiving data management editing from the user regarding automated learning or adaptive recognition enhancement processes, or both.

Claim 13

Dependent Claim 24 words

The system of claim 1 , wherein the programming instructions comprise instructions for providing utilization access by the user of added value services tools.

Claim 14

Dependent Claim 45 words

The system of claim 12 , wherein the added value services tools comprise slideshow generation tools, print tools, web publisher tools, face detection tools, face recognition tools, or image enhancement tools based on the presence and location of faces in an image, or combinations thereof.

Claim 15

Dependent Claim 42 words

The system of claim 1 , wherein the comparing by the face recognition module further comprises receiving and processing user input regarding whether the faceprint and associated normalized face region corresponds to a known identity or matches a previously-archived faceprint, or both.

Claim 16

Dependent Claim 61 words

The system of claim 1 , wherein the database module further for associating the new face print image with a new or known identity by grouping the new face print image with a new or prior face class defined by range values of one or more face classifier parameters for performing further comparisons with further faceprints and for recalling the faceprints.

Claim 17

Dependent Claim 49 words

The system of claim 1 , wherein the programming instructions are stored on or accessible by a stand alone processor-based device configured for receiving raw image data from a digital camera, and the device being coupled with or including user interface hardware, and upon which the classifying is performed.

Claim 18

Dependent Claim 44 words

The system of claim 1 , wherein the programming instructions are stored at least in part on an embedded appliance for performing some image classifying-related processing prior to outputting processed image data to a further processor-based device upon which the classifying is further performed.

Claim 19

Dependent Claim 14 words

The system of claim 17 , wherein the embedded appliance comprises a digital camera.

Claim 20

Dependent Claim 26 words

The system of claim 18 , wherein the digital camera comprises a dedicated digital camera or a camera-capable handheld pda or phone, or a combination thereof.

Claim 21

Dependent Claim 49 words

The system of claim 1 , wherein the programming instructions are stored at least in part on a processor-based device connected to a network for performing some image classifying-related processing on the device prior to outputting processed data to a back-end server upon which the classifying is further performed.

Claim 22

Dependent Claim 31 words

The system of claim 1 , wherein the identifying by the face detection module or the comparing by the face recognition module, or both, comprise receiving and utilizing user input confirmation.

Claim 23

Dependent Claim 38 words

The system of claim 1 , wherein the identifying by the face detection module or the comparing by the face recognition module, or both, are configured for auto-processing subject to selective disablement of the auto-processing by a user.

Claim 24

Dependent Claim 63 words

The system of claim 1 , wherein the identifying by the face detection module applies automatic face region identification when a detection probability is calculated to be above a detection probability threshold or the comparing by the face recognition module applies automatic identity recognition when a matching probability with a prior faceprint is calculated to be above a matching probability threshold, or both.

Claim 25

Dependent Claim 20 words

The system of claim 23 , wherein the detection probability threshold or the matching probability threshold, or both, are adjustable.

Claim 26

Dependent Claim 34 words

The system of claim 24 , wherein the detection threshold or the matching threshold, or both, are adjustable by a user, a manufacturer, or an adaptive learning program of the system, or combinations thereof.

Claim 27

Dependent Claim 28 words

The system of claim 1 , wherein the programming instructions are stored on or accessible by processor-based components within a digital camera upon which the classifying is performed.

Claim 28

Dependent Claim 331 words

One or more processor-readable digital data storage media having programming instructions embedded therein for programming a processor to classify images including face regions that are acquired with an image acquisition device, the programming instructions comprising: a workflow module providing for the automatic or semiautomatic processing of identified face regions within digital images from which normalized face classifier parameter values are extracted and collectively referred to as a faceprint, the processing comprising: comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, and associating the new faceprint and a normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media; and a set of user interface modules for obtaining user input in the classifying of faceprints and their associated normalized face regions and parent images; and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining by the workflow module comprises a further confirmation to determine whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of an identity match and at least one determination that the identities do not match.

Claim 29

Dependent Claim 331 words

One or more processor-readable digital data storage media having programming instructions embedded therein for programming a processor to classify images including face regions that are acquired with an image acquisition device, the programming instructions comprising: a workflow module providing for the automatic or semiautomatic processing of identified face regions within digital images from which normalized face classifier parameter values are extracted and collectively referred to as a faceprint, the processing comprising: comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities, determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities, and associating the new faceprint and a normalized face region from which said faceprint is derived with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media; and a set of user interface modules for obtaining user input in the classifying of faceprints and their associated normalized face regions and parent images; and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing by the workflow module comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining by the workflow module comprises a further confirmation to determine whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of an identity match and at least one determination that the identities do not match.

Claim 30

Dependent Claim 31 words

The system of claim 27 , wherein the archiving further for enabling further comparisons with further faceprints and for recalling the faceprints and their associated normalized face regions and parent images.

Claim 31

Dependent Claim 38 words

The system of claim 27 , wherein the archiving further comprises grouping the new faceprint with a new or prior face class defined by sets of face classifier parameter boundary values corresponding to the new or known identity.

Claim 32

Dependent Claim 40 words

The system of claim 27 , wherein the programming instructions further comprise providing interactive access to the user of data associated with the identities, faceprints, associated normalized face regions or parent images acquired with a digital camera, or combinations thereof.

Claim 33

Dependent Claim 37 words

The system of claim 30 , wherein the data comprises identity data, relationship data, personal data, group membership data, events and occasions data, location-based data, image category data or data stored within image metadata, or combinations thereof.

Claim 34

Dependent Claim 21 words

The system of claim 30 , wherein the data comprises image data, identity data or face recognition data, or combinations thereof.

Claim 35

Dependent Claim 32 words

The system of claim 27 , wherein the programming instructions comprise instructions for receiving data management editing from the user regarding image data, identity data or face recognition data, or combinations thereof.

Claim 36

Dependent Claim 27 words

The system of claim 27 , wherein the programming instructions comprise instructions for receiving data management editing from the user regarding statistical thresholds utilized in the comparing.

Claim 37

Dependent Claim 31 words

The system of claim 34 , wherein the programming instructions further comprise instructions for receiving data management editing from the user regarding automated learning or adaptive recognition enhancement processes, or both.

Claim 38

Dependent Claim 24 words

The system of claim 27 , wherein the programming instructions comprise instructions for providing utilization access by the user of added value services tools.

Claim 39

Dependent Claim 45 words

The system of claim 36 , wherein the added value services tools comprise slideshow generation tools, print tools, web publisher tools, face detection tools, face recognition tools, or image enhancement tools based on the presence and location of faces in an image, or combinations thereof.

Claim 40

Dependent Claim 49 words

The system of claim 27 , wherein the programming instructions are stored on or accessible by a stand alone processor-based device configured for receiving raw image data from a digital camera, and the device being coupled with or including user interface hardware, and upon which the classifying is performed.

Claim 41

Dependent Claim 44 words

The system of claim 27 , wherein the programming instructions are stored at least in part on an embedded appliance for performing some image classifying-related processing prior to outputting processed image data to a further processor-based device upon which the classifying is further performed.

Claim 42

Dependent Claim 14 words

The system of claim 39 , wherein the embedded appliance comprises a digital camera.

Claim 43

Dependent Claim 26 words

The system of claim 40 , wherein the digital camera comprises a dedicated digital camera or a camera-capable handheld pda or phone, or a combination thereof.

Claim 44

Dependent Claim 49 words

The system of claim 27 , wherein the programming instructions are stored at least in part on a processor-based device connected to a network for performing some image classifying-related processing on the device prior to outputting processed data to a back-end server upon which the classifying is further performed.

Claim 45

Dependent Claim 28 words

The system of claim 27 , wherein the programming instructions are stored on or accessible by processor-based components within a digital camera upon which the classifying is performed.

Claim 46

Independent Claim 306 words

A method for classifying and archiving images including face regions that are acquired with an image acquisition device, comprising, using a processor to perform the steps of: (a) generating a normalized face region from an identified face region within digital image data acquired by the acquisition device; (b) automatically extracting a set of face classifier parameter values, collectively referred to as a faceprint, from the normalized face region; (c) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities; (d) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities; (e) associating the new faceprint with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media; and (f) obtaining user input in the classifying of faceprints and their associated normalized face regions and parent images; and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining comprises a further confirmation to determine whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of all identity match and at least one determination that the identities do not match.

Claim 47

Independent Claim 306 words

A method for classifying and archiving images including face regions that are acquired with an image acquisition device, comprising, using a processor to perform the steps of: (a) generating a normalized face region from an identified face region within digital image data acquired by the acquisition device; (b) automatically extracting a set of face classifier parameter values, collectively referred to as a faceprint, from the normalized face region; (c) automatically comparing said extracted faceprint to a database of archived faceprints previously determined to correspond to one or more known identities; (d) determining based on the comparing whether a new faceprint corresponds to any of the one or more known identities; (e) associating the new faceprint with a new or known identity within a database comprising other data corresponding to the archived faceprints and associated parent images for performing further comparisons with further faceprints, to permit data corresponding to the new faceprint and its associated parent image to be archived according to the associating by the workflow module within one or more digital data storage media; and (f) obtaining user input in the classifying of faceprints and their associated normalized face regions and parent images; and wherein one or more archived faceprints have been previously determined to correspond to the one or more known identities, and the comparing comprises determining proximities of the values of the face classifier parameters of the new face print image with values corresponding to the one or more archived faceprints, and wherein the determining comprises a further confirmation to determine whether the new faceprint corresponds to a known identity when comparisons of the face classifier parameter values of a first faceprint with multiple archived faceprints corresponding to a same known identity result in at least one determination of all identity match and at least one determination that the identities do not match.

Claim 48

Dependent Claim 29 words

The method of claim 44 , further comprising archiving the new faceprint and its associated parent image, according to the associating, within one or more digital data storage media.

Claim 49

Dependent Claim 29 words

The method of claim 45 , wherein the archiving enables further comparisons with further faceprints and for recalling the faceprints and their associated normalized face regions and parent images.

Claim 50

Dependent Claim 38 words

The method of claim 45 , wherein the archiving further comprises grouping the new faceprint with a new or prior face class defined by sets of face classifier parameter boundary values corresponding to the new or known identity.

Claim 51

Dependent Claim 32 words

The method of claim 44 , further comprising interactively accessing data output associated with the identities, faceprints, associated normalized face regions or parent images acquired with a digital camera, or combinations thereof.

Claim 52

Dependent Claim 25 words

The method of claim 44 , further comprising receiving data management editing input regarding image data, identity data or face recognition data, or combinations thereof.

Claim 53

Dependent Claim 22 words

The method of claim 44 , further comprising receiving data management editing from the user regarding statistical thresholds utilized in the comparing.

Claim 54

Dependent Claim 23 words

The method of claim 50 , further comprising receiving data management editing input regarding automated learning or adaptive recognition enhancement processes, or both.

Claim 55

Dependent Claim 17 words

The method of claim 44 , further comprising providing utilization access output of added value services tools.

Claim 56

Dependent Claim 12 words

The method of claim 44 , wherein the extracting is performed automatically.

Claim 57

Dependent Claim 12 words

The method of claim 44 , wherein the comparing is performed automatically.

Claim 58

Dependent Claim 12 words

The method of claim 54 , wherein the extracting is performed automatically.

Claim 59

Dependent Claim 23 words

The method of claim 44 , further comprising digitally organizing and selectively recalling said new and archived faceprints and the associated parent images.

Claim 60

Dependent Claim 18 words

The method of claim 44 , further comprising determining that the face region has a particular pose aspect.

Claim 61

Dependent Claim 33 words

The method of claim 57 , further comprising completing the recognition process by comparing and determining a match of face classifier parameters with a previously determined known identity sharing a similar pose aspect.

Claim 62

Dependent Claim 16 words

The method of claim 44 , wherein the generating comprises pose normalizing the identified face region.

Claim 63

Dependent Claim 38 words

The system of claim 1 , wherein the further confirmation comprises automatically determining that the new face print image corresponds to a know identity based on one or more geometric distance proximities being within a predetermined proximity threshold.

Claim 64

Dependent Claim 45 words

The one or more processor-readable digital data storage media of claim 27 , wherein the further confirmation comprises automatically determining that the new face print image corresponds to a know identity based on one or more geometric distance proximities being within a predetermined proximity threshold.

Claim 65

Dependent Claim 38 words

The method of claim 44 , wherein the further confirmation comprises automatically determining that the new face print image corresponds to a know identity based on one or more geometric distance proximities being within a predetermined proximity threshold.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	2012-07-06	2013-01-05	2013-07-07	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2016-07-06	2017-01-05	2017-07-07	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2020-07-06	2021-01-05	2021-07-07	$7700.00	Window Closed / Lapsed

Classification system for consumer digital images using workflow and user interface modules, and face detection and recognition

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag