Patent US7916894B1 successfully refreshed from Google Patents.
US7916894B1
Active / In Force
US
⏱️ 0.2 years remaining
Summary of a video using faces
Assignee: Adobe Inc
•
Filing: 2007-01-29
•
Granted: 2011-03-29
•
Expires: 2027-01-29
Abstract
Abstract A plurality of sets of face images associated with a video is obtained. Each set of face images corresponds to a particular person depicted in the video. Of the people associated with the plurality of sets of face images, one or more of those people are selected to be included in a facial summary by analyzing the plurality of sets of face images and/or the video. For each of the selected one or more people, a face image to use in the facial summary is selected. The facial summary is laid out using the selected face images.
Inventors
- 👤 Samreen Dhillon
- 👤 Harshdeep Singh
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 12:41
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/70; G06F16/78; G06F16/783; G06F16/7837; G06F16/784; G06F16/73; G06F16/738; G06F16/739
Claims Analysis
Total Claims: 26
Claim 1
Independent Claim
233 words
A method, comprising: obtaining a plurality of sets of face images associated with a video, wherein each set corresponds to a particular person depicted in the video; of the people associated with the plurality of sets of face images, selecting one or more of those people to include in a facial summary by: analyzing the plurality of sets of face images and/or the video; determining an importance value associated with a degree to which a person is prominent within the video for each of the people associated with the plurality of sets of face images, wherein determining the importance value is based at least in part on the analysis including (1) a number of face images in that set and (2) an average face size associated with the face images in that set; and selecting one or more people to include in the facial summary based at least in part on the importance values; for each of the selected one or more people, selecting a face image from a group of potential face images to use in the facial summary based at least in part on the image quality of the potential face images in the group; and using a processor to lay out the facial summary using the selected face images, including by sizing the selected face images in the laid-out facial summary based at least in part on the importance values.
Claim 2
Independent Claim
233 words
A method, comprising: obtaining a plurality of sets of face images associated with a video, wherein each set corresponds to a particular person depicted in the video; of the people associated with the plurality of sets of face images, selecting one or more of those people to include in a facial summary by: analyzing the plurality of sets of face images and/or the video; determining an importance value associated with a degree to which a person is prominent within the video for each of the people associated with the plurality of sets of face images, wherein determining the importance value is based at least in part on the analysis including (1) a number of face images in that set and (2) an average face size associated with the face images in that set; and selecting one or more people to include in the facial summary based at least in part on the importance values; for each of the selected one or more people, selecting a face image from a group of potential face images to use in the facial summary based at least in part on the image quality of the potential face images in the group; and using a processor to lay out the facial summary using the selected face images, including by sizing the selected face images in the laid-out facial summary based at least in part on the importance values.
Claim 3
Dependent Claim
18 words
A method as recited in claim 1 , wherein obtaining includes performing automatic face detection on the video.
Claim 4
Dependent Claim
66 words
A method as recited in claim 1 , wherein selecting one or more people includes one or more of the following: using a maximum number of people, using a number of face images included in a particular set, using face image size, using average face image size for a particular set, or using a duration of time associated with a particular person appearing in the video.
Claim 5
Dependent Claim
30 words
A method as recited in claim 1 , wherein at least one of the face images selected to be used in the facial summary is not obtained from the video.
Claim 6
Dependent Claim
39 words
A method as recited in claim 1 , wherein selecting a face image to use in the facial summary includes, for a given person, selecting a face image from the set of face images associated with the given person.
Claim 7
Dependent Claim
33 words
A method as recited in claim 1 , wherein the image quality used to select the face image includes at least one of: brightness, contrast, sharpness, direction of a person's face, or blinking.
Claim 8
Dependent Claim
45 words
A method as recited in claim 1 , wherein laying out the facial summary includes: dividing a remaining portion of the facial summary into at least two portions; and placing one of the selected face images in one of the portions created by the division.
Claim 9
Dependent Claim
35 words
A method as recited in claim 1 , wherein laying out the facial summary includes adjusting the size of a face image included in the facial summary based at least in part on a ranking.
Claim 10
Dependent Claim
25 words
A method as recited in claim 1 further comprising: receiving a modification to the facial image; and presenting the facial image with the modification applied.
Claim 11
Dependent Claim
34 words
A method as recited in claim 1 further comprising: receiving a modification to the facial image; and presenting the facial image with the modification applied, wherein the modification includes a modification associated with text.
Claim 12
Dependent Claim
39 words
A method as recited in claim 1 further comprising: receiving a modification to the facial image; and presenting the facial image with the modification applied, wherein the modification includes a modification to an object associated with the facial image.
Claim 13
Independent Claim
256 words
A system, comprising: a processor; and a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to: obtain a plurality of sets of face images associated with a video, wherein each set corresponds to a particular person depicted in the video; of the people associated with the plurality of sets of face images, select one or more of those people to include in a facial summary by: analyzing the plurality of sets of face images and/or the video; determining an importance value associated with a degree to which a person is prominent within the video for each of the people associated with the plurality of sets of face images, wherein determining the importance value is based at least in part on the analysis including (1) a number of face images in that set and (2) an average face size associated with the face images in that set; and selecting one or more people to include in the facial summary based at least in part on the importance values; for each of the selected one or more people, select a face image from a group of potential face images to use in the facial summary based at least in part on the image quality of the potential face images in the group; and lay out a facial summary using the selected face images, including by sizing the selected face images in the laid-out facial summary based at least in part on the importance values.
Claim 14
Independent Claim
256 words
A system, comprising: a processor; and a memory coupled with the processor, wherein the memory is configured to provide the processor with instructions which when executed cause the processor to: obtain a plurality of sets of face images associated with a video, wherein each set corresponds to a particular person depicted in the video; of the people associated with the plurality of sets of face images, select one or more of those people to include in a facial summary by: analyzing the plurality of sets of face images and/or the video; determining an importance value associated with a degree to which a person is prominent within the video for each of the people associated with the plurality of sets of face images, wherein determining the importance value is based at least in part on the analysis including (1) a number of face images in that set and (2) an average face size associated with the face images in that set; and selecting one or more people to include in the facial summary based at least in part on the importance values; for each of the selected one or more people, select a face image from a group of potential face images to use in the facial summary based at least in part on the image quality of the potential face images in the group; and lay out a facial summary using the selected face images, including by sizing the selected face images in the laid-out facial summary based at least in part on the importance values.
Claim 15
Dependent Claim
243 words
A computer program product embodied in a non-transitory computer readable storage medium and comprising computer instructions for: obtaining a plurality of sets of face images associated with a video, wherein each set corresponds to a particular person depicted in the video; of the people associated with the plurality of sets of face images, selecting one or more of those people to include in a facial summary by: analyzing the plurality of sets of face images and/or the video; determining an importance value associated with a degree to which a person is prominent within the video for each of the people associated with the plurality of sets of face images, wherein determining the importance value is based at least in part on the analysis including (1) a number of face images in that set and (2) an average face size associated with the face images in that set; and selecting one or more people to include in the facial summary based at least in part on the importance values; for each of the selected one or more people, selecting a face image from a group of potential face images to use in the facial summary based at least in part on the image quality of the potential face images in the group; and laying out the facial summary using the selected face images, including by sizing the selected face images in the laid-out facial summary based at least in part on the importance values.
Claim 16
Dependent Claim
243 words
A computer program product embodied in a non-transitory computer readable storage medium and comprising computer instructions for: obtaining a plurality of sets of face images associated with a video, wherein each set corresponds to a particular person depicted in the video; of the people associated with the plurality of sets of face images, selecting one or more of those people to include in a facial summary by: analyzing the plurality of sets of face images and/or the video; determining an importance value associated with a degree to which a person is prominent within the video for each of the people associated with the plurality of sets of face images, wherein determining the importance value is based at least in part on the analysis including (1) a number of face images in that set and (2) an average face size associated with the face images in that set; and selecting one or more people to include in the facial summary based at least in part on the importance values; for each of the selected one or more people, selecting a face image from a group of potential face images to use in the facial summary based at least in part on the image quality of the potential face images in the group; and laying out the facial summary using the selected face images, including by sizing the selected face images in the laid-out facial summary based at least in part on the importance values.
Claim 17
Dependent Claim
35 words
A computer program product as recited in claim 13 , wherein the computer instructions for selecting one or more people include computer instructions for using a number of face images included in a particular set.
Claim 18
Dependent Claim
28 words
A computer program product as recited in claim 13 , wherein the computer instructions for selecting one or more people include computer instructions for using face image size.
Claim 19
Dependent Claim
35 words
A computer program product as recited in claim 13 , wherein the image quality used to select the face image includes at least one of: brightness, contrast, sharpness, direction of a person's face, or blinking.
Claim 20
Dependent Claim
35 words
A computer program product as recited in claim 13 , the computer program product further comprising computer instructions for: receiving a modification to the facial image; and presenting the facial image with the modification applied.
Claim 21
Dependent Claim
33 words
A system as recited in claim 12 , wherein the image quality used to select the face image includes at least one of: brightness, contrast, sharpness, direction of a person's face, or blinking.
Claim 22
Dependent Claim
45 words
A system as recited in claim 12 , wherein laying out the facial summary includes: dividing a remaining portion of the facial summary into at least two portions; and placing one of the selected face images in one of the portions created by the division.
Claim 23
Dependent Claim
47 words
A computer program product as recited in claim 13 , wherein laying out the facial summary includes: dividing a remaining portion of the facial summary into at least two portions; and placing one of the selected face images in one of the portions created by the division.
Claim 24
Dependent Claim
65 words
A method as recited in claim 1 , wherein determining the importance value further includes using (w 1 *F i )+(w 2 *R i ) as the importance value where w 1 and w 2 are weighting factors, F i is said number of face images in that set, and R i is said average face size associated with the face images in that set.
Claim 25
Dependent Claim
70 words
A system as recited in claim 12 , wherein the processor is configured to determine the importance value further by using (w 1 *F i )+(w 2 *R i ) as the importance value where w 1 and w 2 are weighting factors, F i is said number of face images in that set, and R i is said average face size associated with the face images in that set.
Claim 26
Dependent Claim
74 words
A computer program product as recited in claim 13 , wherein the computer instructions for determining the importance value further include computer instructions for using (w 1 *F i )+(w 2 *R i ) as the importance value where w 1 and w 2 are weighting factors, F i is said number of face images in that set, and R i is said average face size associated with the face images in that set.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2014-03-28 | 2014-09-27 | 2015-03-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2018-03-28 | 2018-09-27 | 2019-03-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2022-03-28 | 2022-09-27 | 2023-03-29 | $7700.00 | Window Closed / Lapsed |