US7953690B2
Active / In Force
US
⏱️ 1.2 years remaining
Discovering social relationships from personal photo collections
Assignee: Monument Peak Ventures LLC
•
Filing: 2008-01-25
•
Granted: 2011-05-31
•
Expires: 2028-01-25
Abstract
Abstract A method of categorizing the relationship of individuals from a collection of photos taken in multiple sets of events includes: searching the photo collection to identify individuals in the photo collection, determining the gender and age range of the identified individuals; and using the identified individuals, their occurrences and co-occurrences, their gender, and their ages to infer social relationships between the individuals based on a set of rules.
Inventors
- 👤 Jiebo Luo
- 👤 Parag Singla
- 👤 Henry Kautz
- 👤 Andrew C. Gallagher
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:01
CPC Classifications
G; G06; G06N; G06N20/00; G06N5/00; G06N5/01; G06N7/00; G06N7/01
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
113 words
A method of categorizing the relationship of individuals from a collection of photos taken in multiple sets of events, comprising using a computer for automatically performing the following steps: a. searching the photo collection to identify individuals in the photo collection, and determining the gender and age range of the identified individuals; b. determining occurrences of identified individuals and co-occurrences of identified individuals; and c. performing an inference task using the identified individuals, their occurrences and co-occurrences, their gender, and their age ranges to determine a type of social relationship relationships between a pair of individuals, wherein the types of social relationships include parent, child, spouse, other relative, friend, child's friend, or acquaintance.
Claim 2
Independent Claim
113 words
A method of categorizing the relationship of individuals from a collection of photos taken in multiple sets of events, comprising using a computer for automatically performing the following steps: a. searching the photo collection to identify individuals in the photo collection, and determining the gender and age range of the identified individuals; b. determining occurrences of identified individuals and co-occurrences of identified individuals; and c. performing an inference task using the identified individuals, their occurrences and co-occurrences, their gender, and their age ranges to determine a type of social relationship relationships between a pair of individuals, wherein the types of social relationships include parent, child, spouse, other relative, friend, child's friend, or acquaintance.
Claim 3
Dependent Claim
41 words
The method of claim 1 wherein step c wherein the inference task includes using a set of rules including at least one of the following hard rules: i. parents are older than their children; and ii. spouses are of opposite gender.
Claim 4
Dependent Claim
68 words
The method of claim 2 wherein the set of rules further includes at least one of the following soft rules: iii. parents and grandparents appear with their children or grandchildren; iv. friends and relatives are clustered across photos; v. an acquaintance appears in fewer images than relatives and friends; and vi. people with closer relationships appear closer in photos than those who do not have a close relationship.
Claim 5
Dependent Claim
16 words
The method of claim 1 wherein the inference is performed using a Markov Logic Network (MLN).
Claim 6
Dependent Claim
31 words
The method of claim 1 further comprising one or more of the following: d. adding additional new images to the image collection; or e. identifying new individuals in the new images.
Claim 7
Dependent Claim
40 words
The method of claim 5 further including f. using the identified new individuals, their occurrences and co-occurrences, their gender, and their ages to infer social relationships between the new individuals and the identified individuals based on the set of rules.
Claim 8
Independent Claim
125 words
A method of categorizing the relationship of individuals from a collection of photos taken in multiple sets of events and belonging to an assumed owner, comprising using a computer for automatically performing the following steps: a. searching the photo collection to identify individuals in the photo collection, and determining the gender and age range of the identified individuals; and b. determining occurrences of identified individuals and co-occurrences of identified individuals; and c. performing an inference task using the identified individuals, their occurrences and co-occurrences, their gender, and their age ranges to determine a type of social relationship between the individuals and the assumed owner of the photo collection, wherein the types of social relationships include parent, child, spouse, other relative, friend, child's friend, or acquaintance.
Claim 9
Independent Claim
125 words
A method of categorizing the relationship of individuals from a collection of photos taken in multiple sets of events and belonging to an assumed owner, comprising using a computer for automatically performing the following steps: a. searching the photo collection to identify individuals in the photo collection, and determining the gender and age range of the identified individuals; and b. determining occurrences of identified individuals and co-occurrences of identified individuals; and c. performing an inference task using the identified individuals, their occurrences and co-occurrences, their gender, and their age ranges to determine a type of social relationship between the individuals and the assumed owner of the photo collection, wherein the types of social relationships include parent, child, spouse, other relative, friend, child's friend, or acquaintance.
Claim 10
Dependent Claim
41 words
The method of claim 7 wherein step c wherein the inference task includes using a set of rules including at least one of the following hard rules: i. parents are older than their children; and ii. spouses are of opposite gender.
Claim 11
Dependent Claim
85 words
The method of claim 7 wherein the set of rules further includes at least one of the following soft rules: iii. children of an assumed owner of the photo collection, occur more frequently in the photo collection; iv. parents and grandparents appear with their children or grandchildren; v. friends and relatives are clustered across photos; vi. an acquaintance appears in fewer images than relatives and friends; and vii. people with closer relationships appear closer in photos than those who do not have a close relationship.
Claim 12
Dependent Claim
16 words
The method of claim 7 wherein the inference is performed using a Markov Logic Network (MLN).
Claim 13
Dependent Claim
31 words
The method of claim 7 further comprising one or more of the following: d. adding additional new images to the image collection; or e. identifying new individuals in the new images.
Claim 14
Dependent Claim
45 words
The method of claim 11 further including f. using the identified new individuals, their occurrences and co-occurrences, their gender, and their age ranges to infer social relationships between the new individuals and the assumed owner of the photo collection based on the set of rules.
References Cited (Backward Citations)
US20060045352A1
Cited
US20090153661A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2014-05-30 | 2014-11-29 | 2015-05-31 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2018-05-30 | 2018-11-29 | 2019-05-31 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2022-05-30 | 2022-11-29 | 2023-05-31 | $7700.00 | Window Closed / Lapsed |