Patent US8139826B2 successfully refreshed from Google Patents.
US8139826B2
Active / In Force
US
⏱️ 1.6 years remaining
Device and method for creating photo album
Assignee: Fujifilm Corp
•
Filing: 2008-06-09
•
Granted: 2012-03-20
•
Expires: 2028-06-09
Abstract
Abstract A device for automatically creating a photo album is disclosed. A face detection unit detects faces from an inputted image, an inclination determining unit determines an inclination of the inputted image based on inclinations of the faces, a temporary trimming reference area determining unit determines a trimming reference area containing one or more of the faces, a temporary trimming reference point determining unit determines a trimming reference point in the trimming reference area, an image rotating unit rotates the inputted image depending on the inclination of the inputted image, a trimming unit sets in the inputted image a layout frame of an image insertion area of a photo album template such that the layout reference point is positioned on the trimming reference point and the trimming reference area is contained within the layout frame and carries out trimming, and a template composition unit combines the trimmed area with the template.
Inventors
- 👤 Masayuki Ryuto
- 👤 Kei Yamaji
- 👤 Sakiko Narumi
- 👤 Ryo Tabata
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:42
CPC Classifications
G; G06; G06T; G06T11/00; G06T11/60; G06V; G06V10/00; G06V10/20; G06V10/24; G06V10/243; G06V40/00; G06V40/10; G06V40/16; G06V40/161
Claims Analysis
Total Claims: 13
Claim 1
Independent Claim
328 words
A photo album creating device comprising: a face detection unit to detect at least one person's face region from an inputted image; an inclination determining unit to calculate an inclination of each of the at least one person based on content characteristics of the person and to determine an inclination of the inputted image based on the calculated inclination; an image rotating unit to rotate the inputted image depending on the inclination of the inputted image; a trimming reference area determining unit to determine a trimming reference area in the rotated inputted image, the trimming reference area containing one or more of the at least one face region detected by the face detection unit; a trimming reference point determining unit to determine a trimming reference point in the trimming reference area; a template for the photo album associated with at least one image insertion area for receiving an inserted image, and a layout reference point arbitrarily set in each image insertion area, the template including at least one layout frame, each layout frame representing an outline of each image insertion area; a trimming unit to set in the inputted image one of the at least one layout frame and trim the inputted image along the set layout frame, wherein the layout frame is set such that the layout reference point is positioned on the trimming reference point and the trimming reference area is contained in the layout frame; and a template composition unit to combine an area of the trimmed inputted image with the template, and further comprising a main subject determining unit to determine a main subject from the at least one person detected by the face detection unit based on content characteristics of the at least one person, wherein the inclination determining unit weights the inclination of each of the at least one person such that a larger weight is assigned to the inclination of the main subject to determine the inclination of the inputted image.
Claim 2
Dependent Claim
328 words
A photo album creating device comprising: a face detection unit to detect at least one person's face region from an inputted image; an inclination determining unit to calculate an inclination of each of the at least one person based on content characteristics of the person and to determine an inclination of the inputted image based on the calculated inclination; an image rotating unit to rotate the inputted image depending on the inclination of the inputted image; a trimming reference area determining unit to determine a trimming reference area in the rotated inputted image, the trimming reference area containing one or more of the at least one face region detected by the face detection unit; a trimming reference point determining unit to determine a trimming reference point in the trimming reference area; a template for the photo album associated with at least one image insertion area for receiving an inserted image, and a layout reference point arbitrarily set in each image insertion area, the template including at least one layout frame, each layout frame representing an outline of each image insertion area; a trimming unit to set in the inputted image one of the at least one layout frame and trim the inputted image along the set layout frame, wherein the layout frame is set such that the layout reference point is positioned on the trimming reference point and the trimming reference area is contained in the layout frame; and a template composition unit to combine an area of the trimmed inputted image with the template, and further comprising a main subject determining unit to determine a main subject from the at least one person detected by the face detection unit based on content characteristics of the at least one person, wherein the inclination determining unit weights the inclination of each of the at least one person such that a larger weight is assigned to the inclination of the main subject to determine the inclination of the inputted image.
Claim 3
Dependent Claim
28 words
The photo album creating device as claimed in claim 1 , wherein the face detection unit detects a person's face of a main subject in the inputted image.
Claim 4
Dependent Claim
44 words
The photo album creating device as claimed in claim 1 , wherein the trimming reference area determined by the trimming reference area determining unit in the rotated inputted image contains all of the at least one face region detected by the face detection unit.
Claim 5
Dependent Claim
61 words
The photo album creating device as claimed in claim 1 further comprising a main subject determining unit to determine a main subject from the at least one person detected by the face detection unit based on content characteristics of the at least one person, wherein the trimming reference area determined by the trimming reference area unit contains only the main subject.
Claim 6
Dependent Claim
73 words
The photo album creating device as claimed in claim 1 , wherein: the trimming reference area comprises a rectangular area; the at least one image insertion area of the template comprises a plurality of image insertion areas; and the trimming unit carries out the trimming when an aspect ratio of the layout frame and an aspect ratio of the trimming reference area are similar enough to each other to satisfy a predetermined criterion.
Claim 7
Dependent Claim
113 words
The photo album creating device as claimed in claim 1 , wherein: the trimming reference area comprises a rectangular area; the at least one image insertion area of the template comprises a plurality of image insertion areas; and when an aspect ratio of the layout frame and an aspect ratio of the trimming reference area are not similar enough to each other to satisfy a predetermined criterion, the trimming unit determines a main subject from the at least one person detected by the face detection unit based on content characteristics of the at least one person, and carries out the trimming using the trimming reference area determined to contain only the main subject.
Claim 8
Dependent Claim
110 words
The photo album creating device as claimed in claim 1 , wherein: the trimming reference area comprises a rectangular area; the at least one image insertion area of the template comprises a plurality of image insertion areas; and when an aspect ratio of the layout frame and an aspect ratio of the trimming reference area are not similar enough to each other to satisfy a predetermined criterion, the trimming unit divides the trimming reference area into a plurality of smaller areas, and carries out the trimming for each of the smaller areas with using layout frames of the plurality of image insertion areas on facing pages of the photo album.
Claim 9
Dependent Claim
61 words
The photo album creating device as claimed in claim 1 , wherein the trimming reference area determining unit calculates a distance between the face regions adjacent to each other, and if the calculated distance is larger than a predetermined threshold, the trimming reference area determining unit determines a plurality of trimming reference areas having a boundary between the adjacent face regions.
Claim 10
Dependent Claim
277 words
A photo album creating method comprising: obtaining a template for the photo album associated with at least one image insertion area for receiving an inserted image, and a layout reference point arbitrarily set in each image insertion area, the template including at least one layout frame, each layout frame representing an outline of each image insertion area; detecting at least one person's face region from an inputted image; calculating an inclination of each of the at least one person based on content characteristics of the person and determining an inclination of the inputted image based on the calculated inclination; rotating the inputted image depending on the inclination of the inputted image; determining a trimming reference area in the rotated inputted image, the trimming reference area containing one or more of the at least one detected face region; determining a trimming reference point in the trimming reference area; setting, in the inputted image, one of the at least one layout frame and trimming the inputted image along the set layout frame, wherein the layout frame is set such that the layout reference point is positioned on the trimming reference point and the trimming reference area is contained in the layout frame; and combining an area of the trimmed inputted image with the template, and further comprising determining a main subject from the at least one person detected by the face detection unit based on content characteristics of the at least one person, wherein calculating the inclination of each of the at least one person is performed such that a larger weight is assigned to the inclination of the main subject to determine the inclination of the inputted image.
Claim 11
Dependent Claim
277 words
A photo album creating method comprising: obtaining a template for the photo album associated with at least one image insertion area for receiving an inserted image, and a layout reference point arbitrarily set in each image insertion area, the template including at least one layout frame, each layout frame representing an outline of each image insertion area; detecting at least one person's face region from an inputted image; calculating an inclination of each of the at least one person based on content characteristics of the person and determining an inclination of the inputted image based on the calculated inclination; rotating the inputted image depending on the inclination of the inputted image; determining a trimming reference area in the rotated inputted image, the trimming reference area containing one or more of the at least one detected face region; determining a trimming reference point in the trimming reference area; setting, in the inputted image, one of the at least one layout frame and trimming the inputted image along the set layout frame, wherein the layout frame is set such that the layout reference point is positioned on the trimming reference point and the trimming reference area is contained in the layout frame; and combining an area of the trimmed inputted image with the template, and further comprising determining a main subject from the at least one person detected by the face detection unit based on content characteristics of the at least one person, wherein calculating the inclination of each of the at least one person is performed such that a larger weight is assigned to the inclination of the main subject to determine the inclination of the inputted image.
Claim 12
Dependent Claim
138 words
The photo album creating device according to claim 1 , wherein the inclination determining unit obtains the content characteristics of the person by detecting regions of eyes and mouth from the detected face region, calculates the inclination of each face region by finding an angle between a line which is drawn from the center of the mouth region and perpendicularly crosses a line connecting the centers of the eyes and a line drawn along the vertical direction of the input image, converts the calculated inclination of each face region into a rotational angle which is determined with an interval of 90 degrees, finds an inclination which is the most frequent inclination of the face regions in the input image, based on the rotational angle, and determines the inclination of the inputted image based on the found the inclination.
Claim 13
Dependent Claim
138 words
The photo album creating method according to claim 9 , wherein the content characteristics of the person is obtained by detecting regions by detecting regions of eyes and mouth from the detected face region, the inclination of each face region is calculated by finding an angle between a line which is drawn from the center of the mouth region and perpendicularly crosses a line connecting the centers of the eyes and a line drawn along the vertical direction of the input image, and the inclination of the inputted image is determined based on a inclination which is found as the most frequent inclination of the face regions in the input image based on a rotational angle which is determined with an interval of 90 degrees and is obtained by converting the calculated inclination of each face region thereinto.
References Cited (Backward Citations)
JPH07168872A
Cited
JP2000270198A
Cited
US7710439B2
Cited
US20030174869A1
Cited
US7675647B2
Cited
US7746487B2
Cited
US7773782B2
Cited
JP2007026246A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2015-03-20 | 2015-09-19 | 2016-03-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2019-03-20 | 2019-09-19 | 2020-03-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2023-03-20 | 2023-09-19 | 2024-03-20 | $7700.00 | Window Closed / Lapsed |