← Back to Patent Explorer
US10013395B2 Active / In Force US ⏱️ 6.6 years remaining

Apparatus, control method thereof, and storage medium that determine a layout image from a generated plurality of layout images by evaluating selected target images

Assignee: Canon Inc
•
Filing: 2013-06-28
•
Granted: 2018-07-03
•
Expires: 2033-06-28
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An apparatus includes a memory to store a program and a processor to execute the program stored in the memory. The processor selects randomly output target images from output target candidate images and generates a plurality of layout images, each of which is generated by laying out the selected output target image. A template includes at least one image layout area. The processor determines a layout image from the generated plurality of layout images, by evaluating the selected target images included in each of the generated plurality of layout images according to both of first information corresponding to a user's evaluations for each of the selected output target images and second information based on an output history of each of the selected output target images in accordance with user designations. The processor outputs the determined layout image.

Inventors

  • 👤 Yuto Kajiwara
  • 👤 Hiroyuki Sakai
  • 👤 Yusuke Hashii
  • 👤 Hiroyasu Kunieda
  • 👤 Naoki Sumi
  • 👤 Kiyoshi Umeda

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 09:29
CPC Classifications
G06F17/212; G; G06; G06F; G06F40/00; G06F40/10; G06F40/103; G06F40/106

Claims Analysis

Total Claims: 31
Claim 1
Independent Claim 204 words
An apparatus comprising: a storage device that can store a plurality of images; a memory configured to store a program; and a processor configured to execute the program stored in the memory, wherein the processor (i) selects randomly N images from a plurality of images that are stored in the storage device, (ii) for each of the selected N images, determines randomly a layout area, among N layout areas in a template, in which one image is laid out in one layout area, wherein the random selecting of the N images and the random determining of the layout areas for the selected N images are executed multiple times, whereby a plurality of pages of the selected N images are laid out in the N layout areas, are generated by the random selecting and the random determining executed multiple times, (iii) evaluates the plurality of pages, based on information relating to an omitted portion of a face included in each of the N images, wherein the omitted portion of the face is a portion out of the layout area, (iv) determines a page from the plurality of pages, based on an evaluation for each of the plurality of pages, and (v) outputs the determined page.
Claim 2
Independent Claim 204 words
An apparatus comprising: a storage device that can store a plurality of images; a memory configured to store a program; and a processor configured to execute the program stored in the memory, wherein the processor (i) selects randomly N images from a plurality of images that are stored in the storage device, (ii) for each of the selected N images, determines randomly a layout area, among N layout areas in a template, in which one image is laid out in one layout area, wherein the random selecting of the N images and the random determining of the layout areas for the selected N images are executed multiple times, whereby a plurality of pages of the selected N images are laid out in the N layout areas, are generated by the random selecting and the random determining executed multiple times, (iii) evaluates the plurality of pages, based on information relating to an omitted portion of a face included in each of the N images, wherein the omitted portion of the face is a portion out of the layout area, (iv) determines a page from the plurality of pages, based on an evaluation for each of the plurality of pages, and (v) outputs the determined page.
Claim 3
Independent Claim 182 words
A method performed by a processor by executing a program stored in a memory, the method comprising: selecting randomly N images, from a plurality of images that are stored in a storage device; for each of the selected N images, determining randomly a layout area, among N layout areas in a template, in which one image is laid out in one layout area, wherein the random selection of the N images from the plurality of images and the random determining of the layout areas are executed multiple times, whereby a plurality of pages in which the selected N images are laid out in the N layout areas, are generated by the random selecting and the random determining executed multiple times; evaluating the plurality of pages, based on information relating to an omitted portion of a face included in each of the N images, wherein the omitted portion of the face is a portion out of the layout area; determining a page from the plurality of pages, based on an evaluation for each of the plurality of pages; and outputting the determined page.
Claim 4
Independent Claim 182 words
A method performed by a processor by executing a program stored in a memory, the method comprising: selecting randomly N images, from a plurality of images that are stored in a storage device; for each of the selected N images, determining randomly a layout area, among N layout areas in a template, in which one image is laid out in one layout area, wherein the random selection of the N images from the plurality of images and the random determining of the layout areas are executed multiple times, whereby a plurality of pages in which the selected N images are laid out in the N layout areas, are generated by the random selecting and the random determining executed multiple times; evaluating the plurality of pages, based on information relating to an omitted portion of a face included in each of the N images, wherein the omitted portion of the face is a portion out of the layout area; determining a page from the plurality of pages, based on an evaluation for each of the plurality of pages; and outputting the determined page.
Claim 5
Dependent Claim 33 words
The method according to claim 2 , wherein, in the outputting, the plurality of pages are output according to an order that follows an evaluation for the plurality of pages in the evaluating.
Claim 6
Dependent Claim 37 words
The method according to claim 2 , wherein, in the step of selecting randomly N images, a scenario is determined, and the N images are selected from a plurality of images that corresponds to the determined scenario.
Claim 7
Dependent Claim 75 words
The method according to claim 4 , further comprising generating person groups, each of which corresponds to a person included in one or more images stored in the storage device, by analyzing images stored in the storage device, wherein a scenario corresponding to a person group among the person groups is determined, and N images are randomly selected, from the plurality of images including a person of the person group corresponding to the determined scenario.
Claim 8
Dependent Claim 99 words
The method according to claim 5 , wherein, in the generating of person groups, a first face feature amount corresponding to a first person group is stored in a database, and in a case when a second face feature amount of a face image is similar to the first face feature amount, the second face feature amount is additionally stored to the first person group, and in a case when the second face feature is not similar to the first face feature amount, the second face feature amount is additionally stored to the database as a new person group.
Claim 9
Dependent Claim 25 words
The method according to claim 4 , wherein a scenario corresponding to a theme is determined, and a template corresponding to the theme is selected.
Claim 10
Dependent Claim 22 words
The method according to claim 7 , wherein an event is designated to an image in the storage device, as the theme.
Claim 11
Dependent Claim 50 words
The method according to claim 2 , further comprising generating a list indicating attribute information of each of the plurality of images, the attribute information indicating the first information and the second information, wherein the N images are randomly selected from the plurality of images, based on the generated list.
Claim 12
Dependent Claim 96 words
The method according to claim 2 , wherein the storage device stores attribute information of each of the plurality of images, wherein the attribute information includes, for each image, a first value in a multi-valued form as the first information and a second value in a multi-valued form as the second information for each image, the first value indicating a favorite ratio of a user and being manually inputted by the user, and the second value indicating how many times the image is accessed in the past and being updated automatically when the image is accessed.
Claim 13
Dependent Claim 84 words
The method according to claim 2 , wherein, in the evaluating, the plurality of pages are evaluated by calculating, for each of the N layout areas included in one page, a score in accordance with an area of the omitted portion of the face out of the layout so that a score of a layout area in which a face in an image is not omitted is higher than a score of a layout area in which a face in an image is omitted.
Claim 14
Dependent Claim 28 words
The method according to claim 2 , further comprising selecting the template among a plurality of templates, the template including the N image layout areas in a page.
Claim 15
Dependent Claim 48 words
The method according to claim 12 , wherein, in the evaluating, each page is evaluated by multiplying values indicated by the first information associated with the images in the page by a weight greater than values indicated by the second information associated with the images in the page.
Claim 16
Dependent Claim 45 words
The method according to claim 13 , wherein, in the evaluating, the weight is determined according to a correlation between the values indicated by the first information and the values indicated by the second information of the plurality of images stored in the storage device.
Claim 17
Dependent Claim 53 words
The method according to claim 12 , wherein, in the evaluating, values indicated by the first information for each of the N images in each of the plurality of generated pages, are determined based on a user's evaluations for another image among the plurality of images, which is indicated by the first information.
Claim 18
Dependent Claim 35 words
The method according to claim 15 , wherein, in the evaluating, the values indicated by the first information are determined according to the number of images evaluated by the user among the plurality of images.
Claim 19
Dependent Claim 42 words
The method according to claim 15 , wherein, in the evaluating, the values indicated by the first information are determined according to a variance of the user's evaluations, which correspond to the plurality of images and are indicated by the first information.
Claim 20
Dependent Claim 31 words
The method according to claim 12 , wherein the second information indicates output counts of each of the N images in each of the plurality of generated pages, as the history.
Claim 21
Dependent Claim 36 words
The method according to claim 12 , wherein, in the evaluating, a page is evaluated, according to the first information, the second information, the third information, and fourth information indicating an analysis result of the face.
Claim 22
Dependent Claim 65 words
The method according to claim 2 , wherein, in the evaluating, the plurality of pages are evaluated, based on the information, first information corresponding to a user's evaluations for each of N images in each of the plurality of pages, and second information based on output histories of each of N images in accordance with a user's designation in each of the plurality of pages.
Claim 23
Dependent Claim 36 words
The method according to claim 2 , further comprising determining similarity of the N images, wherein, in the evaluating, the plurality of pages are evaluated, based on the information and determined similarity of the N image.
Claim 24
Dependent Claim 35 words
The method according to claim 21 , wherein, in the determining of similarity of the N image, the similarity of the N images is determined based on captured dates of time of the N images.
Claim 25
Dependent Claim 46 words
The method according to claim 22 , wherein, in the evaluating, the plurality of pages are evaluated so that a page whose similarity of the N images is determined as low is higher than a page whose similarity of the N image is determined as high.
Claim 26
Dependent Claim 39 words
The method according to claim 2 , further comprising determining a color variation in the N images, wherein, in the evaluating, the plurality of pages are evaluated, based on the information and determined color variation in the N images.
Claim 27
Dependent Claim 40 words
The method according to claim 24 , wherein, in the evaluating, the plurality of pages are evaluated so that a page whose color variation is determined as high is higher than a page whose color variation is determined as low.
Claim 28
Dependent Claim 46 words
The method according to claim 2 , further comprising determining a variation degree of face sizes in the N images, wherein, in the evaluating, the plurality of pages are evaluated, based on the information and determined a variation degree of face sizes in the N images.
Claim 29
Dependent Claim 46 words
The method according to claim 26 , wherein, in the evaluating, the plurality of pages are evaluated so that a page whose variation degree of face sizes is determined as high is higher than a page whose variation degree of face sizes is determined as low.
Claim 30
Dependent Claim 181 words
A non-transitory computer-readable storage medium storing a program for controlling a computer to execute respective steps of a method, the method comprising: selecting randomly N images, from a plurality of images that are stored in a storage device; for each of the selected N images, determining randomly a layout area among N layout areas in a template, in which one image is laid out in one layout area, wherein the random selecting of the N images and the random determining of the layout areas are executed multiple times, whereby a plurality of pages, in which the selected N images are laid out in the N layout areas, are generated by the random selecting and the random determining executed multiple times; evaluating the plurality of pages, based on information related to an omitted portion of a face included in each of N images, wherein the omitted portion of the face is a portion out of the layout area; determining a page from the plurality of pages, based on an evaluation for each of the plurality of pages; and outputting the determined page.
Claim 31
Dependent Claim 181 words
A non-transitory computer-readable storage medium storing a program for controlling a computer to execute respective steps of a method, the method comprising: selecting randomly N images, from a plurality of images that are stored in a storage device; for each of the selected N images, determining randomly a layout area among N layout areas in a template, in which one image is laid out in one layout area, wherein the random selecting of the N images and the random determining of the layout areas are executed multiple times, whereby a plurality of pages, in which the selected N images are laid out in the N layout areas, are generated by the random selecting and the random determining executed multiple times; evaluating the plurality of pages, based on information related to an omitted portion of a face included in each of N images, wherein the omitted portion of the face is a portion out of the layout area; determining a page from the plurality of pages, based on an evaluation for each of the plurality of pages; and outputting the determined page.

References Cited (Backward Citations)

JP2541688B2 Cited
US5218387A Cited
JPH05197793A Cited
US5905807A Cited
JPH0863597A Cited
JPH0877334A Cited
JP3469031B2 Cited
JPH1153525A Cited
JPH11250267A Cited
US20010014184A1 Cited
JP2000105829A Cited
JP2000132688A Cited
JP2000235648A Cited
JP2001216515A Cited
US6885760B2 Cited
US20040049486A1 Cited
US6965684B2 Cited
JP2002183731A Cited
US7103218B2 Cited
US20080094420A1 Cited
JP2003030667A Cited
US6895103B2 Cited
US20030011801A1 Cited
US7190467B2 Cited
US20030189739A1 Cited
US20050111737A1 Cited
US7515294B2 Cited
US20040161224A1 Cited
US7236632B2 Cited
US20060050312A1 Cited
US20100118052A1 Cited
US7969591B2 Cited
US7746487B2 Cited
US20050168779A1 Cited
US7783115B2 Cited
US20080205789A1 Cited
JP2008529150A Cited
WO2006079991A2 Cited
JP2006229682A Cited
US20080089590A1 Cited
JP2006279119A Cited
US20060224964A1 Cited
JP2007005886A Cited
US20090116752A1 Cited
US20070180355A1 Cited
US20070186154A1 Cited
US20080123993A1 Cited
US20070288462A1 Cited
US7801907B2 Cited
US20070291153A1 Cited
US20090049374A1 Cited
US20090074329A1 Cited
US20090138788A1 Cited
US20090199226A1 Cited
US8947442B2 Cited
US20100067027A1 Cited
US20120020576A1 Cited
US20130246925A1 Cited
JP2010251999A Cited
US20100260415A1 Cited
US20100289818A1 Cited
US8665294B2 Cited
US20100293157A1 Cited
JP2010273144A Cited
US20100295998A1 Cited
US9049419B2 Cited
US20120106859A1 Cited
US20110029635A1 Cited
US20110029562A1 Cited
US8332427B2 Cited
US9436707B2 Cited
US20150161174A1 Cited
US8571331B2 Cited
US20110129159A1 Cited
US20110213795A1 Cited
US20110270813A1 Cited
US20110280486A1 Cited
US20120076427A1 Cited
US20120210200A1 Cited
US20150228307A1 Cited
US20130159924A1 Cited
US20140003648A1 Cited
US20140009796A1 Cited
US20140096075A1 Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2021-07-02 2022-01-01 2022-07-03 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2025-07-02 2026-01-01 2026-07-03 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2029-07-02 2030-01-01 2030-07-03 $7700.00 Pending Window

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag