Patent US7275210B2 successfully refreshed from Google Patents.
← Back to Patent Explorer
US7275210B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Systems and methods for generating video summary image layouts

Assignee: Fujifilm Business Innovation Corp
•
Filing: 2003-03-21
•
Granted: 2007-09-25
•
Expires: 2023-03-21
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Systems and methods for creating aesthetically pleasing visual image summaries from a collection of input images. The systems and methods determine a visual image summary by creating candidate partial layouts, assigning penalty scores to the candidate partial layouts based on a number of evaluation criteria, evaluating the penalty scores for the candidate partial layouts, and building upon the candidate partial layouts, beginning with the lowest scoring candidate partial layout first, to form complete layouts. The resultant visual image summary fits within a user defined area, maintains the order of the input images, and contains a relative small amount of aesthetically undesirable qualities.

Inventors

  • 👤 Andreas Girgensohn

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 09:59
CPC Classifications
G; G06; G06T; G06T11/00; G06T11/60; G06F; G06F16/00; G06F16/70; G06F16/73; G06F16/738; G06F16/739

Claims Analysis

Total Claims: 42
Claim 1
Independent Claim 236 words
A method for creating a layout comprising: (a) inputting a smallest rectangular shape; (b) inputting a total area for the layout as integer multiples of the width and height of the smallest rectangular shape; (c) inputting a largest acceptable rectangular shape as integer multiples of the width and height of the smallest rectangular shape; (d) inputting a plurality of rectangular shapes, wherein each of the plurality of rectangular shapes is characterized by a size relative to the smallest rectangular shape and no larger than the input largest acceptable rectangular shape; (e) determining if a selection of said plurality of rectangular shapes exists such that the selection has the cardinality of the input plurality of rectangular shapes and the plurality of rectangular shapes covers the inputted total area without overlapping or leaving any part of the total area uncovered, wherein: (1) if at least one such plurality of rectangular shapes exists, producing a layout of the plurality of inputted shapes by changing the sizes of some of the inputted rectangular shapes sizes relative to a smallest rectangular shape and no larger than the input largest acceptable rectangular shape such that the plurality of rectangular shapes covers the input total area without overlapping; and (2) if no such plurality of rectangular shapes exists, find a total area similar to the inputted total area for which such a combination exists and apply the layout method to that total area.
Claim 2
Independent Claim 236 words
A method for creating a layout comprising: (a) inputting a smallest rectangular shape; (b) inputting a total area for the layout as integer multiples of the width and height of the smallest rectangular shape; (c) inputting a largest acceptable rectangular shape as integer multiples of the width and height of the smallest rectangular shape; (d) inputting a plurality of rectangular shapes, wherein each of the plurality of rectangular shapes is characterized by a size relative to the smallest rectangular shape and no larger than the input largest acceptable rectangular shape; (e) determining if a selection of said plurality of rectangular shapes exists such that the selection has the cardinality of the input plurality of rectangular shapes and the plurality of rectangular shapes covers the inputted total area without overlapping or leaving any part of the total area uncovered, wherein: (1) if at least one such plurality of rectangular shapes exists, producing a layout of the plurality of inputted shapes by changing the sizes of some of the inputted rectangular shapes sizes relative to a smallest rectangular shape and no larger than the input largest acceptable rectangular shape such that the plurality of rectangular shapes covers the input total area without overlapping; and (2) if no such plurality of rectangular shapes exists, find a total area similar to the inputted total area for which such a combination exists and apply the layout method to that total area.
Claim 3
Dependent Claim 44 words
The method of claim 1 , further comprising organizing the total area into rows of varying heights and placing the rectangular shapes into the rows such that at least one of the rectangular shapes in a row has the same height as the row.
Claim 4
Dependent Claim 29 words
The method of claim 2 , wherein the width and height of all placed rectangular shapes are integer multiples of the width and height of the smallest rectangular shape.
Claim 5
Dependent Claim 41 words
The method of claim 3 , further comprising: (a) determining a penalty score for changing the size of an input rectangular shape; (b) combining the penalty scores of resized rectangular shapes; (c) determining the layout with a lowest combined penalty score.
Claim 6
Dependent Claim 45 words
The method of claim 4 , further comprising: (a) leaving at least a part of a bottom row empty; (b) determining a penalty score for the empty area; (c) combining the penalty score for the empty area with the penalty score for the resized shapes.
Claim 7
Dependent Claim 47 words
The method of claim 5 , further comprising: (a) determining penalty scores for properties such as the number of the rectangular shapes of the same size next to each other; (b) combining such penalty scores with the penalty score for the resized rectangular shapes and empty areas.
Claim 8
Dependent Claim 18 words
The method of claim 6 , wherein at least one of the rectangular shapes are user interface components.
Claim 9
Dependent Claim 16 words
The method of claim 6 , wherein at least one of the rectangular shapes are images.
Claim 10
Dependent Claim 19 words
The method of claim 8 , wherein the inputted image sizes are based on the importance of the images.
Claim 11
Dependent Claim 19 words
The method of claim 9 , wherein all inputted images have the same aspect ratio between width and height.
Claim 12
Dependent Claim 18 words
The method of claim 10 , wherein at least one of the placed images preserves the aspect ratio.
Claim 13
Dependent Claim 30 words
The method of claim 11 , further comprising displaying a portion of the at least one images, wherein the at least one placed images does not preserve the aspect ratio.
Claim 14
Independent Claim 115 words
A method for creating a summary layout comprising: (a) inputting a plurality of rectangular shapes; (b) inputting a total area for the summary layout; (c) determining each of at least one layout of rectangular shape placeholders for a row of the summary layout as new partial layouts; (d) determining penalty scores for each of the at least one layout; (e) selecting the layout having lowest penalty score; (f) repeating step (c) to (e) until no rows remain; assigning each of the plurality of rectangular shapes to a corresponding rectangular shape placeholder and determining whether the plurality of rectangular shapes covers the inputted total area without overlapping or leaving any part of the total area uncovered.
Claim 15
Independent Claim 115 words
A method for creating a summary layout comprising: (a) inputting a plurality of rectangular shapes; (b) inputting a total area for the summary layout; (c) determining each of at least one layout of rectangular shape placeholders for a row of the summary layout as new partial layouts; (d) determining penalty scores for each of the at least one layout; (e) selecting the layout having lowest penalty score; (f) repeating step (c) to (e) until no rows remain; assigning each of the plurality of rectangular shapes to a corresponding rectangular shape placeholder and determining whether the plurality of rectangular shapes covers the inputted total area without overlapping or leaving any part of the total area uncovered.
Claim 16
Dependent Claim 162 words
The method of claim 13 , further comprising: (a) selecting an unselected partial layout with the lowest penalty score as the current partial layout; (b) determining whether each of the plurality of input rectangular shapes is represented by a rectangular shapes place holder within the current partial layout, if so, terminating this step; otherwise performing the steps wherein: (1) if each of the input rectangular shapes is not represented by a rectangular shapes place holder: (i) determining, based on the current partial layout, at least one layout for a next row of the current partial layout; (ii) determining a penalty score for each of the at least one layout for the next row; (iv) combining each layout for the next row with the current partial layout to create new partial layouts; and (v) combining the penalty score for the current partial layout with the penalty score for each layout for the next row into the penalty scores for the new partial layouts.
Claim 17
Dependent Claim 27 words
The method of claim 14 , further comprising repeating the steps of claim 14 until no unselected partial layout remains and then outputting the stored final layout.
Claim 18
Dependent Claim 33 words
The method of claim 15 , wherein, if each of the input rectangular shapes is represented by a rectangular shape place holder, further comprising testing whether the rows exactly fill the total area.
Claim 19
Dependent Claim 37 words
The method of claim 16 , further comprising: (a) converting the selected partial layout into a final layout; and (b) converting the penalty score of the selected partial layout into the penalty score of the final layout.
Claim 20
Dependent Claim 201 words
The method of claim 17 , further comprising: (a) selecting a next unselected partial layout having a lowest penalty score from the remaining unselected at least one partial layout; and (b) comparing the penalty score of the selected partial layout with the penalty score of the final layout, wherein: (1) if the penalty score of the final layout is not greater than the penalty score of the selected partial layout: (i) converting the final layout into a summary layout; and (ii), outputting the final layout and stopping; and (2) if the penalty score of the final layout is greater than the penalty score of the selected partial layout: (i) determining, based on the selected partial layout, at least one layout for the next row of the selected layout; (ii) determining a penalty score for each of the at least one layout for the next row of the selected partial layout; (iv) combining the selected partial layout score and each layout for the next row for the partial selected layout into new partial layouts; and (v) combining the penalty score of the selected partial layout and the penalty score of each next row into the penalty scores for the new partial layouts.
Claim 21
Dependent Claim 136 words
The method of claim 18 , wherein, if each of the input rectangular shapes is represented by a rectangular shape place holder, further comprising: (a) converting the current partial layout into a new final layout; and (b) converting the penalty score of the current partial layout into the penalty score of the new final layout; (c) comparing the penalty score of the new final layout with a penalty score of the stored final layout, wherein: (1) if the penalty score of the stored final layout is not greater than the penalty score of the new final layout, discarding the new final layout; and (2) if the penalty score of the stored final layout is greater than the penalty score of the new final layout; (i) discarding the stored final layout; (ii) storing the new final layout.
Claim 22
Dependent Claim 18 words
The method of claim 19 , wherein at least one of the rectangular shapes are user interface components.
Claim 23
Dependent Claim 16 words
The method of claim 19 , wherein at least one of the rectangular shapes are images.
Claim 24
Dependent Claim 19 words
The method of claim 21 , wherein the inputted image sizes are based on the importance of the images.
Claim 25
Dependent Claim 19 words
The method of claim 22 , wherein all inputted images have the same aspect ratio between width and height.
Claim 26
Dependent Claim 18 words
The method of claim 23 , wherein at least one of the placed images preserves the aspect ratio.
Claim 27
Dependent Claim 30 words
The method of claim 23 , further comprising displaying a portion of the at least one images, wherein the at least one placed images does not preserve the aspect ratio.
Claim 28
Dependent Claim 12 words
The method of claim 13 , further comprising inputting a penalty factor.
Claim 29
Dependent Claim 162 words
The method of claim 26 , farther comprising: (a) selecting the unselected partial layout with a lowest penalty score as the current partial layout; (b) determining whether each of the plurality of input rectangular shapes is represented by a rectangular shape place holder within the current partial layout, if so, terminating this step; otherwise performing the steps wherein: (1) if each of the input rectangular shapes is not represented by a rectangular shapes place holder: (i) determining, based on the current partial layout, at least one layout for a next row of the current partial layout; (ii) determining a penalty score for each of the at least one layout for the next row; (iv) combining each layout for the next row with the current partial layout to create new partial layouts; and (v) combining the penalty score for the current partial layout with the penalty score for each layout for the next row into the penalty scores for the new partial layouts.
Claim 30
Dependent Claim 27 words
The method of claim 27 , further comprising repeating the steps of claim 14 until no unselected partial layout remains and then outputting the stored final layout.
Claim 31
Dependent Claim 32 words
The method of claim 28 , wherein, if each of the rectangular shapes is represented by a rectangular shape place holder, further comprising testing whether the rows exactly fill the total area.
Claim 32
Dependent Claim 37 words
The method of claim 29 , further comprising: (a) converting the selected partial layout into a final layout; and (b) converting the penalty score of the selected partial layout into the penalty score of the final layout.
Claim 33
Dependent Claim 211 words
The method of claim 30 , further comprising: (a) selecting a next unselected partial layout having a lowest penalty score from the remaining unselected at least one partial layout; and (b) comparing the penalty score of the selected partial layout with the penalty score of the final layout, wherein: (1) if the penalty score of the final layout multiplied by the penalty factor is not greater than the penalty score of the selected partial layout: (i) converting the final layout into a summary layout; and (ii), outputting the final layout and stopping; and (2) if the penalty score of the final layout multiplied by the penalty factor is greater than the penalty score of the selected partial layout: (i) determining, based on the selected partial layout, at least one layout for the next row of the selected layout; (ii) determining a penalty score for each of the at least one layout for the next row of the selected partial layout; (iv) combining the selected partial layout score and each layout for the next row for the partial selected layout into new partial layouts; and (v) combining the penalty score of the selected partial layout and the penalty score of each next row into the penalty scores for the new partial layouts.
Claim 34
Dependent Claim 136 words
The method of claim 31 , wherein, if each of the input rectangular shapes is represented by an rectangular shapes place holder, further comprising: (a) converting the current partial layout into a new final layout; and (b) converting the penalty score of the current partial layout into the penalty score of the new final layout. (c) comparing the penalty score of the new final layout with the penalty score of the stored final layout, wherein: (1) if the penalty score of the stored final layout is not greater than the penalty score of the new final layout, discarding the new final layout; and (2) if the penalty score of the stored final layout is greater than the penalty score of the new final layout; (i) discarding the stored final layout; (ii) storing the new final layout.
Claim 35
Dependent Claim 16 words
The method of claim 32 , wherein at least one of the rectangular shapes are images.
Claim 36
Dependent Claim 18 words
The method of claim 32 , wherein at least one of the rectangular shapes are user interface components.
Claim 37
Dependent Claim 19 words
The method of claim 33 , wherein the inputted image sizes are based on the importance of the images.
Claim 38
Dependent Claim 19 words
The method of claim 35 , wherein all inputted images have the same aspect ratio between width and height.
Claim 39
Dependent Claim 18 words
The method of claim 36 , wherein at least one of the placed images preserves the aspect ratio.
Claim 40
Dependent Claim 30 words
The method of claim 36 , further comprising displaying a portion of the at least one images, wherein the at least one placed images does not preserve the aspect ratio.
Claim 41
Dependent Claim 243 words
An image summary layout determining system that generates an image summary layout for a plurality of images, comprising: (a) an image/block count determining circuit, routine, or application that determines at least one of image counts and block counts based on data including at least some of the images, an importance of each of the images, and an order of the images; (b) a penalty score determining circuit, routine, or application that inputs data representing at least one of an image count and a block count and data representing the images and generates data representing a penalty score for the input image or block count; (c) a penalty score comparing circuit, routine, or application that determines an order of data representing at least two of a number of image or block counts, a number of partial layouts or selected partial layouts, a final partial layout, and a final layout, based on data representing a penalty score of those image or block counts, those partial layouts or selected partial layouts, the final partial layout, and the final layout; (d) a partial layout/solution creating circuit, routine, or application that generates data representing a partial layout or selected partial layout and data representing the penalty score of that partial layout or selected partial layout; and (e) an image placing circuit, routine, or application that inputs data representing a final partial layout and data representing images and generates data representing the images reconfigured into the image summary layout.
Claim 42
Dependent Claim 243 words
An image summary layout determining system that generates an image summary layout for a plurality of images, comprising: (a) an image/block count determining circuit, routine, or application that determines at least one of image counts and block counts based on data including at least some of the images, an importance of each of the images, and an order of the images; (b) a penalty score determining circuit, routine, or application that inputs data representing at least one of an image count and a block count and data representing the images and generates data representing a penalty score for the input image or block count; (c) a penalty score comparing circuit, routine, or application that determines an order of data representing at least two of a number of image or block counts, a number of partial layouts or selected partial layouts, a final partial layout, and a final layout, based on data representing a penalty score of those image or block counts, those partial layouts or selected partial layouts, the final partial layout, and the final layout; (d) a partial layout/solution creating circuit, routine, or application that generates data representing a partial layout or selected partial layout and data representing the penalty score of that partial layout or selected partial layout; and (e) an image placing circuit, routine, or application that inputs data representing a final partial layout and data representing images and generates data representing the images reconfigured into the image summary layout.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2010-09-24 2011-03-26 2011-09-25 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2014-09-24 2015-03-26 2015-09-25 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2018-09-24 2019-03-26 2019-09-25 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag