Patent US6724937B1 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6724937B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Method of identifying image frames suitable for printing

Assignee: Canon Inc
•
Filing: 1999-06-16
•
Granted: 2004-04-20
•
Expires: 2019-06-16
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method for identifying one or more image frames ( 100 ) from a series ( 104 ) of video image frames, in order to print, store or flag the selected frames. The method calculates a gradient value for each image frame in a video shot ( 102 ) series, identifies one or more gradient value peaks ( 324 ) in a corresponding range of a raw data series ( 302 ), and selects the image frames ( 110 ) corresponding to the identified gradient value peaks. Two types of frames ( 202, 206 ) are identified as being suitable for printing. A first type ( 202 ) comprises frames with a high gradient content, where the image is sharply defined. A second type of frame ( 206 ) also has good focus, but is representative of periods of relative stillness, or lack of motion between consecutive image frames ( 100 ) during the video shot series ( 104 ).

Inventors

  • 👤 Jing Wu
  • 👤 John Richard Windle

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 10:48
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/40; G06T7/41

Claims Analysis

Total Claims: 43
Claim 1
Independent Claim 118 words
A method for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the method including the steps of: a) calculating, for each image frame in the series, a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; b) smoothing data within the raw data series to generate a smoothed data series; c) identifying one or more local maxima in the smoothed data series; d) identifying one or more gradient value peaks in a corresponding range of the raw data series based on positions of respective local maxima; and e) selecting the image frames corresponding to each of the identified gradient value peaks.
Claim 2
Independent Claim 118 words
A method for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the method including the steps of: a) calculating, for each image frame in the series, a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; b) smoothing data within the raw data series to generate a smoothed data series; c) identifying one or more local maxima in the smoothed data series; d) identifying one or more gradient value peaks in a corresponding range of the raw data series based on positions of respective local maxima; and e) selecting the image frames corresponding to each of the identified gradient value peaks.
Claim 3
Dependent Claim 24 words
A method according to claim 1 , wherein the gradient value peaks identified in step (d) are in the vicinity of each local maximum.
Claim 4
Dependent Claim 39 words
A method according claim 1 , wherein step (d) includes the sub-steps of: f) defining a gradient value threshold; and g) for each set of peaks with a least one peak exceeding the threshold value, selecting a maximum peak.
Claim 5
Dependent Claim 57 words
A method according to claim 1 , wherein step (d) includes the sub-steps of: h) where said maxima are positioned remote from each other in the series, selecting points in the smoothed data series between adjacent local maxima; and i) identifying one or more peaks in the raw data series in a vicinity of each selected point.
Claim 6
Dependent Claim 40 words
A method according to claim 4 , wherein step (i) includes the sub-steps of: j) defining a gradient value threshold; and k) for each set of peaks with at least one peak exceeding the threshold value, selecting a maximum peak.
Claim 7
Dependent Claim 39 words
A method according to claim 5 , wherein the method further includes the steps of: l) printing, displaying or storing the selected image frames; and/or m) printing, displaying or storing a frame list associated with the selected image frames.
Claim 8
Dependent Claim 20 words
A method according to claim 4 , whereby the selected points are selected on the basis of predetermined time intervals.
Claim 9
Dependent Claim 30 words
A method according to claim 4 , whereby the selected points are selected on the basis of a rate of change of the smoothed data series between the adjacent maxima.
Claim 10
Dependent Claim 19 words
A method according to claim 1 , whereby the gradient value is calculated over a region in the image.
Claim 11
Dependent Claim 24 words
A method according to claim 9 , whereby the gradient value calculated is dependent upon weights which are assigned to pixels in the region.
Claim 12
Independent Claim 90 words
A method of identifying one or more image frames from a series of image frames, the method including the steps of: n) calculating, for each image frame in the series a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; o) defining a gradient value threshold; p) identifying sets of adjacent gradient values in the raw data series which exceed the gradient value threshold and are of similar value; and q) selecting a representative image frame from each set of adjacent gradient values.
Claim 13
Independent Claim 90 words
A method of identifying one or more image frames from a series of image frames, the method including the steps of: n) calculating, for each image frame in the series a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; o) defining a gradient value threshold; p) identifying sets of adjacent gradient values in the raw data series which exceed the gradient value threshold and are of similar value; and q) selecting a representative image frame from each set of adjacent gradient values.
Claim 14
Independent Claim 188 words
An apparatus for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the apparatus comprising: gradient calculation means arranged to receive a series of image frames and to calculate for each image frame in the series, a single scalar gradient value, and output a raw data series of scalar gradient values, one gradient value characterizing said each frame; data smoothing means responsive to the raw data series and arranged to generate and output a smoothed data series; identification means responsive to the smoothed data series and arranged to identify and output one or more local maxima in the smoothed data series; gradient peak selection means responsive to the one or more local maxima and to the raw data series and arranged to identify one or more gradient value peaks in a corresponding range of the raw data series based upon positions of respective local maxima; and image frame selection means responsive to the series of image frames and to the identified gradient value peaks, and arranged to select image frames corresponding to each of the identified gradient value peaks.
Claim 15
Independent Claim 188 words
An apparatus for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the apparatus comprising: gradient calculation means arranged to receive a series of image frames and to calculate for each image frame in the series, a single scalar gradient value, and output a raw data series of scalar gradient values, one gradient value characterizing said each frame; data smoothing means responsive to the raw data series and arranged to generate and output a smoothed data series; identification means responsive to the smoothed data series and arranged to identify and output one or more local maxima in the smoothed data series; gradient peak selection means responsive to the one or more local maxima and to the raw data series and arranged to identify one or more gradient value peaks in a corresponding range of the raw data series based upon positions of respective local maxima; and image frame selection means responsive to the series of image frames and to the identified gradient value peaks, and arranged to select image frames corresponding to each of the identified gradient value peaks.
Claim 16
Dependent Claim 27 words
An apparatus according to claim 12 , wherein the gradient peak selection means are arranged to identify gradient value peaks in the vicinity of each local maximum.
Claim 17
Dependent Claim 41 words
An apparatus according to claim 12 , wherein the gradient peak selection means are arranged to define a gradient value threshold, and for each set of peaks with a least one peak exceeding the threshold value, to select a maximum peak.
Claim 18
Dependent Claim 58 words
An apparatus according to claim 12 , wherein where said maxima are positioned remote from each other in the series, the gradient peak selection means are arranged to select points in the smoothed data series between adjacent local maxima, and to identify one or more peaks in the raw data series in a vicinity of each selected point.
Claim 19
Dependent Claim 57 words
An apparatus according to claim 15 , wherein the means to identify one or more peaks in the raw data series in a vicinity of each selected point are further arranged to define a gradient value threshold, and for each set of peaks with at least one peak exceeding the threshold value, to select a maximum peak.
Claim 20
Dependent Claim 28 words
An apparatus according to claim 15 , wherein the gradient peak selection means are further arranged to select the selected points on the basis of predetermined time intervals.
Claim 21
Dependent Claim 38 words
An apparatus according to claim 15 , wherein the gradient peak selection means are further arranged to select the selected points on the basis of a rate of change of the smoothed data series between the adjacent maxima.
Claim 22
Dependent Claim 21 words
An apparatus according to claim 12 , the apparatus further including means for printing, displaying or storing the selected image frames.
Claim 23
Dependent Claim 26 words
An apparatus according to claim 12 , the apparatus further including means for printing, displaying or storing a frame list associated with the selected image frames.
Claim 24
Dependent Claim 26 words
An apparatus according to claim 12 , wherein the gradient calculation means are further arranged to calculate the gradient value over a region in the image.
Claim 25
Dependent Claim 31 words
An apparatus according to claim 21 , wherein the gradient calculation means are further arranged to calculate the gradient value dependent upon weights which are assigned to pixels in the region.
Claim 26
Independent Claim 91 words
An apparatus for identifying one or more image frames from a series of image frames, the apparatus comprising: means for calculating, for each image frame in the series, a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; means for defining a gradient value threshold; means for identifying sets of adjacent gradient values in the raw data series which exceed the gradient value threshold and are of similar value; and means for selecting a representative image frame from each set of adjacent gradient values.
Claim 27
Independent Claim 91 words
An apparatus for identifying one or more image frames from a series of image frames, the apparatus comprising: means for calculating, for each image frame in the series, a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; means for defining a gradient value threshold; means for identifying sets of adjacent gradient values in the raw data series which exceed the gradient value threshold and are of similar value; and means for selecting a representative image frame from each set of adjacent gradient values.
Claim 28
Independent Claim 93 words
An apparatus for identifying one or more image frames from a series of video images for printing, storing or flagging, the apparatus comprising: gradient calculation means arranged to receive a series of image frames and to calculate, for each image frame in the series, a single scalar gradient value, and output a corresponding series of scalar gradient values characterizing the image frames; data smoothing means responsive to the series of gradient values for generating a smoothed data series; and image frame selection means responsive to the smoothed data series for selecting image frames.
Claim 29
Independent Claim 93 words
An apparatus for identifying one or more image frames from a series of video images for printing, storing or flagging, the apparatus comprising: gradient calculation means arranged to receive a series of image frames and to calculate, for each image frame in the series, a single scalar gradient value, and output a corresponding series of scalar gradient values characterizing the image frames; data smoothing means responsive to the series of gradient values for generating a smoothed data series; and image frame selection means responsive to the smoothed data series for selecting image frames.
Claim 30
Dependent Claim 207 words
A computer program product including a computer readable medium having recorded thereon a computer program for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the computer program comprising: gradient calculation process steps arranged to receive a series of image frames and to calculate, for each image frame in the series, a single scalar gradient value, and output a raw data series of scalar gradient values, one gradient value characterizing said each frame; data smoothing process steps responsive to the raw data series and arranged to generate and output a smoothed data series; identification process steps responsive to the smoothed data series and arranged to identify and output one or more local maxima in the smoothed data series; gradient peak selection process steps responsive to the one or more local maxima and to the raw data series and arranged to identify one or more gradient value peaks in a corresponding range of the raw data series based upon positions of respective local maxima; and image frame selection process steps responsive to the series of image frames and to the identified gradient value peaks, and arranged to select image frames corresponding to each of the identified gradient value peaks.
Claim 31
Dependent Claim 207 words
A computer program product including a computer readable medium having recorded thereon a computer program for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the computer program comprising: gradient calculation process steps arranged to receive a series of image frames and to calculate, for each image frame in the series, a single scalar gradient value, and output a raw data series of scalar gradient values, one gradient value characterizing said each frame; data smoothing process steps responsive to the raw data series and arranged to generate and output a smoothed data series; identification process steps responsive to the smoothed data series and arranged to identify and output one or more local maxima in the smoothed data series; gradient peak selection process steps responsive to the one or more local maxima and to the raw data series and arranged to identify one or more gradient value peaks in a corresponding range of the raw data series based upon positions of respective local maxima; and image frame selection process steps responsive to the series of image frames and to the identified gradient value peaks, and arranged to select image frames corresponding to each of the identified gradient value peaks.
Claim 32
Dependent Claim 31 words
A computer program product according to claim 25 , wherein the gradient peak selection process steps identify the one or more gradient value peaks based upon positions of respective local maxima.
Claim 33
Dependent Claim 40 words
A computer program product according to claim 25 , wherein the gradient peak selection process steps define a gradient value threshold, and for each set of peaks with a least one peak exceeding the threshold value, select a maximum peak.
Claim 34
Dependent Claim 61 words
A computer program product according to claim 25 , wherein the gradient peak selection process steps include the sub-steps of: where said maxima are positioned remote from each other in the series, selecting points in the smoothed data series between adjacent local maxima; and identifying one or more peaks in the raw data series in a vicinity of each selected point.
Claim 35
Dependent Claim 43 words
A computer program product according to claim 28 , wherein the point selection process steps include the sub-steps of: defining a gradient value threshold; and for each set of peaks with at least one peak exceeding the threshold value, selecting a maximum peak.
Claim 36
Dependent Claim 26 words
A computer program product according to claim 28 , wherein the point selection process steps select the selected points on the basis of predetermined time intervals.
Claim 37
Dependent Claim 36 words
A computer program product according to claim 28 , wherein the point selection process steps select the selected points on the basis of a rate of change of the smoothed data series between the adjacent maxima.
Claim 38
Dependent Claim 26 words
An computer program product according to claim 25 , wherein the computer program further includes the steps of: printing, displaying or storing the selected image frames.
Claim 39
Dependent Claim 31 words
A computer program product according to claim 25 , wherein the computer program further includes the steps of: printing, displaying or storing a frame list associated with the selected image frames.
Claim 40
Dependent Claim 23 words
A computer program product according to claim 25 , whereby the gradient value calculation steps are performed over a region in the image.
Claim 41
Dependent Claim 27 words
A computer program product according to claim 34 , whereby the gradient value calculation steps are dependent upon weights which are assigned to pixels in the region.
Claim 42
Dependent Claim 115 words
A computer program product including a computer readable medium having recorded thereon a computer program for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the computer program comprising: process steps for calculating, for each image frame in the series, a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; process steps for defining a gradient value threshold; process steps for identifying sets of adjacent gradient values in the raw data series which exceed the gradient value threshold and are of similar value; and process steps for selecting a representative image frame from each set of adjacent gradient values.
Claim 43
Dependent Claim 115 words
A computer program product including a computer readable medium having recorded thereon a computer program for identifying one or more image frames from a series of video image frames for printing, storing or flagging, the computer program comprising: process steps for calculating, for each image frame in the series, a single scalar gradient value characterizing said each image frame, thereby to generate a raw data series; process steps for defining a gradient value threshold; process steps for identifying sets of adjacent gradient values in the raw data series which exceed the gradient value threshold and are of similar value; and process steps for selecting a representative image frame from each set of adjacent gradient values.

References Cited (Backward Citations)

US4379632A Cited
US5576950A Cited
US5875040A Cited
US5903660A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2007-04-20 2007-10-20 2008-04-20 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2011-04-20 2011-10-20 2012-04-20 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2015-04-20 2015-10-20 2016-04-20 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag