Patent US6157744A successfully refreshed from Google Patents.
US6157744A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for detecting a point of change in a moving image
Assignee: Hitachi Ltd
•
Filing: 1996-02-21
•
Granted: 2000-12-05
•
Expires: 2016-02-21
Abstract
Abstract A system for detecting a point of change between video shots from a video having a plurality of succeeding frames. The system includes video playback apparatus for playing a video chronologically one frame at a time, and a display for displaying the video. The a processing device for calculating a feature quantity of video image data for each frame, determining a first correlation coefficient between a feature quantity of a current frame and a feature quantity calculated from an immediately preceding frame and determining a second correlation coefficient between the feature quantity of the current frame and a feature quantity of at least two frames preceding the current frame, and indicating on the display a point of change between video shots when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges. The correlation coefficients of each frame is stored and can be used by the processing device to dynamically change a reference used for detecting a point of change between video shots. The change in the reference is performed based on the stored correlation coefficients or feature quantities of past frames.
Inventors
- 👤 Akio Nagasaka
- 👤 Takafumi Miyatake
- 👤 Kazuaki Tanaka
- 👤 Takehiro Fujita
- 👤 Shigeki Nagaya
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:09
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/20; G06T7/246; G06F; G06F16/00; G06F16/70; G06F16/74; G06F16/745; G06F16/78; G06F16/783; G06F16/7834; G06F16/7847; G06F16/785; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G11B27/10; G11B27/19; G11B27/28; G11B27/34
Claims Analysis
Total Claims: 48
Claim 1
Independent Claim
178 words
A method of detecting a change between video shots from a video including a plurality of succeeding frame images, said method comprising the steps of: inputting said video into a processing device; obtaining a feature quantity of each frame of the inputted video; determining a first correlation coefficient which is a difference between a feature quantity of a current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image; determining a second correlation coefficient which is a difference between the feature quantity of said current frame image and a feature quantity of a second preceding frame at least two frame image preceding said current frame image; and indicating a change between video shots a time when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of frame images preceding said current frame image for said second preceding frame image is successively increased so as to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 2
Independent Claim
178 words
A method of detecting a change between video shots from a video including a plurality of succeeding frame images, said method comprising the steps of: inputting said video into a processing device; obtaining a feature quantity of each frame of the inputted video; determining a first correlation coefficient which is a difference between a feature quantity of a current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image; determining a second correlation coefficient which is a difference between the feature quantity of said current frame image and a feature quantity of a second preceding frame at least two frame image preceding said current frame image; and indicating a change between video shots a time when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of frame images preceding said current frame image for said second preceding frame image is successively increased so as to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 3
Dependent Claim
14 words
A method according to claim 1, wherein said feature quantity is a color histogram.
Claim 4
Dependent Claim
57 words
A method according to claim 1, further comprising the steps of: extracting a frame located at said change between video shots or a frame located at a position a predetermined offset from said change between video shots; resizing the frame image to a preset size; and storing the resized frame in a storage device or a medium.
Claim 5
Dependent Claim
88 words
A method according to claim 3, further comprising the step of: storing the resized frame image in a storage device or medium by relating it to at least one of four sets of associated information including first information representing a position of said change in video, second information representing a time when said change occurred, third information representing a distance or time between said change and an immediately preceding change in video, and fourth information describing attributes of said change or of a shot beginning with said change.
Claim 6
Dependent Claim
21 words
A method according to claim 4, wherein the video frame images and their related information are managed in a single file.
Claim 7
Dependent Claim
48 words
A method according to claim 3, wherein a buffer is used to store two or more latest frame images or resized frame images at all times so that when a change is detected in a preceding frame, the frame image containing said change is extracted from the buffer.
Claim 8
Dependent Claim
48 words
A method according to claim 1, wherein in indicating whether the first correlation coefficient and the second correlation coefficient are out of the predetermined allowable ranges, the predetermined allowable ranges are changed according to the feature quantity of an immediately preceding frame or an immediately following frame image.
Claim 9
Dependent Claim
43 words
A method according to claim 7, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is an overall brightness level of at least an immediately preceding frame image or at least an immediately following frame image.
Claim 10
Dependent Claim
39 words
A method according to claim 7, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is a correlation coefficient between the current frame image and an immediately preceding or following frame image.
Claim 11
Dependent Claim
42 words
A method according to claim 7, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is the number of frame images to be processed per unit time for the immediately preceding or following video image.
Claim 12
Dependent Claim
45 words
A method according to claim 1, wherein the number of frame images preceding said current frame image is successively increased for determining said second correlation coefficient in order to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 13
Independent Claim
187 words
A system for detecting a change between video shots from a video including a plurality of succeeding frame images, said system comprising: video playback apparatus for playing said video; a display for displaying said video; and a processing device for obtaining a feature quantity of each frame of the inputted video, determining a first correlation coefficient which is a difference between a feature quantity of a current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image and determining a second correlation coefficient which is a difference between the feature quantity of the current frame image and a feature quantity of a second preceding frame image at least two frame images preceding said current frame image, and indicating on said display a change between video shots when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of images preceding said current frame images for said second preceding frame images is successively increased in order to distinguish a disturbance lasting an arbitrary number of frames from a change between video shots.
Claim 14
Independent Claim
187 words
A system for detecting a change between video shots from a video including a plurality of succeeding frame images, said system comprising: video playback apparatus for playing said video; a display for displaying said video; and a processing device for obtaining a feature quantity of each frame of the inputted video, determining a first correlation coefficient which is a difference between a feature quantity of a current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image and determining a second correlation coefficient which is a difference between the feature quantity of the current frame image and a feature quantity of a second preceding frame image at least two frame images preceding said current frame image, and indicating on said display a change between video shots when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of images preceding said current frame images for said second preceding frame images is successively increased in order to distinguish a disturbance lasting an arbitrary number of frames from a change between video shots.
Claim 15
Dependent Claim
14 words
A system according to claim 12, wherein said feature quantity is a color histogram.
Claim 16
Dependent Claim
55 words
A system according to claim 12, further comprising: means for extracting a frame located at the change in shot or a frame located at a position a predetermined offset from the change; means for resizing the frame to a preset size; and means for storing the resized frame in a storage device or a medium.
Claim 17
Dependent Claim
87 words
A system according to claim 14, further comprising: means for storing the resized frame image in a storage device or medium by relating it to at least one of four sets of associated information, including first information representing a position of the change in video, second information representing a time when the change occurred, third information representing a distance or time between the change and an immediately preceding change in video, and fourth information describing attributes of the change or of a shot beginning with the change.
Claim 18
Dependent Claim
21 words
A system according to claim 15, wherein the video frame images and their related information are managed in a single file.
Claim 19
Dependent Claim
49 words
A system according to claim 14, wherein a buffer is used to store two or more latest frame images or resized frame images at all times so that when of change is detected in a preceding frame image, the frame image containing the change is extracted from the buffer.
Claim 20
Dependent Claim
51 words
A system according to claim 12, wherein said processing device in indicating whether the first correlation coefficient and the second correlation coefficient are out of the predetermined allowable ranges, the predetermined allowable ranges are changed according to the feature quantity of an immediately preceding frame or an immediately following frame image.
Claim 21
Dependent Claim
42 words
A system according to claim 18, wherein the feature quantity of an immediately preceding frame or an immediately following frame image is an overall brightness level of at least an immediately preceding frame image or at least an immediately following frame image.
Claim 22
Dependent Claim
39 words
A system according to claim 18, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is a correlation coefficient between the current frame image and an immediately preceding or following frame image.
Claim 23
Dependent Claim
41 words
A system according to claim 18, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is the number of frames to be processed per unit time for the immediately preceding or following video image.
Claim 24
Dependent Claim
45 words
A system according to claim 12, wherein the number of frame images preceding said current frame image is successively increased for determining said second correlation coefficient in order to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 25
Dependent Claim
223 words
A computer program product for use with a computer having a display, said computer being used to detect a change between video shots from a video including a plurality of succeeding frame images, said computer program comprising: a computer readable medium with the computer program recorded thereon, the computer program comprises: a first code section for inputting video into a processing device, a second code section for obtaining a feature quantity of each frame of the inputted video, a third code section for determining a first correlation coefficient which is a difference between a feature quantity of a current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image and determining a second correlation coefficient which is a difference between the feature quantity of the current frame image and a feature quantity of a second preceding frame image at least two frame images preceding said current frame image, and a fourth code section for indicating a change between video shots when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of frame images preceding said current frame image for said second preceding frame image is successively increased in order to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 26
Dependent Claim
223 words
A computer program product for use with a computer having a display, said computer being used to detect a change between video shots from a video including a plurality of succeeding frame images, said computer program comprising: a computer readable medium with the computer program recorded thereon, the computer program comprises: a first code section for inputting video into a processing device, a second code section for obtaining a feature quantity of each frame of the inputted video, a third code section for determining a first correlation coefficient which is a difference between a feature quantity of a current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image and determining a second correlation coefficient which is a difference between the feature quantity of the current frame image and a feature quantity of a second preceding frame image at least two frame images preceding said current frame image, and a fourth code section for indicating a change between video shots when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of frame images preceding said current frame image for said second preceding frame image is successively increased in order to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 27
Dependent Claim
16 words
A computer program product according to claim 23, wherein said feature quantity is a color histogram.
Claim 28
Dependent Claim
70 words
A computer program product according to claim 23, further comprising: a fifth code section for extracting a frame image located at the change in shot or a frame image located at a position a predetermined offset from the change; a sixth code section for resizing the frame image to a preset size; and a seventh code section for storing the resized frame image in a storage device or a medium.
Claim 29
Dependent Claim
94 words
A computer program product according to claim 25, further comprising: an eighth code section for storing the resized frame image in a storage device or medium by relating it to at least one of four sets of associated information including first information representing a position of the change in video, second information representing a time when the change occurred, third information representing a distance or time between the change in video and an immediately preceding point of change, and fourth information describing attributes of the change or of a shot beginning with the change.
Claim 30
Dependent Claim
23 words
A computer program product according to claim 26, wherein the video frame images and their related information are managed in a single file.
Claim 31
Dependent Claim
52 words
A computer program product according to claim 25, wherein a buffer is used to store two or more latest frame images or resized frame images at all times so that when a change in video is detected in a preceding frame image, the frame containing the change is extracted from the buffer.
Claim 32
Dependent Claim
51 words
A computer program product according to claim 23, wherein in indicating whether the first correlation coefficient and the second correlation coefficient are out of the predetermined allowable ranges, the predetermined allowable ranges are changed according to the feature quantity of an immediately preceding frame image or an immediately following frame image.
Claim 33
Dependent Claim
45 words
A computer program product according to claim 29, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is an overall brightness level of at least an immediately preceding frame image or at least an immediately following frame image.
Claim 34
Dependent Claim
40 words
A computer program product according to claim 29, wherein the feature quantity of an immediately preceding frame image or an immediately following frame is a correlation coefficient between the current frame image and an immediately preceding or following frame image.
Claim 35
Dependent Claim
44 words
A computer program product according to claim 29, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is the number of frame images to be processed per unit time for the immediately preceding or following video image.
Claim 36
Dependent Claim
49 words
A computer program product according to claim 23, wherein the number of frame images preceding said current frame image is successively increased for determining said second correlation coefficient in order to distinguish a disturbance lasting an arbitrary number of frame images from a point of change between video shots.
Claim 37
Dependent Claim
224 words
A computer program product for use with a computer having a display, said computer being used to detect a change between video shots from a video including a plurality of succeeding frame images, said computer program product comprising: a logic circuit with the computer program product recorded thereon, the computer program comprises: a first code second for inputting a video into a processing device, a second code section for obtaining a feature quantity of each frame of the inputted video, a third code section for determining a first correlation coefficient which is a difference between a feature quantity of current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image and determining a second correlation coefficient which is a difference between the feature quantity of the current frame image and a feature quantity of a second preceding frame image at least two frame images preceding said current frame image, and a fourth code section for indicating a change between video shots when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of frame images preceding said current frame image for said second preceding frame image is successively increased in order to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 38
Dependent Claim
224 words
A computer program product for use with a computer having a display, said computer being used to detect a change between video shots from a video including a plurality of succeeding frame images, said computer program product comprising: a logic circuit with the computer program product recorded thereon, the computer program comprises: a first code second for inputting a video into a processing device, a second code section for obtaining a feature quantity of each frame of the inputted video, a third code section for determining a first correlation coefficient which is a difference between a feature quantity of current frame image and a feature quantity of a first preceding frame image immediately preceding said current frame image and determining a second correlation coefficient which is a difference between the feature quantity of the current frame image and a feature quantity of a second preceding frame image at least two frame images preceding said current frame image, and a fourth code section for indicating a change between video shots when the first correlation coefficient and the second correlation coefficient are out of predetermined allowable ranges; wherein the number of frame images preceding said current frame image for said second preceding frame image is successively increased in order to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
Claim 39
Dependent Claim
16 words
A computer program product according to claim 34, wherein said feature quantity is a color histogram.
Claim 40
Dependent Claim
71 words
A computer program product according to claim 34, further comprising: a fifth code section for extracting a frame image located at the change in shot or a frame located at a position a predetermined offset from the change in video; a sixth code section for resizing the frame image to a preset size; and a seventh code section for storing the resized frame image in a storage device or a medium.
Claim 41
Dependent Claim
98 words
A computer program product according to claim 36, further comprising: an eighth code section for storing the resized frame image in a storage device or medium by relating it to at least one of four sets of associated information including first information representing a position of the change in video, second information representing a time when the change in video occurred, third information representing a distance or time between the change in video and an immediately preceding change, and fourth information describing attributes of the change in video or of a shot beginning with the change in video.
Claim 42
Dependent Claim
23 words
A computer program product according to claim 37, wherein the video frame images and their related information are managed in a single file.
Claim 43
Dependent Claim
52 words
A computer program product according to claim 36, wherein a buffer is used to store two or more latest frame images or resized frame images at all times so that when a change in video is detected in a preceding frame image, the frame containing the change is extracted from the buffer.
Claim 44
Dependent Claim
51 words
A computer program product according to claim 34, wherein in indicating whether the first correlation coefficient and the second correlation coefficient are out of the predetermined allowable ranges, the predetermined allowable ranges are changed according to the feature quantity of an immediately preceding frame image or an immediately following frame image.
Claim 45
Dependent Claim
45 words
A computer program product according to claim 40, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is an overall brightness level of at least an immediately preceding frame image or at least an immediately following frame image.
Claim 46
Dependent Claim
41 words
A computer program product according to claim 40, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is a correlation coefficient between the current frame image and an immediately preceding or following frame image.
Claim 47
Dependent Claim
44 words
A computer program product according to claim 40, wherein the feature quantity of an immediately preceding frame image or an immediately following frame image is the number of frame image to be processed per unit time for the immediately preceding or following video image.
Claim 48
Dependent Claim
47 words
A computer program product according to claim 34, wherein the number of frame images preceding said current frame image is successively increased for determining said second correlation coefficient in order to distinguish a disturbance lasting an arbitrary number of frame images from a change between video shots.
References Cited (Backward Citations)
US5099322A
Cited
US5083860A
Cited
EP0590759A1
Cited
EP0637027A2
Cited
US5642294A
Cited
US5635982A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-12-05 | 2004-06-05 | 2004-12-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-12-05 | 2008-06-05 | 2008-12-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-12-05 | 2012-06-05 | 2012-12-05 | $7700.00 | Window Closed / Lapsed |