Moving object detection apparatus

Claim 2

A moving object detection apparatus comprising: means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judgment means including: means for setting a window area of interest for the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval which is predicted to belong to the background because of absence of the moving object from the pattern of at least one of the calculated correlated value; and means for deciding the interval for which a moving object is present from the interval which is predicted to belong to the judged background; wherein said means for judging the interval to be predicted to belong to the background judges whether the background change is caused by the illuminance change or the structure change, from the pattern of at least one of the correlated values.

Claim 3

A moving object detection apparatus comprising: means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame by assuming the data of the window area of interest as vectors to use the distance, the inner product or the angle between the vectors as the correlated value.

Claim 4

A moving object detection apparatus comprising: means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame by assuming the data of the window area of interest as vectors to use the distance, the inner product or the angle between the vectors as the correlated value.

Claim 5

A moving object detection apparatus comprising: means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for detecting of the moving object comprises moving object motion analyzing means including: means for acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and for acquiring two background images, respectively, from such intervals to be predicted to belong to the background as are located before and after the interval for which the moving object is present; means for creating two background differential images from the frame image and the background images located before and after the period of said frame image; means for determining a merging region from the two background differential images; and means for cutting a moving object image out of said frame image and said merging region; whereby the moving object image is extracted.

Claim 6

A moving object detection apparatus comprising: means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for detecting of the moving object comprises moving object motion analyzing means including: means for acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and for acquiring two background images, respectively, from such intervals to be predicted to belong to the background as are located before and after the interval for which the moving object is present; means for creating two background differential images from the frame image and the background images located before and after the period of said frame image; means for determining a merging region from the two background differential images; and means for cutting a moving object image out of said frame image and said merging region; whereby the moving object image is extracted.

Claim 7

A moving object detection apparatus according to claim 3, wherein said means for creating the two background differential images from the frame image and the background images located before and after the period of said frame image creates the background difference by assuming the partial data of the window area of interest as vectors to use the distance, the inner product and the angle of the vectors.

Claim 8

A moving object detection apparatus comprising: means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for deciding the interval for which the moving object is present includes: means for cutting out the spatial-temporal image of the interval for which the moving object is present; means for separating the moving object region from the image regions of only the two backgrounds, as are located before and behind the interval for which the moving object is present, and the spatial-temporal image; means for correcting the obtained moving object region by the morphology processing and the hole fill processing; means for determining the region which is obtained from the corrected background differential image and in which the two moving object regions are merged; and means for estimating the direction/velocity of the moving object by calculating the inclination of the obtained merged region.

Claim 9

A moving object detection apparatus comprising: means for inputting a movie; means for detecting a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; wherein said means for deciding the interval for which the moving object is present includes: means for cutting out the spatial-temporal image of the interval for which the moving object is present; means for separating the moving object region from the image regions of only the two backgrounds, as are located before and behind the interval for which the moving object is present, and the spatial-temporal image; means for correcting the obtained moving object region by the morphology processing and the hole fill processing; means for determining the region which is obtained from the corrected background differential image and in which the two moving object regions are merged; and means for estimating the direction/velocity of the moving object by calculating the inclination of the obtained merged region.

Claim 10

A moving object detection apparatus according to claim 5, wherein said means for determining the region, which is obtained from the corrected background differential image and in which the two moving object regions are merged, merge the regions by using the logical product of the two region images.

Claim 11

A moving object detection apparatus according to claim 6, wherein said means for outputting said detected result includes means for displaying the inputted movie, the representative screen of the detected moving object, or the representative screen of the detected background change.

Claim 12

A moving object detection apparatus according to claim 7, wherein the representative screen before the background change and the representative screen after the background change are displayed as one group.

Claim 13

A moving object detection apparatus according to claim 7, wherein the representative screens of the moving objects are displayed in a list.

Claim 14

A moving object detection apparatus according to claim 7, wherein said means for outputting said detected result includes means for simultaneously displaying the sequences of the correlated values grounding the detected moving object and background change.

Claim 15

A moving object detection apparatus according to claim 10, wherein the sequence of the correlated values of the data of the window area of interest in a predetermined frame, as grounding the detected moving object and background change, and the data of the window area of interest of each frame are simultaneously displayed.

Claim 16

A moving object detection apparatus according to claim 10, wherein the images, which are obtained by arranging the pixels of the window area of interest in each frame, as grounding the detected moving object and background change, in the chronological order, are simultaneously displayed.

Claim 17

A moving object detection apparatus comprising: means for inputting a movie; means for detection a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; moving object motion analyzing means including: means for acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and for acquiring two background images, respectively; means for creating two background differential images from the frame image and the background images located before and after the period of said frame image; means for determining a merging region from the two background differential images; and means for cutting a moving object image out of said frame image and said merging region; and moving object extracting means including: means for cutting out the spatial-temporal image of the interval for which the moving object is present; means for separating the moving object region from the image regions of only the two backgrounds, as are located before and behind the interval for which the moving object is present, and the spatial-temporal image; means for correcting the obtained moving object region by the morphology processing and the hole fill processing; means for determining the region which is obtained from the corrected background differential image and in which the two moving object regions are merged; and means for estimating the direction/velocity of the moving object by calculating the inclination of the obtained merged region.

Claim 18

A moving object detection apparatus comprising: means for inputting a movie; means for detection a moving object from the inputted movie; and means for outputting the detected result, wherein said moving object detection means comprises background judging means including: means for setting a window area of interest for judging the background with respect to the inputted movie; means for calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; means for judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; means for deciding the interval, for which a moving object is present, from the interval which is predicted to belong to the judged background; moving object motion analyzing means including: means for acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and for acquiring two background images, respectively; means for creating two background differential images from the frame image and the background images located before and after the period of said frame image; means for determining a merging region from the two background differential images; and means for cutting a moving object image out of said frame image and said merging region; and moving object extracting means including: means for cutting out the spatial-temporal image of the interval for which the moving object is present; means for separating the moving object region from the image regions of only the two backgrounds, as are located before and behind the interval for which the moving object is present, and the spatial-temporal image; means for correcting the obtained moving object region by the morphology processing and the hole fill processing; means for determining the region which is obtained from the corrected background differential image and in which the two moving object regions are merged; and means for estimating the direction/velocity of the moving object by calculating the inclination of the obtained merged region.

Claim 19

A moving object detection method comprising: setting a window area of interest for judging the background for an inputted movie; calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and deciding the interval, for which a moving object is present, from the interval for which is predicted to belong to the judged background; acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and acquiring two background images, respectively, from such intervals to be predicted to belong to the background as are located before and after the interval for which the moving object is present; creating two background differential images from the frame image and the background images located before and after the period of said frame image; determining a merging region from the two background differential images; and cutting a moving object image out of said frame image and said merging region, and extracting the moving object image.

Claim 20

A moving object detection method comprising: setting a window area of interest for judging the background for an inputted movie; calculating the correlation between the data of the window area of interest in a predetermined frame and the data of the window area of interest in each frame; judging the interval, which is predicted to belong to the background because of absence of the moving object, from the pattern of at least one of the calculated correlated value; and deciding the interval, for which a moving object is present, from the interval for which is predicted to belong to the judged background; acquiring the frame image containing the moving object on the basis of the interval, for which the moving object is present, and acquiring two background images, respectively, from such intervals to be predicted to belong to the background as are located before and after the interval for which the moving object is present; creating two background differential images from the frame image and the background images located before and after the period of said frame image; determining a merging region from the two background differential images; and cutting a moving object image out of said frame image and said merging region, and extracting the moving object image.

Claim 21

A moving object detection method according to claim 14, further comprising: cutting out the spatial-temporal image of the interval for which the moving object is present; separating the moving object region from the image regions of only the two backgrounds, as are located before and behind the interval for which the moving object is present, and the spatial-temporal image; and estimating the direction/velocity of the moving object by calculating the inclination of the obtained merged region.

Claim 22

A moving object detection apparatus for detecting a moving object in a video image comprising: a first memory for storing background image data; a second memory for storing inputted video image data; means for detecting a moving object according to background differences between the background image data stored in the first memory and a frame of the video image stored in the second memory; background judging means for determining a background image, said background judging means setting a window of interest, and detecting a moving object period and a background period based on a correlation between data of the window area of interest in the background image and data of the window area of interest in each frame image following a position of the set window area of interest; wherein said means for detecting a moving object utilizes a new background image for the previously determined background image when the new background image is in the background period where a correlation pattern is different from a correlation pattern in the background period including the previously determined background image.

Claim 23

A moving object detection apparatus for detecting a moving object in a video image comprising: a first memory for storing background image data; a second memory for storing inputted video image data; means for detecting a moving object according to background differences between the background image data stored in the first memory and a frame of the video image stored in the second memory; background judging means for determining a background image, said background judging means setting a window of interest, and detecting a moving object period and a background period based on a correlation between data of the window area of interest in the background image and data of the window area of interest in each frame image following a position of the set window area of interest; wherein said means for detecting a moving object utilizes a new background image for the previously determined background image when the new background image is in the background period where a correlation pattern is different from a correlation pattern in the background period including the previously determined background image.

Claim 24

A moving object detection apparatus according to claim 16, wherein the window area of interest for the background judgment has a straight line or segment shape.

Claim 25

A moving object detection apparatus according to claim 16, wherein the window area of interest for the background of judgment has a square shape.

Claim 26

A moving object detection apparatus according to claim 16, wherein said background judging means judges an interval to be predicted to belong to the background image using a correlation pattern which has no change in a correlated value for a constant period as a correlation pattern of the correlated value for judging the interval to be predicted to belong to the background image.

Claim 27

A moving object detection apparatus according to claim 16, wherein said background judging means determines whether the background image to be utilized is the previously determined background image or the new background image based upon the different correlation pattern in accordance with at a change of at least one of illuminance and structure.