US7212650B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Monitoring system and monitoring method
Assignee: Mitsubishi Electric Corp
•
Filing: 2002-12-17
•
Granted: 2007-05-01
•
Expires: 2022-12-17
Abstract
Abstract A camera picks-up at least two images of a region where an object is present. A monitoring unit monitors the object and displays the images of the object on a display for a user. The monitoring unit obtains a difference image of the two images, and removes an image of a moving object that may be considered as a background image from the difference image to thereby obtain an image of the object. The monitoring unit determines the image of the moving object as the background image based on an area of the image of the moving object. The monitoring unit determines a state of the object based on barycentric positions of the images of the moving objects in the difference image.
Inventors
- 👤 Noriaki Sumi
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:04
CPC Classifications
G; G08; G08B; G08B13/00; G08B13/18; G08B13/189; G08B13/194; G08B13/196; G08B13/19678; G08B13/19686; G06; G06T; G06T7/00; G06T7/20; G06T7/254
Claims Analysis
Total Claims: 17
Claim 1
Independent Claim
260 words
A monitoring system comprising: an image pick-up unit that obtains at least two images of a region where an object to be monitored is present at different timing; a monitoring unit that extracts an image of the monitored object from the images picked-up by the image pick-up unit, determines a state of the monitored object, and transmits the image of the monitored object and the state of the monitored object; and a display unit that receives and displays the image of the monitored object and the state of the monitored object for an observer, the monitoring unit including an outline extracting unit that obtains a difference image from the two images picked up by the image pick-up unit, extracts outlines of non-monitored objects and the monitored object in the difference image to extract images of moving objects in the difference image; an attribute processing unit that calculates areas and barycentric positions of each of the images of the moving objects in the difference image; a fluctuation extracting unit that determines an image of the moving object that may be considered as a moving background image based on the area of the image of the moving object in the difference image and subtracts the image of the moving object that may be considered as the moving background image from the difference image to extract an image of the monitored object without the moving background image; and a determination unit that determines the state of the monitored object based on the barycentric positions and the difference image from the fluctuation extracting unit.
Claim 2
Dependent Claim
260 words
A monitoring system comprising: an image pick-up unit that obtains at least two images of a region where an object to be monitored is present at different timing; a monitoring unit that extracts an image of the monitored object from the images picked-up by the image pick-up unit, determines a state of the monitored object, and transmits the image of the monitored object and the state of the monitored object; and a display unit that receives and displays the image of the monitored object and the state of the monitored object for an observer, the monitoring unit including an outline extracting unit that obtains a difference image from the two images picked up by the image pick-up unit, extracts outlines of non-monitored objects and the monitored object in the difference image to extract images of moving objects in the difference image; an attribute processing unit that calculates areas and barycentric positions of each of the images of the moving objects in the difference image; a fluctuation extracting unit that determines an image of the moving object that may be considered as a moving background image based on the area of the image of the moving object in the difference image and subtracts the image of the moving object that may be considered as the moving background image from the difference image to extract an image of the monitored object without the moving background image; and a determination unit that determines the state of the monitored object based on the barycentric positions and the difference image from the fluctuation extracting unit.
Claim 3
Dependent Claim
62 words
The monitoring system according to claim 1 , wherein the fluctuation extracting unit checks whether an amount of fluctuation in the area of an image of a moving object is larger than a predetermined value, and when the amount of fluctuation in the area is larger than the predetermined value determines the image of the moving object as the moving background image.
Claim 4
Dependent Claim
62 words
The monitoring system according to claim 1 , wherein the fluctuation extracting unit checks whether an amount of movement of the barycentric position of an image of a moving object is within a predetermined region, and when the amount of movement of the barycentric position is within the predetermined region determines the image of the moving object as the moving background image.
Claim 5
Dependent Claim
23 words
The monitoring system according to claim 1 , wherein the fluctuation extracting unit colors the inside of the image of the monitored object.
Claim 6
Dependent Claim
28 words
The monitoring system according to claim 1 , wherein if there are a plurality monitored objects, the fluctuation extracting unit colors each monitored object with a different color.
Claim 7
Dependent Claim
35 words
The monitoring system according to claim 1 , wherein if there are a plurality of monitored objects, the fluctuation extracting unit assigns a different character or a number or a symbol to each monitored object.
Claim 8
Dependent Claim
37 words
A monitoring system according to claim 1 , wherein the fluctuation extracting unit determines the moving object is the moving background image based on the barycentric position of the moving object not moving beyond a predetermined range.
Claim 9
Dependent Claim
29 words
A monitoring system according to claim 1 , wherein the determination unit determines the state of the monitored object from displacement of the barycentric position based upon predetermined conditions.
Claim 10
Dependent Claim
28 words
A monitoring system according to claim 1 , wherein the difference image is based on an absolute value of a difference of respective pixel values in two images.
Claim 11
Dependent Claim
247 words
A monitoring method of monitoring an object present in a region using a monitoring unit, the monitoring unit including an image pick-up unit that obtains at least two images of the region at different timing; a monitoring unit that extracts an image of the monitored object from the images picked-up by the image pick-up unit, determines a state of the monitored object, and transmits the image of the monitored object and the state of the monitored object; and a display unit that receives and displays the image of the monitored object and the state of the monitored object for an observer, the monitoring method comprising: obtaining a difference image from the two images picked up by the image pick-up unit; extracting outlines of non-monitored objects and the monitored object in the difference image to extract images of moving objects in the difference image; calculating areas and barycentric positions of each of the images of the moving objects in the difference image; determining an image of the moving object that may be considered as a moving background image based on the area of the image of the moving object in the difference image; subtracting the image of the moving object that may be considered as the moving background image from the difference image to extract an image of the monitored object without the moving background image; and determining the state of the monitored object based on the barycentric positions and the difference images without the moving background image.
Claim 12
Dependent Claim
247 words
A monitoring method of monitoring an object present in a region using a monitoring unit, the monitoring unit including an image pick-up unit that obtains at least two images of the region at different timing; a monitoring unit that extracts an image of the monitored object from the images picked-up by the image pick-up unit, determines a state of the monitored object, and transmits the image of the monitored object and the state of the monitored object; and a display unit that receives and displays the image of the monitored object and the state of the monitored object for an observer, the monitoring method comprising: obtaining a difference image from the two images picked up by the image pick-up unit; extracting outlines of non-monitored objects and the monitored object in the difference image to extract images of moving objects in the difference image; calculating areas and barycentric positions of each of the images of the moving objects in the difference image; determining an image of the moving object that may be considered as a moving background image based on the area of the image of the moving object in the difference image; subtracting the image of the moving object that may be considered as the moving background image from the difference image to extract an image of the monitored object without the moving background image; and determining the state of the monitored object based on the barycentric positions and the difference images without the moving background image.
Claim 13
Dependent Claim
20 words
The monitoring method according to claim 10 , further comprising coloring the inside of the image of the monitored object.
Claim 14
Dependent Claim
32 words
The monitoring method according to claim 10 , if there are a plurality of monitored objects, further comprising assigning a different character or a number or a symbol to each monitored object.
Claim 15
Dependent Claim
37 words
A monitoring method according to claim 10 , further comprising the step of determining the moving object is the moving background image based on the barycentric position of the moving object not moving beyond a predetermined range.
Claim 16
Dependent Claim
30 words
A monitoring method according to claim 10 , further comprising the step of determining the state of the monitored object from displacement of the barycentric position based upon predetermined conditions.
Claim 17
Dependent Claim
32 words
A monitoring method to claim 10 , further comprising the step of determining the difference image is based on an absolute value of a difference of respective pixel values in two images.
References Cited (Backward Citations)
US5054097A
Cited
US5243418A
Cited
US6636635B2
Cited
US5969755A
Cited
US6456320B2
Cited
JP2000000216A
Cited
US6570608B1
Cited
JP2000278584A
Cited
JP2001028086A
Cited
JP2001069494A
Cited
US6424370B1
Cited
US6819353B2
Cited
US6678413B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2010-04-30 | 2010-10-30 | 2011-05-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2014-04-30 | 2014-10-30 | 2015-05-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2018-04-30 | 2018-10-30 | 2019-05-01 | $7700.00 | Window Closed / Lapsed |