Patent US814058A successfully refreshed from Google Patents.
US7085401B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Automatic object extraction
Assignee: F Poszat HU LLC
•
Filing: 2001-10-31
•
Granted: 2006-08-01
•
Expires: 2021-10-31
Abstract
Abstract A method for automatic, stable and robust object extraction of moving objects in color video frames, achieved without any prior knowledge of the video content. For high rate video, the method includes providing at least a first and a second high frame rate video frames, performing a reciprocal illumination correction of the first and second video frames to yield respective first and second smoothed frames, performing a change detection operation between the first and second smoothed frames to obtain a difference image, and performing a local adaptive thresholding operation on the difference image to generate a binary image containing extracted objects, the local thresholding operation using a weight test to determine a boundary of each of the extracted objects. For an extracted object with a fragmented boundary, the method further comprises re-unifying the boundary. For low rate video, additional steps include: an edge correction applied on the first image to yield a first edge-corrected image, a global thresholding applied to the first edge-corrected image to yield a first binary edge image, and an ANDing operation on the difference image and the first binary edge image to generate a second binary image which is fed to the local adaptive thresholding operation.
Inventors
- 👤 Amir Averbuch
- 👤 Ofer Miller
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:00
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/10; G06T7/12; G06T7/174; G06T7/20; G06T7/215; G06V; G06V10/00; G06V10/20; G06V10/28; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/20; G06T2207/20004; G06T2207/20012; G06T2207/20048; G06T2207/20064
Claims Analysis
Total Claims: 28
Claim 1
Independent Claim
142 words
A method for automatic extraction of objects in video sequences, each object represented by an array of pixels, the method comprising: a. providing at least a first and a second high frame rate video frames; b. performing a reciprocal illumination correction of said first and second video frames to yield respective first and second smoothed frames; c. performing a change detection operation between said first and second smoothed frames to obtain a difference image; and d. performing a local adaptive thresholding operation on said difference image to generate a binary image containing extracted objects, said local thresholding operation using a weight test to determine a boundary of each of said extracted objects, whereby the extraction of said extracted objects by the method is automatic stable and robust, and whereby no advance knowledge of the video sequences is needed to achieve the extraction.
Claim 2
Independent Claim
142 words
A method for automatic extraction of objects in video sequences, each object represented by an array of pixels, the method comprising: a. providing at least a first and a second high frame rate video frames; b. performing a reciprocal illumination correction of said first and second video frames to yield respective first and second smoothed frames; c. performing a change detection operation between said first and second smoothed frames to obtain a difference image; and d. performing a local adaptive thresholding operation on said difference image to generate a binary image containing extracted objects, said local thresholding operation using a weight test to determine a boundary of each of said extracted objects, whereby the extraction of said extracted objects by the method is automatic stable and robust, and whereby no advance knowledge of the video sequences is needed to achieve the extraction.
Claim 3
Dependent Claim
58 words
The method of claim 1 , wherein said first and second video frames are colored video frames, and wherein said step of providing at least a first and a second video frames is preceded by a logical test for said high frame rate, said logical test checking whether said high rate is at least fifteen frames per second.
Claim 4
Dependent Claim
30 words
The method of claim 1 , wherein said step of reciprocal illumination correction includes the application of a low pass filter on each of said first and second video frames.
Claim 5
Dependent Claim
26 words
The method of claim 3 , wherein said low pass filter is selected from the group consisting of bilateral, Gaussian, non-decimated scaling wavelet and spline filters.
Claim 6
Dependent Claim
26 words
The method of claim 1 , wherein said step of reciprocal illumination correction further includes normalization of pixel values of said first and second smoothed frames.
Claim 7
Dependent Claim
29 words
The method of claim 5 , wherein said normalization further includes a pixel-by-pixel division of said first and second smoothed frames by respectively said first and second video frames.
Claim 8
Dependent Claim
22 words
The method of claim 1 , wherein said step of performing a change detection operation includes performing a statistical model-based change detection.
Claim 9
Dependent Claim
37 words
The method of claim 1 , wherein said step of performing a local adaptive thresholding operation further includes the substep of using the pixels as seeds for a search operation resulting in the determination of said boundary.
Claim 10
Dependent Claim
19 words
The method of claim 1 , wherein said boundary is fragmented, said method further comprising re-unifying said fragmented boundary.
Claim 11
Dependent Claim
21 words
The method of claim 9 , wherein said step of performing a local adaptive thresholding further includes performing a region-growing operation.
Claim 12
Dependent Claim
47 words
The method of claim 1 , wherein said weight test use includes checking for a monotonic change in said weight, said change showing a monotonic increase for pixels inside said boundary, and a monotonic decrease leading to a plateau in said weight for pixels outside said boundary.
Claim 13
Dependent Claim
19 words
The method of claim 11 , wherein said step of re-unifying is carried out using a contour extraction algorithm.
Claim 14
Independent Claim
198 words
A method for automatic extraction of objects in video sequences, each object represented by an array of pixels, the method comprising: a. providing at least a first and a second low frame rate video frames; b. performing a reciprocal illumination correction of said first and second video frames to yield respective first and second smoothed frames; c. performing an edge detection operation on said first video frame to produce a first edge image; d. performing a change detection operation between said first and second smoothed frames to obtain a difference image; e. performing a global thresholding operation on said first edge image to produce a first binary edge image; f. ANDing said difference image and said first binary edge image to produce a first edge-corrected difference image; and g. performing a local adaptive thresholding operation on said first edge-corrected difference image to generate a second binary image containing extracted objects, said local thresholding operation using a weight test to determine a boundary of each of said extracted objects, whereby the extraction of said extracted objects by the method is automatic, stable and robust, and whereby no advance knowledge of the video sequences is needed to achieve the extraction.
Claim 15
Independent Claim
198 words
A method for automatic extraction of objects in video sequences, each object represented by an array of pixels, the method comprising: a. providing at least a first and a second low frame rate video frames; b. performing a reciprocal illumination correction of said first and second video frames to yield respective first and second smoothed frames; c. performing an edge detection operation on said first video frame to produce a first edge image; d. performing a change detection operation between said first and second smoothed frames to obtain a difference image; e. performing a global thresholding operation on said first edge image to produce a first binary edge image; f. ANDing said difference image and said first binary edge image to produce a first edge-corrected difference image; and g. performing a local adaptive thresholding operation on said first edge-corrected difference image to generate a second binary image containing extracted objects, said local thresholding operation using a weight test to determine a boundary of each of said extracted objects, whereby the extraction of said extracted objects by the method is automatic, stable and robust, and whereby no advance knowledge of the video sequences is needed to achieve the extraction.
Claim 16
Dependent Claim
61 words
The method of claim 13 , wherein said first and second video frames are colored video frames, and wherein said step of providing at least a first and a second low frame rate video frames is preceded by a logical test for said low frame rate, said logical test checking whether said low rate is less than fifteen frames per second.
Claim 17
Dependent Claim
30 words
The method of claim 13 , wherein said step of reciprocal illumination correction includes the application of a low pass filter on each of said first and second video frames.
Claim 18
Dependent Claim
26 words
The method of claim 15 , wherein said low pass filter is selected from the group consisting of bilateral, Gaussian, non-decimated scaling wavelet and spline filters.
Claim 19
Dependent Claim
26 words
The method of claim 13 , wherein said step of reciprocal illumination correction further includes normalization of pixel values of said first and second smoothed frames.
Claim 20
Dependent Claim
28 words
The method of claim 17 , wherein said normalization includes a pixel-by-pixel division of said first and second smoothed frames by respectively said first and second video frames.
Claim 21
Dependent Claim
22 words
The method of claim 13 , wherein said step of performing a change detection operation includes performing a statistical model-based change detection.
Claim 22
Dependent Claim
157 words
The method of claim 13 , wherein said step of performing a global thresholding operation on said first edge image includes: iteratively: i. choosing an initial threshold based on a first average of gray level values of a group of pixels in the image; ii. computing a new threshold based on a second average of all gray level values that are below said initial threshold, and assigning said new threshold to said initial threshold to get a modified threshold; iii. computing a third average of all gray level values that are above said initial threshold, and averaging said third average with said modified threshold to get a modified new threshold; iv. comparing said modified new threshold with said modified threshold; and v. assigning said modified new threshold to said modified threshold if said modified new and modified thresholds are not equal, and continuing a looping procedure until said modified new threshold and said modified threshold are equal.
Claim 23
Dependent Claim
19 words
The method of claim 13 , wherein said boundary is fragmented, said method further comprising re-unifying said fragmented boundary.
Claim 24
Dependent Claim
21 words
The method of claim 21 , wherein said step of performing a local adaptive thresholding further includes performing a region-growing operation.
Claim 25
Dependent Claim
47 words
The method of claim 13 , wherein said weight test use includes checking for a monotonic change in said weight, said change showing a monotonic increase for pixels inside said boundary, and a monotonic decrease leading to a plateau in said weight for pixels outside said boundary.
Claim 26
Dependent Claim
19 words
The method of claim 23 , wherein said step of re-unifying is carried out using a contour extraction algorithm.
Claim 27
Independent Claim
153 words
A method for automatic extraction of objects in color video sequences, each object represented by an array of pixels, the method comprising: a. providing at least a first and a second high frame rate video frames; b. obtaining a first edge image of said first video frame; c. obtaining a difference image based on first and second illumination corrected, smoothed frames derived from said first and second video frames respectively; d. performing a global thresholding operation on said first edge image to produce a first binary edge image; e. ANDing said difference image and said first binary edge image to produce a first edge-corrected difference image; and f. based on said first edge-corrected difference image, generating a second binary image containing extracted objects, whereby the extraction of said extracted objects by the method is automatic, stable and robust, and whereby no advance knowledge of the video sequences is needed to achieve the extraction.
Claim 28
Independent Claim
153 words
A method for automatic extraction of objects in color video sequences, each object represented by an array of pixels, the method comprising: a. providing at least a first and a second high frame rate video frames; b. obtaining a first edge image of said first video frame; c. obtaining a difference image based on first and second illumination corrected, smoothed frames derived from said first and second video frames respectively; d. performing a global thresholding operation on said first edge image to produce a first binary edge image; e. ANDing said difference image and said first binary edge image to produce a first edge-corrected difference image; and f. based on said first edge-corrected difference image, generating a second binary image containing extracted objects, whereby the extraction of said extracted objects by the method is automatic, stable and robust, and whereby no advance knowledge of the video sequences is needed to achieve the extraction.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-07-31 | 2010-01-30 | 2010-08-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-07-31 | 2014-01-30 | 2014-08-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-07-31 | 2018-01-30 | 2018-08-01 | $7700.00 | Window Closed / Lapsed |