Patent US6181345B1 successfully refreshed from Google Patents.
US6181345B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for replacing target zones in a video sequence
Assignee: Symah Vision
•
Filing: 1998-12-02
•
Granted: 2001-01-30
•
Expires: 2018-12-02
Abstract
Abstract The method for replacing a target billboard in the frames of a video sequence is usable while the billboard undergoes changes of position in the scene. Assuming that the speed of change is constant, a global transformation from a reference image stored in memory is predicted. A modified image is generated by applying the transformation to the reference image and the prediction is adjusted by a global analysis of the image. Then the representation of the billboard is recovered from its color, and its boundaries are extracted by segmentation. The representation of the billboard is substituted by the representation of the model, after the model is warped by a transformation.
Inventors
- 👤 Gilles Richard
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:19
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/272; H04N5/2723
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
151 words
A method for replacing a representation of a target zone with a pattern in successive images of a video sequence, suitable for use while the target zone has a position with respect to a background scene which changes during the video sequence, comprising, for each of successive images of the video sequence, the steps of: (a) assuming that said position changes at constant speed, determining a global transformation predicted from a stored reference image, generating a modified image by applying the global transformation to the reference image, and adjusting the predicted transformation through a global analysis of the image; (b) recognizing said representation of the target zone from a colour thereof and extracting boundaries thereof by segmentation; and (c) verifying a coherence of the recognition, subjecting said pattern to a transformation responsive to the representation recognized at step (b) and substituting the representation of the target zone, by the transformed pattern.
Claim 2
Independent Claim
151 words
A method for replacing a representation of a target zone with a pattern in successive images of a video sequence, suitable for use while the target zone has a position with respect to a background scene which changes during the video sequence, comprising, for each of successive images of the video sequence, the steps of: (a) assuming that said position changes at constant speed, determining a global transformation predicted from a stored reference image, generating a modified image by applying the global transformation to the reference image, and adjusting the predicted transformation through a global analysis of the image; (b) recognizing said representation of the target zone from a colour thereof and extracting boundaries thereof by segmentation; and (c) verifying a coherence of the recognition, subjecting said pattern to a transformation responsive to the representation recognized at step (b) and substituting the representation of the target zone, by the transformed pattern.
Claim 3
Dependent Claim
62 words
Method according to claim 1 , further comprising the steps of: (d1) computing a predicted local transform; (d2) refining an estimation of interest points in the target zone using a 2-D correlation around the interest points; and computing a geometric transform relating positions of the interest points in the reference image to their position in the current image of the video sequence.
Claim 4
Dependent Claim
17 words
Method according to claim 2 , wherein step (d1) makes use of Kalman filtering on successive images.
Claim 5
Dependent Claim
27 words
A method according to claim 2 , wherein step (d2) is performed using a correlation of neighborhoods of several representations of the reference image at different scales.
Claim 6
Dependent Claim
27 words
A method according to claim 2 , comprising estimating the position and appearance of the representation of the target zone in each current image during step (c).
Claim 7
Dependent Claim
29 words
The method of claim 5 , wherein estimation is made using the last correct estimation provided by pattern recognition and data provided by local tracking if quality is unsatisfactory.
Claim 8
Dependent Claim
31 words
The method of claim 6 , wherein estimation is made using information provided by pattern recognition after it is found that quality of information obtained by said pattern recognition is satisfactory.
Claim 9
Dependent Claim
32 words
A method according to claim 1 , wherein a specific color is assigned to the target zone and identification thereof in the current image is from said specific color and its shape.
Claim 10
Dependent Claim
18 words
A method according to claim 8 , wherein the target zone is of rectangular shape when not distorted.
Claim 11
Dependent Claim
29 words
A method according to claim 9 , wherein said rectangular shape has a format of 4×3 or 19×9 and the pattern originates from a video camera or a V.C.R.
Claim 12
Dependent Claim
78 words
The method of claim 1 , wherein the stored reference image used for predicting said global transformation is periodically refreshed by storing the current image of the video sequence responsive to any one of the following situations: when the current image is a first image to be processed in the video sequence, when the current image becomes different from the reference image in excess of a predetermined amount, when the reference image is older than a predetermined time.
Claim 13
Dependent Claim
28 words
The method of claim 11 , wherein said predetermined amount relates to motion or change in focal length exceeding a predefined threshold or the presence of occluding obstacles.
Claim 14
Dependent Claim
80 words
The method of claim 11 , comprising re-sampling the reference image after computation of a predicted transformation by: applying the predicted transformation in order to obtain a deformed and shifted image; roughly estimating a translation from the reference image to the current image, using a correlation process; re-sampling the reference using the available rough rather than prediction; and evaluating the transformation required for passage from the reference image to the current image using several iterations based on a gradient approach.
Claim 15
Independent Claim
150 words
An apparatus for replacing a representation of a target zone with a representation of a pattern in successive images of a video sequence, suitable for use while the target zone has a position with respect to a background scene which changes during the video sequence, comprising a plurality of micro-computers programmed respectively for: (a) assuming that said position changes at constant speed, determining a global transformation predicted from a stored reference image, generating a modified image by applying the global transformation to the reference image, and adjusting the predicted transformation through a global analysis of the image; (b) recognizing said representation of the target zone from a colour thereof and extracting boundaries thereof by segmentation; and (c) verifying a coherence of the recognition, subjecting said pattern to a transformation is responsive to the representation recognized at step (b) and substituting the representation of the target zone, by the transformed pattern.
Claim 16
Independent Claim
150 words
An apparatus for replacing a representation of a target zone with a representation of a pattern in successive images of a video sequence, suitable for use while the target zone has a position with respect to a background scene which changes during the video sequence, comprising a plurality of micro-computers programmed respectively for: (a) assuming that said position changes at constant speed, determining a global transformation predicted from a stored reference image, generating a modified image by applying the global transformation to the reference image, and adjusting the predicted transformation through a global analysis of the image; (b) recognizing said representation of the target zone from a colour thereof and extracting boundaries thereof by segmentation; and (c) verifying a coherence of the recognition, subjecting said pattern to a transformation is responsive to the representation recognized at step (b) and substituting the representation of the target zone, by the transformed pattern.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-01-30 | 2004-07-31 | 2005-01-30 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-01-30 | 2008-07-31 | 2009-01-30 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-01-30 | 2012-07-31 | 2013-01-30 | $7700.00 | Window Closed / Lapsed |