US6449019B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Real-time key frame effects using tracking information
Assignee: Avid Technology Inc
•
Filing: 2000-04-07
•
Granted: 2002-09-10
•
Expires: 2020-04-07
Abstract
Abstract Real time effects are provided by using tracking information to define values for parameters of an effect. The tracking information also may be combined with parameters for various effects that operate on the position, rotation, scale, skew and perspective of objects in an image. The values defined for the parameters of an effect may be represented in a transformation matrix used in a real time digital video effects processor.
Inventors
- 👤 Thomas G. Fincher
- 👤 Robert A. Paoni
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 22:53
CPC Classifications
G; G06; G06T; G06T3/00; G06T7/00; G06T7/20; G06T7/246; H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/272
Claims Analysis
Total Claims: 42
Claim 1
Independent Claim
94 words
A method for generating in real time an effect that is specified by key frames on video data comprising a sequence of images using tracking information, comprising: for each image that is not a key frame, interpolating one or more values for parameters for the effect using one or more values that are specified at the key frames; combining the tracking information with the one or more interpolated values; performing the effect on each image in the sequence of images in real time using the combined tracking information and one or more interpolated values.
Claim 2
Independent Claim
94 words
A method for generating in real time an effect that is specified by key frames on video data comprising a sequence of images using tracking information, comprising: for each image that is not a key frame, interpolating one or more values for parameters for the effect using one or more values that are specified at the key frames; combining the tracking information with the one or more interpolated values; performing the effect on each image in the sequence of images in real time using the combined tracking information and one or more interpolated values.
Claim 3
Independent Claim
83 words
A method for generating an effect that is specified by key frames on video data comprising a sequence of images using tracking information, comprising: for each image that is not a key frame, interpolating one or more values for parameters for the effect using one or more values that are specified at the key frames; combining the tracking information with the one or more interpolated values; performing the effect on each image using the combined tracking information and one or more interpolated values.
Claim 4
Independent Claim
83 words
A method for generating an effect that is specified by key frames on video data comprising a sequence of images using tracking information, comprising: for each image that is not a key frame, interpolating one or more values for parameters for the effect using one or more values that are specified at the key frames; combining the tracking information with the one or more interpolated values; performing the effect on each image using the combined tracking information and one or more interpolated values.
Claim 5
Independent Claim
59 words
A method for generating an effect in real time on video data comprising a sequence of images using tracking information, comprising: for each image, determining one or more values for parameters for the effect using the tracking information; performing the effect on each image in the sequence of images in real time using the determined one or more values.
Claim 6
Independent Claim
59 words
A method for generating an effect in real time on video data comprising a sequence of images using tracking information, comprising: for each image, determining one or more values for parameters for the effect using the tracking information; performing the effect on each image in the sequence of images in real time using the determined one or more values.
Claim 7
Dependent Claim
103 words
The method of claim 1 , wherein the effect is insertion of a foreground object into a background in the sequence of images, wherein the tracking information defines movement of an object in the background, wherein the combining the tracking information with the one or more interpolated values includes determining a transformation matrix defining a transform between an initial position of the object in the background in a first image in the sequence of images and a current position of the object in the background in the image; and wherein the performing the effect includes using the transformation matrix to perform the effect.
Claim 8
Dependent Claim
20 words
The method of claim 4 , wherein the tracking information includes two points and the transformation is a linear transformation.
Claim 9
Dependent Claim
20 words
The method of claim 4 , wherein the tracking information includes three points and the transformation is an affine transformation.
Claim 10
Dependent Claim
20 words
The method of claim 4 , wherein the tracking information includes four points and the transformation is a projective transformation.
Claim 11
Dependent Claim
103 words
The method of claim 2 , wherein the effect is insertion of a foreground object into a background in the sequence of images, wherein the tracking information defines movement of an object in the background, wherein the combining the tracking information with the one or more interpolated values includes determining a transformation matrix defining a transform between an initial position of the object in the background in a first image in the sequence of images and a current position of the object in the background in the image; and wherein the performing the effect includes using the transformation matrix to perform the effect.
Claim 12
Dependent Claim
20 words
The method of claim 8 , wherein the tracking information includes two points and the transformation is a linear transformation.
Claim 13
Dependent Claim
20 words
The method of claim 8 , wherein the tracking information includes three points and the transformation is an affine transformation.
Claim 14
Dependent Claim
20 words
The method of claim 8 , wherein the tracking information includes four points and the transformation is a projective transformation.
Claim 15
Dependent Claim
104 words
The method of claim 3 , wherein the effect is insertion of a foreground object into a background in the sequence of images, wherein the tracking information defines movement of an object in the background, wherein the determining the one or more values for the parameters of the effect includes determining a transformation matrix defining a transform between an initial position of the object in the background in a first image in the sequence of images and a current position of the object in the background in the image; and wherein the performing the effect includes using the transformation matrix to perform the effect.
Claim 16
Dependent Claim
20 words
The method of claim 12 , wherein the tracking information includes two points and the transformation is a linear transformation.
Claim 17
Dependent Claim
20 words
The method of claim 12 , wherein the tracking information includes three points and the transformation is an affine transformation.
Claim 18
Dependent Claim
20 words
The method of claim 12 , wherein the tracking information includes four points and the transformation is a projective transformation.
Claim 19
Independent Claim
149 words
A method for applying an effect to a sequence of images, comprising: receiving tracking information indicating movement of an object from one image to another image in the sequence of images; receiving parameters for the effect specified by values associated with key frames in the sequence of images; for each image in the sequence of images that is not a key frame, interpolating one or more values that are associated with the key frames to obtain values specifying the parameters for the effect for the image; for each image in the sequence of images, combining the tracking information with the parameters for the effect for the image to obtain modified parameters for the effect for the image; and performing the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 20
Independent Claim
149 words
A method for applying an effect to a sequence of images, comprising: receiving tracking information indicating movement of an object from one image to another image in the sequence of images; receiving parameters for the effect specified by values associated with key frames in the sequence of images; for each image in the sequence of images that is not a key frame, interpolating one or more values that are associated with the key frames to obtain values specifying the parameters for the effect for the image; for each image in the sequence of images, combining the tracking information with the parameters for the effect for the image to obtain modified parameters for the effect for the image; and performing the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 21
Dependent Claim
105 words
The method of claim 16 , wherein the effect is insertion of a foreground object into a background in the sequence of images, wherein the tracking information defines movement of an object in the background, wherein the combining the tracking information with the parameters for the effect for the image includes determining a transformation matrix defining a transform between an initial position of the object in the background in a first image in the sequence of images and a current position of the object in the background in the image; and wherein the performing the effect includes using the transformation matrix to perform the effect.
Claim 22
Dependent Claim
20 words
The method of claim 17 , wherein the tracking information includes two points and the transformation is a linear transformation.
Claim 23
Dependent Claim
20 words
The method of claim 17 , wherein the tracking information includes three points and the transformation is an affine transformation.
Claim 24
Dependent Claim
20 words
The method of claim 17 , wherein the tracking information includes four points and the transformation is a projective transformation.
Claim 25
Dependent Claim
178 words
A computer program product, comprising: a computer readable medium computer program instructions stored on the computer readable medium that, when executed by a computer, instruct the computer to perform a method for applying an effect to a sequence of images, comprising: receiving tracking information indicating movement of an object from one image to another image in the sequence of images; receiving parameters for the effect specified by values associated with key frames in the sequence of images; for each image in the sequence of images that is not a key frame, interpolating one or more values that are associated with the key frames to obtain values specifying the parameters for the effect for the image; for each image in the sequence of images, combining the tracking information with the parameters for the effect for the image to obtain modified parameters for the effect for the image; and performing the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 26
Dependent Claim
178 words
A computer program product, comprising: a computer readable medium computer program instructions stored on the computer readable medium that, when executed by a computer, instruct the computer to perform a method for applying an effect to a sequence of images, comprising: receiving tracking information indicating movement of an object from one image to another image in the sequence of images; receiving parameters for the effect specified by values associated with key frames in the sequence of images; for each image in the sequence of images that is not a key frame, interpolating one or more values that are associated with the key frames to obtain values specifying the parameters for the effect for the image; for each image in the sequence of images, combining the tracking information with the parameters for the effect for the image to obtain modified parameters for the effect for the image; and performing the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 27
Dependent Claim
107 words
The computer program product of claim 21 , wherein the effect is insertion of a foreground object into a background in the sequence of images, wherein the tracking information defines movement of an object in the background, wherein the combining the tracking information with the parameters for the effect for the image includes determining a transformation matrix defining a transform between an initial position of the object in the background in a first image in the sequence of images and a current position of the object in the background in the image; and wherein the performing the effect includes using the transformation matrix to perform the effect.
Claim 28
Dependent Claim
22 words
The computer program product of claim 22 , wherein the tracking information includes two points and the transformation is a linear transformation.
Claim 29
Dependent Claim
22 words
The computer program product of claim 22 , wherein the tracking information includes three points and the transformation is an affine transformation.
Claim 30
Dependent Claim
22 words
The computer program product of claim 22 , wherein the tracking information includes four points and the transformation is a projective transformation.
Claim 31
Independent Claim
156 words
An apparatus for applying an effect to a sequence of images according to tracking information indicating movement of an object from one image to another image in the sequence of images and parameters for the effect specified by values associated with key frames in the sequence of images, comprising: means for obtaining, for each image in the sequence of images that is not a key frame, values specifying the parameters for the effect for the image by interpolating one or more values that are associated with the key frames; means for modifying, for each image in the sequence of images, the parameters for the effect for the image using the tracking information to obtain modified parameters for the effect for the image; and means for applying the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 32
Independent Claim
156 words
An apparatus for applying an effect to a sequence of images according to tracking information indicating movement of an object from one image to another image in the sequence of images and parameters for the effect specified by values associated with key frames in the sequence of images, comprising: means for obtaining, for each image in the sequence of images that is not a key frame, values specifying the parameters for the effect for the image by interpolating one or more values that are associated with the key frames; means for modifying, for each image in the sequence of images, the parameters for the effect for the image using the tracking information to obtain modified parameters for the effect for the image; and means for applying the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 33
Dependent Claim
113 words
The apparatus of claim 26 , wherein the effect is insertion of a foreground object into a background in the sequence of images, wherein the tracking information defines movement of an object in the background, wherein the means for modifying the parameters of the effect using the tracking information for an image includes means for determining a transformation matrix defining a transform between an initial position of the object in the background in a first image in the sequence of images and a current position of the object in the background in the image; and wherein the means for applying the effect includes means for using the transformation matrix to perform the effect.
Claim 34
Dependent Claim
20 words
The apparatus of claim 27 , wherein the tracking information includes two points and the transformation is a linear transformation.
Claim 35
Dependent Claim
20 words
The apparatus of claim 27 , wherein the tracking information includes three points and the transformation is an affine transformation.
Claim 36
Dependent Claim
20 words
The apparatus of claim 27 , wherein the tracking information includes four points and the transformation is a projective transformation.
Claim 37
Independent Claim
240 words
An apparatus for applying an effect to a sequence of images, comprising: a tracking engine having an input for receiving the sequence of images and an output providing tracking information indicating movement of an object from one image to another image in the sequence of images; an effects interface having an input through which a user specifies key frames in the sequence of images and values associated with each key frame, wherein the values specify parameters for the effect, and having an output providing an indication of the key frames and the values associated with each key frame; and a real time effects generator, having an input for receiving the indication of the key frames and the values associated with each key frame and an input for receiving the tracking information, and including: means for obtaining, for each image in the sequence of images that is not a key frame, values specifying the parameters for the effect for the image by interpolating one or more values that are associated with the key frames; means for modifying, for each image in the sequence of images, the parameters for the effect for the image using the tracking information to obtain modified parameters for the effect for the image; and means for applying the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 38
Independent Claim
240 words
An apparatus for applying an effect to a sequence of images, comprising: a tracking engine having an input for receiving the sequence of images and an output providing tracking information indicating movement of an object from one image to another image in the sequence of images; an effects interface having an input through which a user specifies key frames in the sequence of images and values associated with each key frame, wherein the values specify parameters for the effect, and having an output providing an indication of the key frames and the values associated with each key frame; and a real time effects generator, having an input for receiving the indication of the key frames and the values associated with each key frame and an input for receiving the tracking information, and including: means for obtaining, for each image in the sequence of images that is not a key frame, values specifying the parameters for the effect for the image by interpolating one or more values that are associated with the key frames; means for modifying, for each image in the sequence of images, the parameters for the effect for the image using the tracking information to obtain modified parameters for the effect for the image; and means for applying the effect on each image in the sequence of images for display of the sequence of images in real time using the modified parameters for the effect for the image.
Claim 39
Dependent Claim
113 words
The apparatus of claim 31 , wherein the effect is insertion of a foreground object into a background in the sequence of images, wherein the tracking information defines movement of an object in the background, wherein the means for modifying the parameters of the effect using the tracking information for an image includes means for determining a transformation matrix defining a transform between an initial position of the object in the background in a first image in the sequence of images and a current position of the object in the background in the image; and wherein the means for applying the effect includes means for using the transformation matrix to perform the effect.
Claim 40
Dependent Claim
20 words
The apparatus of claim 32 , wherein the tracking information includes two points and the transformation is a linear transformation.
Claim 41
Dependent Claim
20 words
The apparatus of claim 32 , wherein the tracking information includes three points and the transformation is an affine transformation.
Claim 42
Dependent Claim
20 words
The apparatus of claim 32 , wherein the tracking information includes four points and the transformation is a projective transformation.
References Cited (Backward Citations)
US5644364A
Cited
US5929836A
Cited
US6198873B1
Cited
US5786824A
Cited
CA2173805A1
Cited
US6084588A
Cited
GB2312126A
Cited
US6097853A
Cited
WO1998011512A1
Cited
US5828769A
Cited
US6061055A
Cited
US5845009A
Cited
US6239846B1
Cited
US6215485B1
Cited
US6164221A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-09-09 | 2006-03-11 | 2006-09-10 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-09-09 | 2010-03-11 | 2010-09-10 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-09-09 | 2014-03-11 | 2014-09-10 | $7700.00 | Window Closed / Lapsed |