← Back to Patent Explorer
US5410644A Expired / Lapsed US ⏱️ 0.0 years remaining

3D video special effects system

Assignee: Avid Technology Inc
•
Filing: 1994-08-31
•
Granted: 1995-04-25
•
Expires: 2014-08-31
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Real-time video information is digitized and stored as a plurality of digital pixels in a memory. A 3D surface is then constructed from a flat source surface by breaking the surface into a plurality of flat polygonal patches and folding, rotating and manipulating the patches in three dimensions. The constructed object can then be manipulated as an object in three dimensions. During patch and object manipulation, the special effects system keeps track of the patch vertex locations. After the object has been created and located, real-time video is painted on the object surface by using the patch vertex locations to retrieve selected source pixels from the memory and to construct a value for each pixel on the object surface from the selected source pixels.

Inventors

  • 👤 Uri Thier
  • 👤 Gene Sarra
  • 👤 William Woodbury
  • 👤 James Norman

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-30 21:15
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4038; G06T19/00; G06T3/08; H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/2628

Claims Analysis

Total Claims: 15
Claim 1
Independent Claim 431 words
A video 3D special-effects system for manipulating a stream of source pixel values representing a digitized flat video source image to create an output display comprising a plurality of target pixels, each of which has a target location and value, that form a projection into a viewing plane of a desired three-dimensional object formed by a plurality of object polygons on each of which appears a segment of the source image contained in a different respective source polygon associated therewith such that each target point that is a projection into the image plane of a point in the object polygon thereby corresponds to a source point in the source polygon associated with that object polygon and each source polygon is associated with the polygon, denominated a target polygon, formed by the target points corresponding to the source points in that source polygon, the system comprising: A) means controlled by the user for specifying, for each of a plurality of the source polygons, a transform associated therewith for determining from the location of a target point in the associated target polygon the location of the corresponding source point in the associated source polygon and for specifying boundary coefficients that define the boundaries of the associated target polygon; B) means for generating a target-pixel-location signal that consecutively identifies each of the plurality of target pixels in the output display; C) a plurality of separate patch detectors, each of which is associated with a different one of the target polygons and thereby with the boundary coefficients specified therefor, each patch detector being responsive to reception of the target-pixel-location signal simultaneously with its reception by other patch detectors to determine simultaneously therewith whether the target pixel identified by the target-pixel-location signal is located in the target polygon defined by the boundary coefficients associated with that patch detector and to generate a presence signal indicative of the result of that determination; D) means responsive to the presence signals for selecting, in accordance with predetermined criteria, one said target polygon in which the given target pixel is located; E) means responsive to the target-pixel location signal and the polygon selection for employing the transform associated with the selected polygon to calculate the source location corresponding to the target pixel identified by the target-pixel location signal; and F) means for calculating a value, for each target pixel located in a target polygon, from at least one source value chosen in accordance with the source location calculated for that target pixel and for generating an output display signal representing an output display that comprises pixels having values thus calculated.
Claim 2
Dependent Claim 431 words
A video 3D special-effects system for manipulating a stream of source pixel values representing a digitized flat video source image to create an output display comprising a plurality of target pixels, each of which has a target location and value, that form a projection into a viewing plane of a desired three-dimensional object formed by a plurality of object polygons on each of which appears a segment of the source image contained in a different respective source polygon associated therewith such that each target point that is a projection into the image plane of a point in the object polygon thereby corresponds to a source point in the source polygon associated with that object polygon and each source polygon is associated with the polygon, denominated a target polygon, formed by the target points corresponding to the source points in that source polygon, the system comprising: A) means controlled by the user for specifying, for each of a plurality of the source polygons, a transform associated therewith for determining from the location of a target point in the associated target polygon the location of the corresponding source point in the associated source polygon and for specifying boundary coefficients that define the boundaries of the associated target polygon; B) means for generating a target-pixel-location signal that consecutively identifies each of the plurality of target pixels in the output display; C) a plurality of separate patch detectors, each of which is associated with a different one of the target polygons and thereby with the boundary coefficients specified therefor, each patch detector being responsive to reception of the target-pixel-location signal simultaneously with its reception by other patch detectors to determine simultaneously therewith whether the target pixel identified by the target-pixel-location signal is located in the target polygon defined by the boundary coefficients associated with that patch detector and to generate a presence signal indicative of the result of that determination; D) means responsive to the presence signals for selecting, in accordance with predetermined criteria, one said target polygon in which the given target pixel is located; E) means responsive to the target-pixel location signal and the polygon selection for employing the transform associated with the selected polygon to calculate the source location corresponding to the target pixel identified by the target-pixel location signal; and F) means for calculating a value, for each target pixel located in a target polygon, from at least one source value chosen in accordance with the source location calculated for that target pixel and for generating an output display signal representing an output display that comprises pixels having values thus calculated.
Claim 3
Dependent Claim 67 words
A video 3D special effects system according to claim 1 wherein said selecting means comprises means for assigning a priority code to each of said plurality of polygons and means responsive to said priority code and operative, when more than one of said presence signals identifies their respective target polygons as containing the target pixel identified by the target-pixel-location signal, for selecting one of said identified polygons.
Claim 4
Dependent Claim 48 words
A video 3D special effects system according to claim 1 wherein said means for calculating a value for each target pixel located in a target polygon generators said value for each such target pixel by filtering an interpolation of source pixel values in response to said source location.
Claim 5
Dependent Claim 480 words
A video 3D special-effects system for manipulating first analog video picture information representing a flat video source image to create an output display comprising a plurality of target pixels, each of which has a target location and value, that form a projection into a viewing plane of a desired three-dimensional object formed by a plurality of object polygons on each of which appears a segment of the source image contained in a different respective source polygon associated therewith such that each target point that is a projection into the image plane of a point in the object polygon thereby corresponds to a source point in the source polygon associated with that object polygon and each source polygon is associated with the polygon, denominated a target polygon, formed by the target points corresponding to the source points in that source polygon, the system comprising: A) an analog-to-digital converter responsive to said analog picture information for generating a stream of digital source pixel values; B) a memory responsive to said stream of digital source pixel values for temporarily storing said digital source pixel values; C) means controlled by the user for specifying, for each of a plurality of the source polygons, a transform associated therewith for determining from the location of a target point in the associated target polygon the location of the corresponding source point in the associated source polygon and for specifying boundary coefficients that define the boundaries of the associated target polygon; D) means for generating a target-pixel-location signal that consecutively identifies each of the plurality of target pixels in the output display; E) a plurality of separate patch detectors, each of which is associated with a different one of the target polygons and thereby with the boundary coefficients specified therefor, each patch detector being responsive to reception of the target-pixel-location signal simultaneously with its reception by other patch detectors to determine simultaneously therewith whether the target pixel identified by the target-pixel-location signal is located in the target polygon defined by the boundary coefficients associated with that patch detector and to generate a presence signal indicative of the result of that determination; F) means responsive to the presence signals for selecting, in accordance with predetermined criteria, one said target polygon in which the given target pixel is located; G) means responsive to the target-pixel location signal and the polygon selection for employing the transform associated with the selected polygon to calculate the source location corresponding to the target pixel identified by the target-pixel location signal; H) means responsive to the calculated source location for retrieving from the memory at least one source value; and I) means for calculating, for each target pixel located in a target polygon, a value calculated from that at least one source value retrieved from the memory and for generating an output display signal representing an output display that comprises pixels having values thus calculated.
Claim 6
Dependent Claim 480 words
A video 3D special-effects system for manipulating first analog video picture information representing a flat video source image to create an output display comprising a plurality of target pixels, each of which has a target location and value, that form a projection into a viewing plane of a desired three-dimensional object formed by a plurality of object polygons on each of which appears a segment of the source image contained in a different respective source polygon associated therewith such that each target point that is a projection into the image plane of a point in the object polygon thereby corresponds to a source point in the source polygon associated with that object polygon and each source polygon is associated with the polygon, denominated a target polygon, formed by the target points corresponding to the source points in that source polygon, the system comprising: A) an analog-to-digital converter responsive to said analog picture information for generating a stream of digital source pixel values; B) a memory responsive to said stream of digital source pixel values for temporarily storing said digital source pixel values; C) means controlled by the user for specifying, for each of a plurality of the source polygons, a transform associated therewith for determining from the location of a target point in the associated target polygon the location of the corresponding source point in the associated source polygon and for specifying boundary coefficients that define the boundaries of the associated target polygon; D) means for generating a target-pixel-location signal that consecutively identifies each of the plurality of target pixels in the output display; E) a plurality of separate patch detectors, each of which is associated with a different one of the target polygons and thereby with the boundary coefficients specified therefor, each patch detector being responsive to reception of the target-pixel-location signal simultaneously with its reception by other patch detectors to determine simultaneously therewith whether the target pixel identified by the target-pixel-location signal is located in the target polygon defined by the boundary coefficients associated with that patch detector and to generate a presence signal indicative of the result of that determination; F) means responsive to the presence signals for selecting, in accordance with predetermined criteria, one said target polygon in which the given target pixel is located; G) means responsive to the target-pixel location signal and the polygon selection for employing the transform associated with the selected polygon to calculate the source location corresponding to the target pixel identified by the target-pixel location signal; H) means responsive to the calculated source location for retrieving from the memory at least one source value; and I) means for calculating, for each target pixel located in a target polygon, a value calculated from that at least one source value retrieved from the memory and for generating an output display signal representing an output display that comprises pixels having values thus calculated.
Claim 7
Dependent Claim 67 words
A video 3D special effects system according to claim 4 wherein said selecting means comprises means for assigning a priority code to each of said plurality of polygons and means responsive to said priority code and operative, when more than one of said presence signals identifies their respective target polygons as containing the target pixel identified by the target-pixel-location signal, for selecting one of said identified polygons.
Claim 8
Dependent Claim 56 words
A video 3D special effects system according to claim 4 wherein said means for calculating a value for said each of said target pixels located in a target polygon calculates said value for each such target pixel by filtering and interpolation of source pixel values in response to said at least one retrieved source pixel value.
Claim 9
Dependent Claim 29 words
A video 3D special effects system according to claim 4 wherein said means for generating a target-pixel location signal comprises a scan line counter and a pixel position counter.
Claim 10
Dependent Claim 34 words
A video 3D special effects system according to claim 4 further comprising means responsive to said output display signal for generating an analog output video display representing an image of said desired three-dimensional shape.
Claim 11
Dependent Claim 47 words
A video 3D special effects system according to claim 4 further comprising means responsive to said first analog video picture information and to second analog video picture information for selectively applying said first analog video picture information and second analog video picture information to said analog-to-digital converter.
Claim 12
Independent Claim 384 words
A method for manipulating a stream of source pixel values representing a digitized flat video source image to create an output display comprising a plurality of target pixels, each of which has a target location and value, that form a projection into a viewing plane of a desired three-dimensional object formed by a plurality of object polygons on each of which appears a segment of the source image contained in a different respective source polygon associated therewith such that each target point that is a projection into the image plane of a point in the object polygon thereby corresponds to a source point in the source polygon associated with that object polygon and each source polygon is associated with the polygon, denominated a target polygon, formed by the target points corresponding to the source points in that source polygon, the method comprising: A) specifying, for each of a plurality of the source polygons, a transform associated therewith for determining from the location of a target point in the associated target polygon the location of the corresponding source point in the associated source polygon and for specifying boundary coefficients that define the boundaries of the associated target polygon; B) generating a target-pixel-location signal that consecutively identifies each of the plurality of target pixels in the output display; C) determining, separately and simultaneously for each of a plurality of target polygons, whether the target pixel identified by the target-pixel-location signal is located in the target polygon defined by the boundary coefficients associated with that target polygon and generating for each such target polygon a presence signal indicative of the results of that determination; D) selecting, in response to the presence signals and in accordance with predetermined criteria, one said target polygon in which the given target pixel is located; E) responding to the target-pixel location signal and the polygon selection by employing the transform associated with the selected polygon to calculate the source location corresponding to the target pixel identified by the target-pixel location signal; and F) calculating, for each target pixel located in a target polygon, a value calculated from at least one source value chosen in accordance with the source location calculated for that target pixel and for generating an output display signal representing an output display that comprises pixels having values thus calculated.
Claim 13
Independent Claim 384 words
A method for manipulating a stream of source pixel values representing a digitized flat video source image to create an output display comprising a plurality of target pixels, each of which has a target location and value, that form a projection into a viewing plane of a desired three-dimensional object formed by a plurality of object polygons on each of which appears a segment of the source image contained in a different respective source polygon associated therewith such that each target point that is a projection into the image plane of a point in the object polygon thereby corresponds to a source point in the source polygon associated with that object polygon and each source polygon is associated with the polygon, denominated a target polygon, formed by the target points corresponding to the source points in that source polygon, the method comprising: A) specifying, for each of a plurality of the source polygons, a transform associated therewith for determining from the location of a target point in the associated target polygon the location of the corresponding source point in the associated source polygon and for specifying boundary coefficients that define the boundaries of the associated target polygon; B) generating a target-pixel-location signal that consecutively identifies each of the plurality of target pixels in the output display; C) determining, separately and simultaneously for each of a plurality of target polygons, whether the target pixel identified by the target-pixel-location signal is located in the target polygon defined by the boundary coefficients associated with that target polygon and generating for each such target polygon a presence signal indicative of the results of that determination; D) selecting, in response to the presence signals and in accordance with predetermined criteria, one said target polygon in which the given target pixel is located; E) responding to the target-pixel location signal and the polygon selection by employing the transform associated with the selected polygon to calculate the source location corresponding to the target pixel identified by the target-pixel location signal; and F) calculating, for each target pixel located in a target polygon, a value calculated from at least one source value chosen in accordance with the source location calculated for that target pixel and for generating an output display signal representing an output display that comprises pixels having values thus calculated.
Claim 14
Dependent Claim 81 words
A method for manipulating a stream of source video pixel values according to claim 10 wherein step B comprises the steps of: B1. sequentially selecting each target pixel from left to right on a particular video scan line; B2. sequentially selecting each target pixel from left to right on a subsequent video scan line after all pixels on a scan line have been selected in step B1; and B3. repeating steps B1 and B2 until all target pixels have been selected.
Claim 15
Dependent Claim 71 words
A method for manipulating a stream of source video pixels according to claim 10 wherein step D further comprises the steps of: D1. assigning a priority code to each of said plurality of target polygons; and D2. using an assigned priority code to select a single target polygon when more than one of said presence signals identifies their respective target polygons as containing the target pixel identified by the target-pixel-location signal.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1998-04-24 1998-10-24 1999-04-25 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2002-04-24 2002-10-24 2003-04-25 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2006-04-24 2006-10-24 2007-04-25 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag