Patent US6014163A successfully refreshed from Google Patents.
US6014163A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Multi-camera virtual set system employing still store frame buffers for each camera
Assignee: RT-SET REAL TIME SYNTHESIZED ENTERTAINMENT TECHNOLOGY Ltd
•
Filing: 1997-06-09
•
Granted: 2000-01-11
•
Expires: 2017-06-09
Abstract
Abstract A method and apparatus for producing data in a virtual set memory representing a composite image. The composite image data is produced from a combination of data representing a virtual image and data representing a camera field of view image. The invention includes a plurality of cameras, each disposed for developing data representing a respective field of view and each having a still store frame buffer associated therewith for receiving and storing data representing virtual images. The still store frame buffers are configured for subsequent selective retrieval. The invention also includes a virtual image data source for generating data representing virtual images and for supplying such data to the still store frame buffers associated with each of the plurality of cameras. Finally, the invention includes at least one compositor for compositing data representing the field of view of a selected one of the plurality of cameras and data representing a virtual image retrieved from a still store frame buffer associated with the selected one of the plurality of cameras. The compositor produces data in the virtual set memory.
Inventors
- 👤 James H. Houskeeper
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 16:37
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/222; H04N13/00; H04N13/10; H04N13/106; H04N13/156; H04N13/20; H04N13/204; H04N13/239; H04N13/275; H04N13/296; H04N5/2224; H04N5/262; H04N5/272; H04N13/246; H04N13/286
Claims Analysis
Total Claims: 21
Claim 1
Independent Claim
175 words
Apparatus for producing data in a virtual set memory representing a composite image from a combination of a virtual image and a camera field of view image, the apparatus comprising: a plurality of cameras, each disposed for capturing data representing a respective field of view and each having a frame buffer associated therewith for receiving and storing data representing virtual images, for subsequent selective retrieval; a virtual image data source for generating data representing virtual images and for supplying such data to the frame buffer associated with a broadcast camera configured for moving spatially, wherein the last image drawn by the image generator is stored in the frame buffer when the broadcast camera stops moving and then virtual image is supplied to another single movable camera; and a means for compositing data representing the field of view of a selected one of the plurality of cameras and data representing a virtual image retrieved from a frame buffer associated with the selected one of the plurality of cameras, to produce data in the virtual set memory.
Claim 2
Dependent Claim
175 words
Apparatus for producing data in a virtual set memory representing a composite image from a combination of a virtual image and a camera field of view image, the apparatus comprising: a plurality of cameras, each disposed for capturing data representing a respective field of view and each having a frame buffer associated therewith for receiving and storing data representing virtual images, for subsequent selective retrieval; a virtual image data source for generating data representing virtual images and for supplying such data to the frame buffer associated with a broadcast camera configured for moving spatially, wherein the last image drawn by the image generator is stored in the frame buffer when the broadcast camera stops moving and then virtual image is supplied to another single movable camera; and a means for compositing data representing the field of view of a selected one of the plurality of cameras and data representing a virtual image retrieved from a frame buffer associated with the selected one of the plurality of cameras, to produce data in the virtual set memory.
Claim 3
Dependent Claim
72 words
Apparatus as in claim 1 wherein said plurality of cameras further comprise a camera tracker electrically coupled between each of the plurality of cameras and the virtual image data source, wherein the camera tracker provides, to the virtual image data source, data on camera position and movement, including pan, tilt, zoom, and focus, thereby enabling the virtual image data source to consider camera position data when generating the data representing virtual images.
Claim 4
Dependent Claim
58 words
Apparatus as in claim 1 wherein said plurality of cameras further comprise a video delay electrically coupled between each of the plurality of cameras and the means for compositing data, wherein the data representing the field of view of the selected one of the plurality cameras is appropriately delayed for compositing with the data representing a virtual image.
Claim 5
Dependent Claim
30 words
Apparatus as in claim 1 wherein the data representing a virtual image comprises data for a three-dimensional graphic having a foreground and a background, and data for a matte channel.
Claim 6
Dependent Claim
42 words
Apparatus as in claim 1 wherein said virtual image data source comprises at least one image generator for generating three-dimensional image data to be stored in the frame buffers, the at least one image generator sharing resources with the plurality of cameras.
Claim 7
Dependent Claim
27 words
Apparatus as in claim 1 wherein said virtual image data source comprises an external video camera for producing video images to generate the data representing virtual images.
Claim 8
Dependent Claim
13 words
Apparatus as in claim 6 wherein the external video camera produces live video.
Claim 9
Dependent Claim
93 words
Apparatus as in claim 1 wherein the means for compositing comprises at least one compositor electrically coupled to each of the frame buffers and to each of the video delays of each of the cameras, the at least one compositor for layering the data representing the field of view of the selected one of the plurality of cameras and the data representing the virtual image from one of the frame buffers associated with one of the plurality of cameras, wherein data representing a single composite image is stored in the virtual set memory.
Claim 10
Dependent Claim
40 words
Apparatus as in claim 8 wherein the at least one compositor comprises a compositor electrically coupled to each of the frame buffers associated with each of the plurality of cameras and wherein said each compositor is tuned to each camera.
Claim 11
Dependent Claim
27 words
Apparatus as in claim 1 wherein the virtual set memory comprises data representing a composite image including a virtual image and a camera field of view image.
Claim 12
Independent Claim
181 words
A method for producing data in a virtual set memory representing a composite image from a combination of a virtual image and a camera field of view image, the method comprising the steps of: (a) providing a plurality of cameras, each having a field of view and each having a frame buffer associated therewith; (b) providing a virtual image data source for generating data representing a virtual image; (c) storing the data representing the virtual image in the frame buffers associated with one broadcast camera while said camera is moving, wherein the last image drawn by the image generator is stored in the frame buffer when the broadcast camera stops moving and the virtual image is supplied to another single moving camera; (d) selectively retrieving the data representing the virtual image from one of the frame buffers of one of the plurality of cameras; and (e) compositing data representing a field of view of one of said plurality of cameras and the data representing the virtual image of one of the frame buffers to produce data in the virtual set memory.
Claim 13
Independent Claim
181 words
A method for producing data in a virtual set memory representing a composite image from a combination of a virtual image and a camera field of view image, the method comprising the steps of: (a) providing a plurality of cameras, each having a field of view and each having a frame buffer associated therewith; (b) providing a virtual image data source for generating data representing a virtual image; (c) storing the data representing the virtual image in the frame buffers associated with one broadcast camera while said camera is moving, wherein the last image drawn by the image generator is stored in the frame buffer when the broadcast camera stops moving and the virtual image is supplied to another single moving camera; (d) selectively retrieving the data representing the virtual image from one of the frame buffers of one of the plurality of cameras; and (e) compositing data representing a field of view of one of said plurality of cameras and the data representing the virtual image of one of the frame buffers to produce data in the virtual set memory.
Claim 14
Dependent Claim
26 words
The method of claim 11 wherein step (a) further comprises providing a camera tracker and a video delay associated with each of the plurality of cameras.
Claim 15
Dependent Claim
24 words
The method of claim 11 wherein step (b) comprises providing an image generator for generating a three-dimensional image having a foreground and a background.
Claim 16
Dependent Claim
19 words
The method of claim 13 wherein step (b) further comprises providing an image generator for generating a matte channel.
Claim 17
Dependent Claim
24 words
The method of claim 11 wherein step (b) comprises providing an external video signal including live video in three-dimensional data sets rendered by processors.
Claim 18
Dependent Claim
23 words
The method of claim 11 wherein step (e) comprises providing a virtual set image based on the data in the virtual set memory.
Claim 19
Dependent Claim
46 words
The apparatus of claim 1 wherein the virtual image data source is a plurality of virtual image data sources wherein each of said data sources is combined with the frame buffer and provides virtual images directly to the frame buffer when the camera is not moving.
Claim 20
Independent Claim
156 words
A method for producing data in a virtual set memory representing a composite image from a combination of a virtual image and a camera field of view image, the method comprising the step of: (a) providing a plurality of cameras, each having a field of view and each having a frame buffer associated therewith; (b) providing a virtual image data source in each frame buffer for rendering data representing a virtual image; (c) rendering and storing the data representing the virtual image in each of the frame buffers associated with each camera when a camera is not moving; (d) selectively retrieving the data representing the virtual image from one of the frame buffers of one of the plurality of cameras; and (e) compositing data representing a field of view of one of said plurality of cameras and the data representing the virtual image in the corresponding frame buffer to produce data in the virtual set memory.
Claim 21
Independent Claim
156 words
A method for producing data in a virtual set memory representing a composite image from a combination of a virtual image and a camera field of view image, the method comprising the step of: (a) providing a plurality of cameras, each having a field of view and each having a frame buffer associated therewith; (b) providing a virtual image data source in each frame buffer for rendering data representing a virtual image; (c) rendering and storing the data representing the virtual image in each of the frame buffers associated with each camera when a camera is not moving; (d) selectively retrieving the data representing the virtual image from one of the frame buffers of one of the plurality of cameras; and (e) compositing data representing a field of view of one of said plurality of cameras and the data representing the virtual image in the corresponding frame buffer to produce data in the virtual set memory.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-01-10 | 2003-07-12 | 2004-01-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-01-10 | 2007-07-12 | 2008-01-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-01-10 | 2011-07-12 | 2012-01-11 | $7700.00 | Window Closed / Lapsed |