Patent US6940538B2 successfully refreshed from Google Patents.
US6940538B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Extracting a depth map from known camera and model tracking data
Assignee: Sony Corp
•
Filing: 2001-08-29
•
Granted: 2005-09-06
•
Expires: 2021-08-29
Abstract
Abstract A method of extracting a depth map from known camera and tracking data. The method includes the steps of positioning a virtual camera at the coordinates of the tracked camera, setting the field of view to that of the tracked camera, positioning and orienting a synthetic tracked object to the coordinates of the tracked object, clearing the depth buffer and rendering the tracked object as a depth map.
Inventors
- 👤 Richter A. Rafey
- 👤 Peter Broadwell
- 👤 Sidney Wang
- 👤 Simon Gibbs
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:25
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/272; G; G06; G06T; G06T7/00; G06T7/50; H04N5/2224; H04N5/2226
Claims Analysis
Total Claims: 35
Claim 1
Independent Claim
120 words
A method for generating a depth map used to render objects comprising: establishing a virtual camera using camera data of a tracked camera which defines a viewpoint for a synthetic scene, wherein the camera data is generated by a live camera focused on at least part of a live scene corresponding to the synthetic scene; setting the field of view of the virtual camera to the field of view of the tracked camera; positioning a synthetic tracked object in the scene according to position information of a tracked object; embedding the synthetic tracked object into the live scene using depth information stored in the depth map; and extracting depth information of the positioned synthetic tracked object to generate depth map.
Claim 2
Independent Claim
120 words
A method for generating a depth map used to render objects comprising: establishing a virtual camera using camera data of a tracked camera which defines a viewpoint for a synthetic scene, wherein the camera data is generated by a live camera focused on at least part of a live scene corresponding to the synthetic scene; setting the field of view of the virtual camera to the field of view of the tracked camera; positioning a synthetic tracked object in the scene according to position information of a tracked object; embedding the synthetic tracked object into the live scene using depth information stored in the depth map; and extracting depth information of the positioned synthetic tracked object to generate depth map.
Claim 3
Dependent Claim
21 words
The method as set forth in claim 1 , wherein the synthetic scene comprises a three dimensional model of an environment.
Claim 4
Dependent Claim
20 words
The method as set forth in claim 1 , wherein extracting further comprises extracting depth information of the synthetic scene.
Claim 5
Dependent Claim
16 words
The method as set forth in claim 1 , wherein the environment comprises a race track.
Claim 6
Dependent Claim
22 words
The method as set forth in claim 1 , wherein establishing further comprises re-positioning the virtual camera as the tracked camera changes.
Claim 7
Dependent Claim
23 words
The method as set forth in claim 1 , further comprising animating the synthetic tracked object according to the position and orientation information.
Claim 8
Dependent Claim
28 words
The method as set forth in claim 1 , further comprising using image segmentation to align the depth map in accordance with real edges in the live scene.
Claim 9
Dependent Claim
49 words
The method as set forth in claim 1 , wherein camera data is recorded from a camera focused on at least part of a scene corresponding to the synthetic scene, the method further comprising combining the synthetic tracked object with video using depth information stored in the depth map.
Claim 10
Dependent Claim
37 words
The method as set forth in claim 1 , wherein the depth map is further refined by distorting grid coordinates of the depth map based upon characteristics of the tracked camera which defines the field of view.
Claim 11
Independent Claim
128 words
A system comprising: a tracked camera configured to define a viewpoint for a synthetic scene, wherein the tracked camera comprises a live camera and the camera data is generated by the tracked camera focused on at least part of a live scene corresponding to the synthetic scene; a virtual camera using camera data of the tracked camera, the field of view of the virtual camera set to the field of view of the tracked camera; a synthetic tracked object in the scene positioned according to position information of a tracked object, wherein depth information of the tracked object provides information to generate a depth man; and a rendering unit configured to embed the synthetic tracked object into the live scene using depth information stored in the depth map.
Claim 12
Independent Claim
128 words
A system comprising: a tracked camera configured to define a viewpoint for a synthetic scene, wherein the tracked camera comprises a live camera and the camera data is generated by the tracked camera focused on at least part of a live scene corresponding to the synthetic scene; a virtual camera using camera data of the tracked camera, the field of view of the virtual camera set to the field of view of the tracked camera; a synthetic tracked object in the scene positioned according to position information of a tracked object, wherein depth information of the tracked object provides information to generate a depth man; and a rendering unit configured to embed the synthetic tracked object into the live scene using depth information stored in the depth map.
Claim 13
Dependent Claim
21 words
The system as set forth in claim 10 , wherein the synthetic scene comprises a three dimensional model of an environment.
Claim 14
Dependent Claim
16 words
The system as set forth in claim 10 , wherein the environment comprises a race track.
Claim 15
Dependent Claim
24 words
The system as set forth in claim 10 , wherein depth information of the synthetic scene further provides information to generate the depth map.
Claim 16
Dependent Claim
20 words
The system as set forth in claim 10 , wherein the virtual camera is re-positioned to track camera data changes.
Claim 17
Dependent Claim
27 words
The system as set forth in claim 10 , further comprising an animation unit to animate the synthetic tracked object according to the position and orientation information.
Claim 18
Dependent Claim
34 words
The system as set forth in claim 10 , wherein the rendering unit is further configured to use image segmentation to define the depth map in accordance with real edges in the live scene.
Claim 19
Dependent Claim
33 words
The system as set forth in claim 16 , wherein the rendering unit distorts grid coordinates of the depth map based upon characteristics of the tracked camera which defines the field of view.
Claim 20
Dependent Claim
21 words
The system as set forth in claim 10 , wherein the synthetic scene comprises a three dimensional model of an environment.
Claim 21
Dependent Claim
24 words
The system as set forth in claim 10 , wherein depth information of the synthetic scene further provides information to generate the depth map.
Claim 22
Dependent Claim
20 words
The system as set forth in claim 10 , wherein the virtual camera is re-positioned to track camera data changes.
Claim 23
Independent Claim
144 words
A system for generating a depth map used to render synthetic objects comprising: a tracked camera configured to define a viewpoint for a synthetic scene, wherein the tracked camera comprises a live camera coupled to the processor and the camera data is generated by the tracked camera focused on at least part of a live scene corresponding to the synthetic scene; a processor configured to generate a virtual camera using camera data of the tracked camera, the field of view of the virtual camera set to the field of view of the tracked camera and a synthetic tracked object in the scene positioned according to position information of the tracked object, wherein the processor is further configured to embed the synthetic tracked object into the live scene using depth information stored in the depth map; and a depth map of the positioned tracked object.
Claim 24
Independent Claim
144 words
A system for generating a depth map used to render synthetic objects comprising: a tracked camera configured to define a viewpoint for a synthetic scene, wherein the tracked camera comprises a live camera coupled to the processor and the camera data is generated by the tracked camera focused on at least part of a live scene corresponding to the synthetic scene; a processor configured to generate a virtual camera using camera data of the tracked camera, the field of view of the virtual camera set to the field of view of the tracked camera and a synthetic tracked object in the scene positioned according to position information of the tracked object, wherein the processor is further configured to embed the synthetic tracked object into the live scene using depth information stored in the depth map; and a depth map of the positioned tracked object.
Claim 25
Dependent Claim
28 words
The system as set forth in claim 21 , wherein the processor is further configured to animate the tracked synthetic object according to the position and orientation information.
Claim 26
Dependent Claim
33 words
The system as set forth in claim 21 , wherein the processor is further configured to use image segmentation to define the depth map in accordance with real edges in the live scene.
Claim 27
Dependent Claim
36 words
The system as set forth in claim 23 , wherein the processor is further configured to distort grid coordinates of the depth map based upon characteristics of the tracked camera which defines the field of view.
Claim 28
Dependent Claim
135 words
A computer readable medium comprising instructions, which when executed by a processing system perform a method for generating a depth map used to render objects comprising: establishing a virtual camera using camera data of a tracked camera which defines a viewpoint for a synthetic scene, wherein the camera data is generated by a live camera focused on at least part of a live scene corresponding to the synthetic scene; setting the field of view of the virtual camera to the field of view of the tracked camera; positioning a synthetic tracked object in the scene according to position information of the tracked object; extracting depth information of the positioned synthetic tracked object to generate a depth map; and embedding the synthetic tracked object into the live scene using depth information stored in the depth map.
Claim 29
Dependent Claim
135 words
A computer readable medium comprising instructions, which when executed by a processing system perform a method for generating a depth map used to render objects comprising: establishing a virtual camera using camera data of a tracked camera which defines a viewpoint for a synthetic scene, wherein the camera data is generated by a live camera focused on at least part of a live scene corresponding to the synthetic scene; setting the field of view of the virtual camera to the field of view of the tracked camera; positioning a synthetic tracked object in the scene according to position information of the tracked object; extracting depth information of the positioned synthetic tracked object to generate a depth map; and embedding the synthetic tracked object into the live scene using depth information stored in the depth map.
Claim 30
Dependent Claim
23 words
The computer readable medium as set forth in claim 25 , wherein the synthetic scene comprises a three dimensional model of an environment.
Claim 31
Dependent Claim
24 words
The computer readable medium as set forth in claim 25 , wherein establishing further comprises re-positioning the virtual camera to track camera data changes.
Claim 32
Dependent Claim
26 words
The computer readable medium as set forth in claim 25 , wherein depth information of the synthetic scene is further used to generate the depth map.
Claim 33
Dependent Claim
25 words
The computer readable medium as set forth in claim 25 , further comprising animating the tracked synthetic object according to the position and orientation information.
Claim 34
Dependent Claim
30 words
The computer readable medium as set forth in claim 25 , further comprising using image segmentation to define the depth map in accordance with real edges in the live scene.
Claim 35
Dependent Claim
33 words
The computer readable medium as set forth in claim 25 , further comprising distorting grid coordinates of the depth map based upon characteristics of the tracked camera which defines the field of view.
References Cited (Backward Citations)
US6031545A
Cited
US5742521A
Cited
US5600368A
Cited
US5729471A
Cited
US5745126A
Cited
US6193610B1
Cited
US5860862A
Cited
US6080063A
Cited
US6072504A
Cited
US6741241B1
Cited
US6535226B1
Cited
US6445815B1
Cited
US6674461B1
Cited
US20010003715A1
Cited
US6466250B1
Cited
US20020069265A1
Cited
US20010023202A1
Cited
US6860806B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-09-05 | 2009-03-07 | 2009-09-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-09-05 | 2013-03-07 | 2013-09-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-09-05 | 2017-03-07 | 2017-09-06 | $7700.00 | Window Closed / Lapsed |