Patent US3560385A successfully refreshed from Google Patents.
Patent US3750253A successfully refreshed from Google Patents.
Patent US5495576A successfully refreshed from Google Patents.
US5495576A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Panoramic image based virtual reality/telepresence audio-visual system and method
Assignee: Intellectual Ventures Holding 81 LLC
•
Filing: 1993-01-11
•
Granted: 1996-02-27
•
Expires: 2013-01-11
Abstract
Abstract An improved panoramic image based virtual reality/telepresence audio-visual system and method includes panoramic three-dimensional input devices, a computer processor, and a panoramic audio-visual output device. In one embodiment of the system the input devices comprise a sensor assembly including a plurality of positionable radar, camera, and acoustical sensors for recording signatures of all sides of three-dimensional subjects simultaneously. The computer processor integrates the sensor signals, processes signals as a virtual model, updates the model based on participant interaction, and selects and distributes portions of the processed virtual model for presentation on display units and audio speakers. The processor includes participant interactive input devices for instantaneous interaction with the virtual model. The panoramic audio-visual output device includes a head-mounted display or a closed structure having contiguous individual display units mounted in all viewable directions surrounding the participant. Conventional, stereoscopic, autostereoscopic, and holographic display systems are provided to view the panoramic three-dimensional image based model. Computer graphics, artificial intelligence, telecommunications, and vehicle control embodiments of the system are provided.
Inventors
- 👤 Kurtis J. Ritchey
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 23:21
CPC Classifications
G; G06; G06T; G06T17/00; H; H04; H04N; H04N13/00; H04N13/10; H04N13/194; H04N13/20; H04N13/204; H04N13/243; H04N13/275; H04N13/279; H04N13/296; H04N13/30; H04N13/332; H04N13/344; A; A63; A63F; A63F2300/00; A63F2300/10; A63F2300/1087; A63F2300/1093; A63F2300/60; A63F2300/66; A63F2300/6661; A63F2300/6676; A63F2300/69; G06T2207/00; G06T2207/10; G06T2207/10004; G06T2207/10012; H04N13/106; H04N13/15; H04N13/156; H04N13/161; H04N13/189; H04N13/239; H04N13/257; H04N13/286; H04N13/289; H04N13/302; H04N13/305; H04N13/324; H04N13/337; H04N13/361; H04N13/363; H04N13/366; H04N13/383; H04N19/00; H04N19/50; H04N19/597; H04N2013/0074; H04N2013/0088
Claims Analysis
Total Claims: 27
Claim 1
Independent Claim
210 words
A display system for virtual interaction with recorded images and comprising: (a) input means including: (1) a plurality of positionable sensor means of mutually angular relation to enable substantially continuous coverage by said sensor means of a three-dimensional subject; and (2) sensor recorder means communicating with said sensor means and operative to store and generate sensor signals representing said subject; (b) signal processing means communicating with said sensor means and said recorder means, receiving said sensor signals from said recorder means, and operable to texture map virtual images represented by said sensor signals onto a three-dimensional form; (c) a panoramic audio-visual display assembly means communicating with said signal processing means and enabling display to a viewer of the texture mapped virtual images; (d) viewer control means communicating with said signal processing means, including at least one interactive input device, and enabling interactive manipulation of said texture mapped virtual images by a viewer thereof operating said interactive input device; and (e) said signal processing means further including: (1) a host computer for manipulation of a computer generated world model; and (2) manipulation software associated with said host computer for assigning action to subjects in said computer generated world model based upon actions by another subject in said computer generated world model.
Claim 2
Dependent Claim
210 words
A display system for virtual interaction with recorded images and comprising: (a) input means including: (1) a plurality of positionable sensor means of mutually angular relation to enable substantially continuous coverage by said sensor means of a three-dimensional subject; and (2) sensor recorder means communicating with said sensor means and operative to store and generate sensor signals representing said subject; (b) signal processing means communicating with said sensor means and said recorder means, receiving said sensor signals from said recorder means, and operable to texture map virtual images represented by said sensor signals onto a three-dimensional form; (c) a panoramic audio-visual display assembly means communicating with said signal processing means and enabling display to a viewer of the texture mapped virtual images; (d) viewer control means communicating with said signal processing means, including at least one interactive input device, and enabling interactive manipulation of said texture mapped virtual images by a viewer thereof operating said interactive input device; and (e) said signal processing means further including: (1) a host computer for manipulation of a computer generated world model; and (2) manipulation software associated with said host computer for assigning action to subjects in said computer generated world model based upon actions by another subject in said computer generated world model.
Claim 3
Dependent Claim
35 words
A system according to claim 1 wherein: (a) the plurality of sensor means are positioned in an inwardly facing mutually angular relation to enable substantially continuous coverage by said sensor means of a given subject.
Claim 4
Dependent Claim
34 words
A system according to claim 1 wherein: (a) the plurality of sensor means are positioned on a housing means in outwardly facing, mutually angular relation to enable substantially spherical coverage by said sensor means.
Claim 5
Dependent Claim
83 words
A system according to claim 1 where said sensor means comprises: (a) a plurality of positionable objective lens means of mutually angular relation to enable substantially continuous coverage by said lens means of a given subject; (b) light sensitive means optically communicating with said lens means and receiving respective optical images therefrom and generating image signals representing said optical images; and (c) said sensor recorder means includes image recorder means communicating with said light sensitive means and operative to store said image signals.
Claim 6
Dependent Claim
60 words
A system according to claim 1 where said sensor means comprises: (a) a plurality of microphones positioned in mutually angular relation to enable continuous coverage by said microphones, said microphones providing audio signals representing sounds sensed thereby; and (b) said sensor recorder means includes audio recorder means communicating with said microphones and operative to store and replay said audio signals.
Claim 7
Dependent Claim
61 words
A system according to claim 1 wherein said sensor means includes: (a) a plurality of three-dimensional digitizing sensor means positioned in mutually angular relation to enable continuous coverage by said digitizer means; and (b) said sensor recorder means includes three-dimensional digitizer recording means communicating with said digitizing sensor means to store and replay signals representing a three-dimensional representation of said subject.
Claim 8
Dependent Claim
43 words
A system according to claim 1 wherein signal processing means includes: (a) interface apparatus for interfacing video and digital signals to a computer in a telecommunications system to allow a plurality of computer terminals to engage in teleconferencing via a digital data network.
Claim 9
Dependent Claim
35 words
A system according to claim 7 including a non-contact sensor array which includes: (a) a plurality of arrays oriented in an outwardly facing mutually angular relation to enable substantially spherical coverage of a three-dimensional subject.
Claim 10
Dependent Claim
36 words
A system according to claim 7 including a non-contact sensor array which includes: (a) a plurality of arrays oriented in an inwardly facing mutually angular relationship to enable substantially continuous coverage of a three dimensional subject.
Claim 11
Dependent Claim
80 words
A system according to claim 1 wherein: (a) said signal processing means includes: (1) said host computer including a pixel programmable display generator; and (2) a video display generator operatively connected to said display assembly means; and (b) said viewer control means including graphics input means operatively connected to said computer and operated by a viewer; said computer generating or altering images in response to said graphic input means; and said display assembly means displaying said generated or altered images.
Claim 12
Dependent Claim
28 words
A system according to claim 1 wherein signal processing means comprises: (a) a plurality of host computers which each process a segment of a panoramic subject for display.
Claim 13
Dependent Claim
80 words
A system according to claim 1 wherein: (a) said signal processing means includes stereoscopic processing means to generate two independent views taken from viewpoints a selected distance apart of a portion of said images mapped onto said three-dimensional form and communicate said views as stereoscopic video signals; and (b) said display assembly means includes a pair of display units of said assembly means operable to display said signals respectively on said display units as a stereoscopic image to said viewer.
Claim 14
Dependent Claim
27 words
A system according to claim 1 wherein said audio-visual display assembly means includes: (a) an autostereoscopic audio-visual display system in which the participant requires no eye glasses.
Claim 15
Dependent Claim
18 words
A system according to claim 1 wherein said audio-visual display assembly means includes: (a) a holographic display system.
Claim 16
Dependent Claim
21 words
A system according to claim 1 wherein the audio-visual display assembly means includes: (a) a plurality of flat panel display systems.
Claim 17
Dependent Claim
20 words
A system according to claim 1 wherein the audio-visual display assembly means includes: (a) a plurality of cathode ray tubes.
Claim 18
Dependent Claim
25 words
A system according to claim 1 wherein the audio-visual display assembly means includes: (a) a plurality of video projection display units and associated projection screens.
Claim 19
Dependent Claim
20 words
A system according to claim 1 wherein the panoramic audio-visual display assembly means includes: (a) a head mounted display assembly.
Claim 20
Dependent Claim
175 words
A system according to claim 1 wherein the panoramic audio-visual display assembly means comprises: (a) structural support means for securing a plurality of display units about a viewer, supporting a planar floor on which the viewer is situated, and supporting an entry and exit portion of said assembly means; (b) said plurality of display units being supported by said structural support means such that said display units face inward to the viewer, said display units being operable to display images; (c) said display units being arranged about a viewer such that a viewer views a respective portion of a composite image in substantially any viewable direction surrounding the viewer; (d) said planar floor being positioned close to a lower side of said assembly means, said planar floor being transparent and having display units positioned therebelow in such orientations as to enable viewing images displayed on such display units through said floor, and said planar floor supporting said viewer; and (e) said entry and exit portion of said assembly means being positioned laterally of said viewer.
Claim 21
Dependent Claim
118 words
A system according to claim 1 wherein said signal processing means includes image segment circuit means for partitioning an image output by said signal processing means and said audio-visual display assembly means comprises: (a) a head mounted display assembly receiving a processed video signal which has been processed by said processing means for display on said head mounted display assembly; and (b) a second audio-visual display assembly including a plurality of display units receiving respective processed video signals representing image segments of a composite image from said segment circuit means; and (c) each said assembly means being arranged such that a respective viewer views a respective portion of a scene of substantially spherical coverage in any viewable direction.
Claim 22
Dependent Claim
18 words
A system according to claim 1 wherein viewer control means includes: (a) a non-contact participant position sensor system.
Claim 23
Dependent Claim
19 words
A system according to claim 1 and including: (a) a video teleconferencing system interfaced to said signal processing means.
Claim 24
Dependent Claim
35 words
A system according to claim 1 wherein the system includes: (a) a conventional stereophonic radio transmitter which transmits a stereophonically modulated radio signal to a conventional stereophonic radio receiver having conventional stereophonic headphones connected thereto.
Claim 25
Dependent Claim
40 words
A system according to claim 1 and including: (a) view processing means for providing a plurality of independent views of a computer generated world model and transmitting said views as separate video signals to another device for processing or display.
Claim 26
Dependent Claim
17 words
A system according to claim 1 wherein the signal processing means includes: (a) a television production system.
Claim 27
Dependent Claim
31 words
A system according to claim 1 wherein the signal processing means includes: (a) a participant mechanical feedback device, actuated by participant actions and actions by subjects programmed into a virtual model.
References Cited (Backward Citations)
US4868682A
Cited
US4951040A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-02-26 | 1999-08-28 | 2000-02-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-02-26 | 2003-08-28 | 2004-02-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-02-26 | 2007-08-28 | 2008-02-27 | $7700.00 | Window Closed / Lapsed |