US5436638A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image display method and apparatus with means for yoking viewpoint orienting muscles of a user
Assignee: Fakespace Inc
•
Filing: 1993-12-17
•
Granted: 1995-07-25
•
Expires: 2013-12-17
Abstract
Abstract An image display method and system in which exertion of a user's viewpoint orienting muscle groups is yoked to sensors measuring displacement and/or force to provide feedback information for control of a virtual-world without requiring full physical-motion by the user. The yoked muscle exertion is mapped to the rate and direction of movement in the virtual-world. Preferably, force exerted by, and/or rotation or translation of, the yoking device in one direction in response to exertion of the muscle groups is mapped to virtual-motion in a corresponding direction in the virtual-world. Due to the fluidity of the human vertebral column, the invention effectively yokes rotational movement of a human's viewpoint orienting muscles to virtual movement in a virtual-world without the disadvantages of a head-mounted display. To orient toward an area-of-interest in a leftward portion of a virtual-world, the user simply and naturally activates muscles that would be used to orient left in the physical world. At the same time, the effect of virtual-motion as the displayed image viewpoint moves is compelling because while the muscles are contracting, special sensory information is sent to the brain to indicate that such movement should be occurring.
Inventors
- 👤 Mark Bolas
- 👤 Ian E. McDowall
- 👤 Russell Mead
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 17:07
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/016; G06F2203/00; G06F2203/01; G06F2203/015
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
269 words
A system for controlling display of an image in response to muscle exertion by a user having a vertebral column, a left limb, a right limb, and viewpoint orienting muscles, said system comprising: a non-head-mounted yoking means including a left member shaped and positioned for being gripped by the left limb during viewpoint orienting exertion of the viewpoint orienting muscles, and a right member shaped and positioned for being gripped by the right limb during viewpoint orienting exertion of the viewpoint orienting muscle, where the yoking means rotates about the vertebral column in response to said viewpoint orienting exertion of the viewpoint orienting muscles when the user's left limb grips the left member and the user's right limb grips the right member; a sensing means, operably associated with the yoking means, for sensing at least one of a force and a displacement in response to rotational movement of the yoking means about the vertebral column in response to said viewpoint orienting exertion of the viewpoint orienting muscles with the left limb gripping the left member and the right limb gripping the right member, and for generating at least one sensor output signal indicating of each said force and each said displacement; and a control means, operably associated with the sensing means, for receiving each said sensor output signal and generating image control commands in response thereto, wherein the image control commands correspond to at least one of said force and said displacement and provide a nonlinear mapping of the rotational movement of the yoking means to change of the image, wherein said change of the image represents viewpoint rotation.
Claim 2
Independent Claim
269 words
A system for controlling display of an image in response to muscle exertion by a user having a vertebral column, a left limb, a right limb, and viewpoint orienting muscles, said system comprising: a non-head-mounted yoking means including a left member shaped and positioned for being gripped by the left limb during viewpoint orienting exertion of the viewpoint orienting muscles, and a right member shaped and positioned for being gripped by the right limb during viewpoint orienting exertion of the viewpoint orienting muscle, where the yoking means rotates about the vertebral column in response to said viewpoint orienting exertion of the viewpoint orienting muscles when the user's left limb grips the left member and the user's right limb grips the right member; a sensing means, operably associated with the yoking means, for sensing at least one of a force and a displacement in response to rotational movement of the yoking means about the vertebral column in response to said viewpoint orienting exertion of the viewpoint orienting muscles with the left limb gripping the left member and the right limb gripping the right member, and for generating at least one sensor output signal indicating of each said force and each said displacement; and a control means, operably associated with the sensing means, for receiving each said sensor output signal and generating image control commands in response thereto, wherein the image control commands correspond to at least one of said force and said displacement and provide a nonlinear mapping of the rotational movement of the yoking means to change of the image, wherein said change of the image represents viewpoint rotation.
Claim 3
Dependent Claim
42 words
The system of claim 1, wherein the image control commands provide a nonlinear mapping of the rotational movement of the yoking means to at least one of a direction of movement of said image and a rate of movement of said image.
Claim 4
Dependent Claim
21 words
The system of claim 1, also including a display means for displaying the image in response to the image control commands.
Claim 5
Dependent Claim
91 words
The system of claim 3, wherein the yoking means includes: a base: and a frame rotatably mounted to the base and rigidly attached to the display means, so that the frame and the display means are free to rotate together as a unit, through a limited angular range relative to the base, in response to said viewpoint orienting exertion of the viewpoint orienting muscles with the left limb gripping the left member and the right limb gripping the right member, wherein the frame includes said left member and said right member.
Claim 6
Dependent Claim
74 words
The system of claim 3, wherein the yoking means includes: a frame mounted to the display means so that said frame has freedom to rotate, through a limited angular range relative to said display means, in response to said viewpoint orienting exertion of the viewpoint orienting muscles with the left limb gripping the left member and the right limb gripping the right member, wherein the frame includes said left member and said right member.
Claim 7
Dependent Claim
25 words
The system of claim 5, wherein the display means has a display screen having an outer periphery, and wherein the frame surrounds the outer periphery.
Claim 8
Independent Claim
161 words
A system for displaying an image, including: a display device having an axis of symmetry; frame means, mounted to the display device symmetrically with respect to the axis, having human interface portions positioned symmetrically with respect to the axis; sensor means for producing output signals, each of the output signals indicative of a force exerted on at least one of the human interface portions, said sensor means including at least one sensor mounted at an end of a limited range of motion of at least one of the frame means and the display device, wherein the sensor means produces first output signals in response to displacement of the frame means along the limited range of motion, and the sensor means produces second output signals in response to a force exerted on the frame means when said frame means is at the end of the limited range of motion; and a computer, coupled to the sensor means, which receives the output signals.
Claim 9
Independent Claim
161 words
A system for displaying an image, including: a display device having an axis of symmetry; frame means, mounted to the display device symmetrically with respect to the axis, having human interface portions positioned symmetrically with respect to the axis; sensor means for producing output signals, each of the output signals indicative of a force exerted on at least one of the human interface portions, said sensor means including at least one sensor mounted at an end of a limited range of motion of at least one of the frame means and the display device, wherein the sensor means produces first output signals in response to displacement of the frame means along the limited range of motion, and the sensor means produces second output signals in response to a force exerted on the frame means when said frame means is at the end of the limited range of motion; and a computer, coupled to the sensor means, which receives the output signals.
Claim 10
Dependent Claim
23 words
The system of claim 7 wherein the computer is programmed with software for mapping the output signals to motions in a virtual environment.
Claim 11
Dependent Claim
40 words
The system of claim 7, where the frame means is fixedly attached to the display device, and the frame means and the display device move together as a unit through the limited range of motion relative to the sensor means.
Claim 12
Dependent Claim
36 words
The system of claim 9, also including: a base supporting the sensor means, wherein the output signals are indicative of a force exerted on the base by one of the frame means and the display device.
Claim 13
Dependent Claim
39 words
The system of claim 10, wherein the output signals are also indicative of at least one of a linear displacement and a rotational displacement of said one of the frame means and the display device relative to the base.
Claim 14
Dependent Claim
42 words
The system of claim 9, wherein the human interface portions include a left handle dimensioned to be gripped by a left hand of a human user and a right handle dimensioned to be gripped by a right hand of the human user.
Claim 15
Dependent Claim
14 words
The system of claim 7, wherein the human interface portions frame the display device.
Claim 16
Independent Claim
172 words
A system for displacing an image, including: a disk, lay device having an axis of symmetry; frame means, mounted to the display device symmetrically with respect to the axis, having human interface portions positioned symmetrically with respect to the axis; sensor means for producing output signals, each of the output signals indicative of a force exerted on at least one of the human interface portions, said sensor means including at least one sensor mounted at an end of a limited range of motion of at least one of the frame means and the display device; and a computer, coupled to the sensor means, which receives the output signals, wherein the frame means is mounted with freedom to move relative to the display device and the sensor means through the limited range of motion, and each of the output signals is indicative of at least one of a linear displacement of the frame means, a rotational displacement of the frame means, and a force on at least one of the human interface portions.
Claim 17
Independent Claim
172 words
A system for displacing an image, including: a disk, lay device having an axis of symmetry; frame means, mounted to the display device symmetrically with respect to the axis, having human interface portions positioned symmetrically with respect to the axis; sensor means for producing output signals, each of the output signals indicative of a force exerted on at least one of the human interface portions, said sensor means including at least one sensor mounted at an end of a limited range of motion of at least one of the frame means and the display device; and a computer, coupled to the sensor means, which receives the output signals, wherein the frame means is mounted with freedom to move relative to the display device and the sensor means through the limited range of motion, and each of the output signals is indicative of at least one of a linear displacement of the frame means, a rotational displacement of the frame means, and a force on at least one of the human interface portions.
Claim 18
Dependent Claim
41 words
The system of claim 7, wherein the human interface portions include left end portion dimensioned for manipulation by a left hand of a human user and a right end portion dimensioned for manipulation by a right hand of the human user.
Claim 19
Dependent Claim
31 words
The system of claim 7, wherein the axis is aligned with a human user's vertebral column, when the human user engages the frame means symmetrically with respect to said vertebral column.
Claim 20
Dependent Claim
41 words
The system of claim 7, wherein said image represents a virtual environment, and wherein the computer is programmed with software for displaying the image on the display device and for modifying the image in response to changes in the output signals.
Claim 21
Dependent Claim
53 words
The system of claim 17, wherein the image has a virtual axis corresponding to the axis of symmetry of the display device, and wherein the software maps force exerted on at least one of the human interface portions to one of translation and rotation of the image with respect to the virtual axis.
Claim 22
Dependent Claim
42 words
The system of claim 18, wherein the software also maps one of translation and rotation of the frame means in a first direction to one of translation and rotation of the image in said first direction with respect to the virtual axis.
Claim 23
Independent Claim
210 words
A method for controlling display of an image in response to muscle exertion by a user, where the user has a vertebral column, a left limb, a right limb, and viewpoint orienting muscles, said method including the steps of: rotating a non-head-mounted yoking means in a first direction about the vertebral column in response to viewpoint orienting exertion of the viewpoint orienting muscles, wherein the yoking means includes a left member that is gripped by the left limb during said viewpoint orienting exertion of the viewpoint orienting muscles, and a right member that is gripping the right limb during said viewpoint orienting exertion of the viewpoint orienting muscles; sensing at least one of a force and a displacement in response to the rotational movement of the yoking means, and generating at least one sensor output signal indicative of each said force and each said displacement; and generating at least one image control command in response to said at least one sensor output signal, wherein each said image control command corresponds to at least one of said force and said displacement and provides a mapping of the rotational movement of the yoking means to change of the image, wherein said change of the image represents viewpoint rotation in said first direction.
Claim 24
Independent Claim
210 words
A method for controlling display of an image in response to muscle exertion by a user, where the user has a vertebral column, a left limb, a right limb, and viewpoint orienting muscles, said method including the steps of: rotating a non-head-mounted yoking means in a first direction about the vertebral column in response to viewpoint orienting exertion of the viewpoint orienting muscles, wherein the yoking means includes a left member that is gripped by the left limb during said viewpoint orienting exertion of the viewpoint orienting muscles, and a right member that is gripping the right limb during said viewpoint orienting exertion of the viewpoint orienting muscles; sensing at least one of a force and a displacement in response to the rotational movement of the yoking means, and generating at least one sensor output signal indicative of each said force and each said displacement; and generating at least one image control command in response to said at least one sensor output signal, wherein each said image control command corresponds to at least one of said force and said displacement and provides a mapping of the rotational movement of the yoking means to change of the image, wherein said change of the image represents viewpoint rotation in said first direction.
Claim 25
Dependent Claim
42 words
The method of claim 20, wherein the image control commands provide a nonlinear mapping of the rotational movement of the yoking means to at least one of a direction of movement of said image and a rate of movement of said image.
Claim 26
Dependent Claim
12 words
The method of claim 20, wherein the mapping is a nonlinear mapping.
Claim 27
Independent Claim
157 words
A method of operating an image display system, said system including a display device having an axis of symmetry, including the steps of: (a) exerting a force on at least one of two human interface portions of a yoke means, said yoke means being mounted to the display device symmetrically with respect to the axis of symmetry with the human interface portions positioned symmetrically with respect to the axis at an end of a limited range of motion of the yoke means; (b) in response to step (a), producing an output, signal indicative of the force; (c) supplying the output signal to a computer and processing said output signal in the computer; and (d) producing a second output signal in response to displacement of the yoke means along the limited range of motion, wherein the second output signal is indicative of at least one of a translational displacement and a rotational displacement of the human interface portions.
Claim 28
Independent Claim
157 words
A method of operating an image display system, said system including a display device having an axis of symmetry, including the steps of: (a) exerting a force on at least one of two human interface portions of a yoke means, said yoke means being mounted to the display device symmetrically with respect to the axis of symmetry with the human interface portions positioned symmetrically with respect to the axis at an end of a limited range of motion of the yoke means; (b) in response to step (a), producing an output, signal indicative of the force; (c) supplying the output signal to a computer and processing said output signal in the computer; and (d) producing a second output signal in response to displacement of the yoke means along the limited range of motion, wherein the second output signal is indicative of at least one of a translational displacement and a rotational displacement of the human interface portions.
Claim 29
Dependent Claim
85 words
The method of claim 23, wherein step (c) includes the step of generating an image control signal from the output signal, where the image control signal is indicative of a change image viewpoint, and also including the steps of: before completing step (c), displaying an image representing a virtual environment from a first viewpoint, on the display device; and after step (c), displaying on the display device a changed image representing the virtual environment form the changed viewpoint, in response to the image control signal.
References Cited (Backward Citations)
US3434342A
Cited
US4048653A
Cited
US4347508A
Cited
US4315240A
Cited
US4315241A
Cited
US4340878A
Cited
US4349815A
Cited
US4800897A
Cited
US4988981A
Cited
US4988981B1
Cited
US5097252A
Cited
US4820162A
Cited
US4895376A
Cited
US5035622A
Cited
US5184319A
Cited
US5317336A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-07-24 | 1999-01-23 | 1999-07-25 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-07-24 | 2003-01-23 | 2003-07-25 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-07-24 | 2007-01-23 | 2007-07-25 | $7700.00 | Window Closed / Lapsed |