Patent US6148100A successfully refreshed from Google Patents.
← Back to Patent Explorer
US6148100A Expired / Lapsed US ⏱️ 0.0 years remaining

3-dimensional telepresence system for a robotic environment

Assignee: Battelle Energy Alliance LLC
•
Filing: 1997-12-22
•
Granted: 2000-11-14
•
Expires: 2017-12-22
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A telepresence system includes a camera pair remotely controlled by a control module affixed to an operator. The camera pair provides for three dimensional viewing and the control module, affixed to the operator, affords hands-free operation of the camera pair. In one embodiment, the control module is affixed to the head of the operator and an initial position is established. A triangulating device is provided to track the head movement of the operator relative to the initial position. A processor module receives input from the triangulating device to determine where the operator has moved relative to the initial position and moves the camera pair in response thereto. The movement of the camera pair is predetermined by a software map having a plurality of operation zones. Each zone therein corresponds to unique camera movement parameters such as speed of movement. Speed parameters include constant speed, or increasing or decreasing. Other parameters include pan, tilt, slide, raise or lowering of the cameras. Other user interface devices are provided to improve the three dimensional control capabilities of an operator in a local operating environment. Such other devices include a pair of visual display glasses, a microphone and a remote actuator. The pair of visual display glasses are provided to facilitate three dimensional viewing, hence depth perception. The microphone affords hands-free camera movement by utilizing voice commands. The actuator allows the operator to remotely control various robotic mechanisms in the remote operating environment.

Inventors

  • 👤 Matthew O. Anderson
  • 👤 Mark D. McKay

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 14:24
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/011; G06F3/012; G02; G02B; G02B27/00; G02B27/0093; G02B30/00; G02B30/20; G02B30/22; G02B30/24; H; H04; H04N; H04N13/00; H04N13/20; H04N13/204; H04N13/239; H04N13/246; H04N13/296; H04N13/30; H04N13/327; H04N13/332; H04N13/344; H04N13/366; H04N13/373; H04N13/376; H04N13/38; H04N13/398; H04N13/10; H04N13/189; H04N13/194

Claims Analysis

Total Claims: 33
Claim 1
Independent Claim 141 words
A telepresence system for assisting in assimilating an operator in a local operating environment into a remote operating environment, the system comprising: (a) a camera assembly comprising a pair of adjacently disposed cameras to obtain a visual image in three dimensions; (b) means for orienting the camera assembly; (c) a visual display unit configured to receive and display the visual image from the camera assembly; (d) means for enabling the operator to view the visual image on the visual display unit in three dimensions; (e) a control module configured for attachment to the operator; (f) a triangulating device configured to receive signals from the control module; and (g) a processor module configured to receive signals from the sensing unit and transmit signals to the means for orienting the camera such that the camera is oriented in response to the operators movement.
Claim 2
Dependent Claim 141 words
A telepresence system for assisting in assimilating an operator in a local operating environment into a remote operating environment, the system comprising: (a) a camera assembly comprising a pair of adjacently disposed cameras to obtain a visual image in three dimensions; (b) means for orienting the camera assembly; (c) a visual display unit configured to receive and display the visual image from the camera assembly; (d) means for enabling the operator to view the visual image on the visual display unit in three dimensions; (e) a control module configured for attachment to the operator; (f) a triangulating device configured to receive signals from the control module; and (g) a processor module configured to receive signals from the sensing unit and transmit signals to the means for orienting the camera such that the camera is oriented in response to the operators movement.
Claim 3
Dependent Claim 21 words
A telepresence system according to claim 1, wherein the means for orienting the camera assembly comprises a pan and tilt device.
Claim 4
Dependent Claim 19 words
A telepresence system according to claim 1, wherein the means for orienting the camera assembly comprises a sliding track.
Claim 5
Dependent Claim 34 words
A telepresence system according to claim 1, wherein the means for enabling the operator to view the visual image on the visual display unit in three dimensions comprises a pair of visual display glasses.
Claim 6
Dependent Claim 28 words
A telepresence system according to claim 4, wherein the visual display glasses have a right and left lens thereof and the visual image is cycled between the lenses.
Claim 7
Dependent Claim 16 words
A telepresence system according to claim 1, wherein the triangulating device comprises a plurality of microphones.
Claim 8
Dependent Claim 39 words
A telepresence system according to claim 1, further comprising: (a) a robotic mechanism configured for operation in the remote operating environment; and (b) an actuator configured to enable the user viewing the visual display to control the robotic mechanism.
Claim 9
Dependent Claim 19 words
A telepresence system according to claim 1, further comprising a pair of stereo microphones mounted to the camera assembly.
Claim 10
Dependent Claim 29 words
A telepresence system according to claim 1, further comprising: (a) a plurality of camera pairs; and (b) means for switching between activation of the camera paris by voice command.
Claim 11
Dependent Claim 231 words
A telepresence system for assisting in assimilating an operator in a local operating environment into a remote operating environment, the system comprising: (a) a camera assembly configured to obtain a visual image in the remote operating environment; (b) means for orienting the camera assembly using a select combination of movement parameters, the movement parameters including speed of camera movement and type of camera movement; (c) a visual display unit configured to receive and display an interpretation of the visual image from the camera assembly; (d) means for enabling tracking of the relative movement of the operator as the operator views the visual display; and (e) a processor being configured to: (i) initialize an initial position of the operator based on inputs received by the processor from the means for enabling tracking; (ii) establish a map including a plurality of operation zones, the zones corresponding to regions in which the operator can move, the zones being positioned relative to the initial position of the operator; (iii) receive inputs from the means for enabling tracking to ascertain the coordinates and corresponding zone of the operator as the operator moves while viewing the visual display; and (iv) transmit signals to the means for orienting the camera, the signals defining the select combination of movement parameters for the camera, the select combination of movement parameters being unique for each of the plurality of operation zones.
Claim 12
Dependent Claim 231 words
A telepresence system for assisting in assimilating an operator in a local operating environment into a remote operating environment, the system comprising: (a) a camera assembly configured to obtain a visual image in the remote operating environment; (b) means for orienting the camera assembly using a select combination of movement parameters, the movement parameters including speed of camera movement and type of camera movement; (c) a visual display unit configured to receive and display an interpretation of the visual image from the camera assembly; (d) means for enabling tracking of the relative movement of the operator as the operator views the visual display; and (e) a processor being configured to: (i) initialize an initial position of the operator based on inputs received by the processor from the means for enabling tracking; (ii) establish a map including a plurality of operation zones, the zones corresponding to regions in which the operator can move, the zones being positioned relative to the initial position of the operator; (iii) receive inputs from the means for enabling tracking to ascertain the coordinates and corresponding zone of the operator as the operator moves while viewing the visual display; and (iv) transmit signals to the means for orienting the camera, the signals defining the select combination of movement parameters for the camera, the select combination of movement parameters being unique for each of the plurality of operation zones.
Claim 13
Dependent Claim 18 words
A telepresence system according to claim 10, wherein the camera assembly comparises a pair of adjacently disposed cameras.
Claim 14
Dependent Claim 21 words
A telepresence system according to claim 10, wherein the means for orienting the camera assembly comprises a pan and tilt device.
Claim 15
Dependent Claim 27 words
A telepresence system according to claim 10, further comprising means for enabling the operator to view the visual image on the visual display unit in three dimensions.
Claim 16
Dependent Claim 40 words
A telepresence system according to claim 10, wherein the means for enabling tracking comprises: (a) a control module configured for attachment to the head of the operator; and (b) a triangulating device configured to receive signals from the control module.
Claim 17
Dependent Claim 39 words
A telepresence system according to claim 10, further comprising: (a) a robotic mechanism configured for operation in the remote operating environment; and (b) an actuator configured to enable the user viewing the visual display to control the robotic mechanism.
Claim 18
Dependent Claim 36 words
A telepresence system according to claim 10, wherein the plurality of operation zones comprises a first zone wherein the camera assembly remains stationary during movement of the operator in the region corresponding to the first zone.
Claim 19
Dependent Claim 42 words
A telepresence system according to claim 10, wherein the plurality of operation zones comprises a second zone wherein the camera assembly can pan and tilt at a first predetermined speed when the operated is in the region corresponding to the second zone.
Claim 20
Dependent Claim 48 words
A telepresence system according to claim 17, wherein the plurality of operation zones comprises a third zone wherein the camera assembly can pan and tilt at a second predetermined speed faster than the first predetermined speed when the operated is in the region corresponding to the third zone.
Claim 21
Dependent Claim 257 words
A telepresence system for assisting in assimilating an operator in a local operating environment into a remote operating environment, the system comprising: (a) a camera pair configured to obtain a visual image in the remote operating environment; (b) a pan and tilt device mounted to the camera pair; (c) a sliding track having the camera mounted thereto, the sliding track being configured to move the camera pair along the length thereof; (d) a visual display unit configured to receive and display the visual image from the camera pair; (e) a control module configured for attachment to the operator; (f) a triangulating device configured to receive signals from the control module; (g) a processor being configured to: (i) initialize an initial position of the operator based on inputs received by the processor from the triangulating device; (ii) establish a map including a plurality of different zones, the zones corresponding to regions in which the operator can move, the zones including a first zone, a second zone, and a third zone, the zones being positioned relative to the initial position of the operator; (iii) receive inputs from the triangulating device to ascertain the coordinates and corresponding zones of the operator as the operator moves while viewing the visual display unit; (iv) transmit signals to the pan and tilt device for moving the camera along a path at a predetermined speed when the operator is in the second zone; and (v) transmit signals to the sliding track for moving the camera therealong when the operator is in the third zone.
Claim 22
Dependent Claim 257 words
A telepresence system for assisting in assimilating an operator in a local operating environment into a remote operating environment, the system comprising: (a) a camera pair configured to obtain a visual image in the remote operating environment; (b) a pan and tilt device mounted to the camera pair; (c) a sliding track having the camera mounted thereto, the sliding track being configured to move the camera pair along the length thereof; (d) a visual display unit configured to receive and display the visual image from the camera pair; (e) a control module configured for attachment to the operator; (f) a triangulating device configured to receive signals from the control module; (g) a processor being configured to: (i) initialize an initial position of the operator based on inputs received by the processor from the triangulating device; (ii) establish a map including a plurality of different zones, the zones corresponding to regions in which the operator can move, the zones including a first zone, a second zone, and a third zone, the zones being positioned relative to the initial position of the operator; (iii) receive inputs from the triangulating device to ascertain the coordinates and corresponding zones of the operator as the operator moves while viewing the visual display unit; (iv) transmit signals to the pan and tilt device for moving the camera along a path at a predetermined speed when the operator is in the second zone; and (v) transmit signals to the sliding track for moving the camera therealong when the operator is in the third zone.
Claim 23
Dependent Claim 27 words
A telepresence system according to claim 19, further comprising means for enabling the operator to view the visual image on the visual display unit in three dimensions.
Claim 24
Dependent Claim 39 words
A telepresence system according to claim 19, further comprising: (a) a robotic mechanism configured for operation in the remote operating environment; and (b) an actuator configured to enable the user viewing the visual display to control the robotic mechanism.
Claim 25
Dependent Claim 29 words
A telepresence system according to claim 19, further comprising: (a) a plurality of camera pairs; and (b) means for switching between activation of the camera paris by voice command.
Claim 26
Dependent Claim 26 words
A telepresence system according to claim 19, wherein the camera pair remains stationary during movement of the operator in the region corresponding to the first zone.
Claim 27
Independent Claim 222 words
A method for operating a processor as part of a telepresence system, the telepresence system further including a camera assembly configured to obtain a visual image, the camera being movable by a means for orienting the camera under a select combination of movement parameters, the movement parameters including speed of camera movement and type of camera movement, a visual display unit configured to receive and display the visual image from the camera, a control module configured for attachment to the operator, and a triangulating device configured to receive signals from the control module, the method comprising the steps of: (a) initializing a coordinate system based on an initial position of the operator, the initial position being based on inputs received from the triangulating device; (b) establishing a map including a plurality of different zones, the zones corresponding to regions in which the operator can move, the zones being positioned relative to the initial position of the operator; (c) receiving inputs from the triangulating device to ascertain the coordinates and corresponding zone of the operator as the operator moves while viewing the visual display unit; and (d) transmitting signals to the means for orienting the camera, the signals defining the select combination of movement parameters for the camera, the select combination of movement parameters being unique for each of the plurality of zones.
Claim 28
Independent Claim 222 words
A method for operating a processor as part of a telepresence system, the telepresence system further including a camera assembly configured to obtain a visual image, the camera being movable by a means for orienting the camera under a select combination of movement parameters, the movement parameters including speed of camera movement and type of camera movement, a visual display unit configured to receive and display the visual image from the camera, a control module configured for attachment to the operator, and a triangulating device configured to receive signals from the control module, the method comprising the steps of: (a) initializing a coordinate system based on an initial position of the operator, the initial position being based on inputs received from the triangulating device; (b) establishing a map including a plurality of different zones, the zones corresponding to regions in which the operator can move, the zones being positioned relative to the initial position of the operator; (c) receiving inputs from the triangulating device to ascertain the coordinates and corresponding zone of the operator as the operator moves while viewing the visual display unit; and (d) transmitting signals to the means for orienting the camera, the signals defining the select combination of movement parameters for the camera, the select combination of movement parameters being unique for each of the plurality of zones.
Claim 29
Dependent Claim 20 words
A method according to claim 24, further comprising the step of receiving voice command inputs to alter various system parameters.
Claim 30
Dependent Claim 29 words
A method according to claim 24, further comprising the step of receiving inputs from an actuator device for controlling movement of a robotic mechanism in a remote operating environment.
Claim 31
Dependent Claim 33 words
A method according to claim 24, wherein the step of transmitting signals to the means for orienting the camera comprises the step of transmitting a signal to slide the camera along the track.
Claim 32
Dependent Claim 40 words
A method according to claim 24, further comprising the step of transmitting an audio signal received from a remote operating environment to the operator in a local operating environment to facilitate assimilation of the operator into the remote operating environment.
Claim 33
Dependent Claim 17 words
A method according to claim 24, wherein the method steps are recorded on a computer readable medium.

References Cited (Backward Citations)

US3601530A Cited
US4555592A Cited
US4985846A Cited
US4992866A Cited
US5426450A Cited
US5450596A Cited
US5594859A Cited
US5640485A Cited
US5784282A Cited
US5576727A Cited
US5436542A Cited
US5684531A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-11-14 2004-05-15 2004-11-14 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-11-14 2008-05-15 2008-11-14 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-11-14 2012-05-15 2012-11-14 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag