US6535793B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and system for remote control of mobile robot
Assignee: iRobot Corp
•
Filing: 2001-05-01
•
Granted: 2003-03-18
•
Expires: 2021-05-01
Abstract
Abstract Methods of remote control of a mobile robot and an intuitive user interface for remotely controlling a mobile robot are provided. Using a point-and-click device ( 405 ), the user is able to choose a target location ( 430 ) within a heads-up display ( 400 ) toward which to move a mobile robot. Additional graphical overlays ( 410 & 412 ) are provided to aid the user in navigating even in systems with asynchronous communication.
Inventors
- 👤 James R. Allard
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 10:51
CPC Classifications
G; G05; G05D; G05D1/00; G05D1/02; G05D1/021; G05D1/0268; G05D1/0272; B; B25; B25J; B25J9/00; B25J9/16; B25J9/1679; B25J9/1689; G05D1/0011; G05D1/0038; G05D1/0044; G05D1/0231; G05D1/0246; G05D1/0276; G05D1/028; G05D1/0282; G05B; G05B2219/00; G05B2219/30; G05B2219/35; G05B2219/35506; G05B2219/40; G05B2219/40161; G05B2219/40169; G05D1/027
Claims Analysis
Total Claims: 27
Claim 1
Independent Claim
144 words
A method for tele-operating a robot in an environment, comprising the steps of: providing a user interface for controlling the tele-operation of the robot; providing, via an imaging device associated with the robot, image information representative of the environment around the robot to the user interface; using the image information to provide a user-perceptible image at the user interface representative of the environment around the robot; designating a target anywhere in the user-perceptible image towards which the robot will move; automatically converting the target designated in the user-perceptible image into a target location having x, y, and z coordinates in the environment of the robot at the user interface; and providing real-time instructions to the robot from the user interface to move from the robot's current location in the environment to the x, y, and z coordinates of the target location in the environment.
Claim 2
Independent Claim
144 words
A method for tele-operating a robot in an environment, comprising the steps of: providing a user interface for controlling the tele-operation of the robot; providing, via an imaging device associated with the robot, image information representative of the environment around the robot to the user interface; using the image information to provide a user-perceptible image at the user interface representative of the environment around the robot; designating a target anywhere in the user-perceptible image towards which the robot will move; automatically converting the target designated in the user-perceptible image into a target location having x, y, and z coordinates in the environment of the robot at the user interface; and providing real-time instructions to the robot from the user interface to move from the robot's current location in the environment to the x, y, and z coordinates of the target location in the environment.
Claim 3
Dependent Claim
113 words
The robot tele-operating method of claim 1 wherein the converting step for each designated target further comprises the steps of: determining a current frame of reference of the robot in the environment; determining a current frame of reference for the imaging device associated with the robot; identifying one end of a click vector based upon the current frame of references of the robot and the imaging device; determining the other end of the click vector based upon the view of the user-perceptible image and the designated target; and projecting the click vector onto a three-dimensional global map of the robot's environment to provide the x, y, and z coordinates of the target location.
Claim 4
Dependent Claim
96 words
The robot tele-operating method of claim 2 wherein the click vector determining step further comprises the steps of: determining the fixed angle and zoom of the imaging device associated with the robot that provides the view of the user-perceptible image; determining the pixel size of the user-perceptible image; identifying a pixel location in the user-perceptible image corresponding to the designated target; and calculating the other end of the click vector using the fixed angle and zoom of the imaging device, the pixel size of the user-perceptible image, and the pixel location corresponding to the designated target.
Claim 5
Dependent Claim
47 words
The robot tele-operating method of claim 1 wherein the target designating step further comprises the steps of: moving a visible pointer to a location in the user-perceptible image corresponding to the designated target; and activating a point-and-click selection device at the location to select the designated target.
Claim 6
Dependent Claim
51 words
The robot tele-operating method of claim 1 wherein the target designating step further comprises the steps of: selecting an icon; dragging the icon to a location in the user-perceptible image corresponding to the designated target; and dropping the icon at the location in the user-perceptible image to select the designated target.
Claim 7
Dependent Claim
17 words
The robot tele-operating method of claim 1 wherein the user-perceptible image is provided on a computer monitor.
Claim 8
Dependent Claim
18 words
The robot tele-operating method of claim 1 wherein the user-perceptible image is provided on a portable liquid-crystal display.
Claim 9
Dependent Claim
24 words
The robot tele-operating method of claim 1 wherein the image information representative of the environment around the robot is provided by a video signal.
Claim 10
Dependent Claim
16 words
The robot tele-operating method of claim 8 wherein the video signal is transmitted via the Internet.
Claim 11
Dependent Claim
14 words
The robot tele-operating method of claim 1 wherein the imaging device is a camera.
Claim 12
Independent Claim
141 words
A system for tele-operating a robot in an environment, comprising: a user interface for controlling the tele-operation of the robot; an imaging device associated with the robot for providing image information representative of the environment around the robot; means for transmitting the image information to the user interface; means for converting the image information to a user-perceptible image at the user interface; means for designating a target in the user-perceptible image towards which the robot should move; means for automatically converting the target designated in the user-perceptible image into a target location having x, y, and z coordinates in the environment of the robot; and means for providing real-time instructions to the robot from the user interface to move from the robot's current location in the environment to the x, y, and z coordinates of the target location in the environment.
Claim 13
Independent Claim
141 words
A system for tele-operating a robot in an environment, comprising: a user interface for controlling the tele-operation of the robot; an imaging device associated with the robot for providing image information representative of the environment around the robot; means for transmitting the image information to the user interface; means for converting the image information to a user-perceptible image at the user interface; means for designating a target in the user-perceptible image towards which the robot should move; means for automatically converting the target designated in the user-perceptible image into a target location having x, y, and z coordinates in the environment of the robot; and means for providing real-time instructions to the robot from the user interface to move from the robot's current location in the environment to the x, y, and z coordinates of the target location in the environment.
Claim 14
Dependent Claim
114 words
The robot tele-operating system of claim 11 wherein the converting means comprises: means for determining the current frame of reference of the robot in the environment; means for determining the current frame of reference of the image device associated with the robot; means for identifying one end of a click vector using the current frames of references of the robot and the imaging device; means for determining the other end of the click vector based upon the view of the user-perceptible image and the designated target; and means for projecting the click vector onto a three-dimensional global map of the robot's environment to provide the x, y, and z coordinates of the target location.
Claim 15
Dependent Claim
106 words
The robot tele-operating system of claim 12 wherein the means for determining the other end of the click vector comprises: means for determining the fixed angle and zoom of the imaging device associated with the robot that provides the view of the user-perceptible image; means for determining the pixel size of the user-perceptible image; means for identifying a pixel location in the user-perceptible image corresponding to the designated target; and means for calculating the other end of the click vector using the fixed angle and zoom of the imaging device, the pixel size of the user-perceptible image, and the pixel location corresponding to the designated target.
Claim 16
Dependent Claim
63 words
The robot tele-operating system of claim 11 wherein the target designating means is a point-and-click selection device that includes a visible pointer movable within the user-perceptible image and means for activating the point-and-click selection device such that the location of the visible pointer within the user-perceptible image when the point-and-click selection device is activated designates the target towards which the robot should move.
Claim 17
Dependent Claim
50 words
The robot tele-operating system of claim 11 wherein the target designating means comprises: means for selecting and dragging an icon to a location in the user-perceptible image corresponding to the designated target; and means for dropping the icon at the location in the user-perceptible image to select the designated target.
Claim 18
Dependent Claim
14 words
The robot tele-operating system of claim 11 wherein the imaging device is a camera.
Claim 19
Dependent Claim
15 words
The robot tele-operating system of claim 11 wherein the image-information transmitting means is the Internet.
Claim 20
Dependent Claim
95 words
A graphical user interface for tele-operating a robot in an environment, comprising: a display device for providing a user-perceptible image representative of the environment around the robot; means for designating a target in the user-perceptible image towards which the robot thould move; and means for superimposing at least one projection in the user-perceptible image in correlation with movement of the target designating means; wherein the at least one projection represents an area to which the robot may move prior to target designation and represents the area to which the robot will move upon target designation.
Claim 21
Dependent Claim
95 words
A graphical user interface for tele-operating a robot in an environment, comprising: a display device for providing a user-perceptible image representative of the environment around the robot; means for designating a target in the user-perceptible image towards which the robot thould move; and means for superimposing at least one projection in the user-perceptible image in correlation with movement of the target designating means; wherein the at least one projection represents an area to which the robot may move prior to target designation and represents the area to which the robot will move upon target designation.
Claim 22
Dependent Claim
22 words
The graphical user interface of claim 18 wherein the at least one projection provided by the superimposing means is a targeting circle.
Claim 23
Dependent Claim
40 words
The graphical user interface of claim 18 wherein the at least one projection provided by the superimposing means is a targeting circle, and wherein said superimposing means is further operative to provide a perspective box associated with the targeting circle.
Claim 24
Dependent Claim
40 words
The graphical user interface of claim 18 wherein the target designating means comprises a visible pointer movable within the user-perceptible image and wherein the projection superimposing means is operative to superimpose the at least one projection over the visible pointer.
Claim 25
Dependent Claim
77 words
A graphical user interface for tele-operating a robot in an environment, comprising: a display device for providing a user-perceptible image representative of the environment around the robot; means for designating a target in the user-perceptible image towards which the robot should move; and means for overlaying a floor plan grid on top of the user-perceptible image to provide an indication of relative distance of objects within the environment of the robot based upon the robot's current position.
Claim 26
Dependent Claim
77 words
A graphical user interface for tele-operating a robot in an environment, comprising: a display device for providing a user-perceptible image representative of the environment around the robot; means for designating a target in the user-perceptible image towards which the robot should move; and means for overlaying a floor plan grid on top of the user-perceptible image to provide an indication of relative distance of objects within the environment of the robot based upon the robot's current position.
Claim 27
Dependent Claim
30 words
The graphical user interface of claim 22 further comprising: means for overlaying at least one rotation tape on top of the user perceptible image to aid in tele-operating the robot.
References Cited (Backward Citations)
US4202037A
Cited
GB2128842A
Cited
DE3404202A1
Cited
US5471560A
Cited
US5511147A
Cited
US5675229A
Cited
US5652849A
Cited
US6108031A
Cited
WO1999005580A2
Cited
JPH11149315A
Cited
US5984880A
Cited
US20010020200A1
Cited
US6088020A
Cited
US6113395A
Cited
JP2000094373A
Cited
US20010025118A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-03-17 | 2006-09-16 | 2007-03-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-03-17 | 2010-09-16 | 2011-03-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-03-17 | 2014-09-16 | 2015-03-18 | $7700.00 | Window Closed / Lapsed |