US5802201A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Robot system with vision apparatus and transparent grippers
Assignee: NEW YORK TRUSTEES OF COLUMBIA UNIVERSITY IN CITY OF NEW YORK
•
Filing: 1996-02-09
•
Granted: 1998-09-01
•
Expires: 2016-02-09
Abstract
Abstract A robot having a vision system for sensing an image of a manipulated object is described. The system includes a robot with an end effector, a transparent gripper mounted on the end effector, a camera for sensing an image of a manipulated object, and an image processing apparatus for processing sensed image data to correct the image data for optical distortion, such as refraction-induced image shifts. Three dimensional image information may be retrieved by including a light plane source and adapting the image processing apparatus to perform three-dimensional image processing.
Inventors
- 👤 Shree K. Nayar
- 👤 Anton Nikolaev
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-28 14:38
CPC Classifications
B; B25; B25J; B25J9/00; B25J9/16; B25J9/1694; B25J9/1697; G; G05; G05B; G05B2219/00; G05B2219/30; G05B2219/39; G05B2219/39566; G05B2219/40; G05B2219/40542; G05B2219/40609
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
102 words
A robot for manipulating an object, comprising: (a) an end effector forming a mechanical component of said robot; (b) a substantially entirely transparent gripper, mechanically coupled to said end effector, to grip said object being manipulated; (c) an optical image sensor, optically coupled to said transparent gripper, to sense an image of said object through a surface of said transparent gripper, and for converting a sensed image of said object into image data; and (d) image data processing apparatus, coupled to said sensor, for processing said image data to remove optical artifacts, including distortion due to refraction, introduced by said gripper therefrom.
Claim 2
Dependent Claim
102 words
A robot for manipulating an object, comprising: (a) an end effector forming a mechanical component of said robot; (b) a substantially entirely transparent gripper, mechanically coupled to said end effector, to grip said object being manipulated; (c) an optical image sensor, optically coupled to said transparent gripper, to sense an image of said object through a surface of said transparent gripper, and for converting a sensed image of said object into image data; and (d) image data processing apparatus, coupled to said sensor, for processing said image data to remove optical artifacts, including distortion due to refraction, introduced by said gripper therefrom.
Claim 3
Dependent Claim
48 words
The robot of claim 1, wherein said transparent gripper is a parallel jaw gripper comprising: (a) a mounting piece; and (b) two substantially transparent parallel jaws, each jaw having a top portion, wherein each of said parallel jaws is connected to said mounting piece at said top portion.
Claim 4
Dependent Claim
53 words
The robot of claim 2, wherein said mounting piece of said parallel jaw gripper is connected to said top portion of a first of said two parallel jaws by at least one bearing, whereby said first parallel jaw is capable of translational movement with respect to the other of said two parallel jaws.
Claim 5
Dependent Claim
21 words
The robot of claim 2, wherein said optical sensor is connected to an outer face of one of said parallel jaws.
Claim 6
Dependent Claim
17 words
The robot of claim 1, wherein said transparent gripper is made from a substantially transparent plastic material.
Claim 7
Dependent Claim
14 words
The robot of claim 5, wherein said transparent gripper is made from polymethyl methacrylate.
Claim 8
Dependent Claim
14 words
The robot of claim 1, wherein said sensor is a charged coupled device sensor.
Claim 9
Dependent Claim
18 words
The robot of claim 1, wherein said robot is a robot having at least five degrees of freedom.
Claim 10
Dependent Claim
51 words
The robot of claim 1, wherein said image data processing apparatus is further adapted to perform transformation processing prior to performing optical distortion processing, whereby said image data is transformed from data corresponding to a frame of reference of said optical sensor to data corresponding to a world frame of reference.
Claim 11
Dependent Claim
69 words
The robot of claim 1, further comprising: (e) a light plane source, optically coupled to said transparent gripper and to said optical sensor, for illuminating said object with a plane of light sensible by said optical sensor; wherein said optical sensor is a light stripe range finder and said image data processing apparatus is further adapted to perform three-dimensional image processing to thereby retrieve three-dimensional information for said object.
Claim 12
Dependent Claim
32 words
The robotic vision system of claim 10, further comprising: (f) depth map storage means, coupled to said image processing apparatus, for storing derived three-dimensional information for said object as a depth map.
Claim 13
Dependent Claim
31 words
The robotic vision system of claim 11, further comprising: (g) display means, coupled to said depth map storage means, for displaying said depth map as a wireframe on a bitmapped workstation.
Claim 14
Independent Claim
94 words
An apparatus for manipulating an object, comprising: (a) a gripper base; (b) substantially entirely transparent gripper means, connected to said gripper base, for gripping said object; (c) sensor means, optically coupled to said transparent gripper means, to sense an image of said object through a surface of said transparent gripper means and for converting a sensed image of said object into image data; and (d) image data processing means, coupled to said sensor means, for processing said image data to remove optical artifacts, including distortion due to refraction, introduced by said gripper means therefrom.
Claim 15
Independent Claim
94 words
An apparatus for manipulating an object, comprising: (a) a gripper base; (b) substantially entirely transparent gripper means, connected to said gripper base, for gripping said object; (c) sensor means, optically coupled to said transparent gripper means, to sense an image of said object through a surface of said transparent gripper means and for converting a sensed image of said object into image data; and (d) image data processing means, coupled to said sensor means, for processing said image data to remove optical artifacts, including distortion due to refraction, introduced by said gripper means therefrom.
Claim 16
Dependent Claim
13 words
The apparatus of claim 13, wherein said sensor means is an active sensor.
Claim 17
Dependent Claim
41 words
The apparatus of claim 13, wherein said sensor means is adapted to sense a plurality of images of said object, and said image data processing means is adapted to perform three-dimensional image processing to thereby retrieve three-dimensional information for said object.
Claim 18
Dependent Claim
27 words
The apparatus of claim 15, wherein said gripper base is a rotatable base and said plurality of images of said object are sensed by rotating said base.
Claim 19
Dependent Claim
81 words
The robotic vision system of claim 15, further comprising: (e) a movable light plane source, optically coupled to said transparent gripper means and to said sensor means, for illuminating said object with a plane of light sensible by said sensor means, wherein said sensor means is a movable camera, and said plurality of images of said object are sensed by moving said movable light plane source and said camera to a plurality of different positions corresponding to each of said images.
Claim 20
Independent Claim
80 words
A method for manipulating an object by a robot, comprising the steps of: (a) gripping said object with a substantially entirely transparent gripper; (b) sensing an image of said object, through a surface of said substantially entirely transparent gripper; (c) converting said sensed image into image data; and (d) processing said image data to remove any optical artifact, including distortion due to refraction, introduced by said gripper therefrom, whereby data for a substantially undistorted image of said object is generated.
Claim 21
Independent Claim
80 words
A method for manipulating an object by a robot, comprising the steps of: (a) gripping said object with a substantially entirely transparent gripper; (b) sensing an image of said object, through a surface of said substantially entirely transparent gripper; (c) converting said sensed image into image data; and (d) processing said image data to remove any optical artifact, including distortion due to refraction, introduced by said gripper therefrom, whereby data for a substantially undistorted image of said object is generated.
Claim 22
Dependent Claim
50 words
The method of claim 18, further comprising illuminating said object with a plane of light prior said sensing step, wherein said sensing step comprises sensing an image of said illuminated object, and said image processing step further comprises performing three-dimensional image processing to thereby retrieve three-dimensional information for said object.
Claim 23
Dependent Claim
37 words
The method of claim 18, wherein said sensing step comprises sensing two or more images of said object, and said image processing step further comprises performing three-dimensional image processing to thereby retrieve three-dimensional information for said object.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-08-31 | 2002-03-02 | 2002-09-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-08-31 | 2006-03-02 | 2006-09-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-08-31 | 2010-03-02 | 2010-09-01 | $7700.00 | Window Closed / Lapsed |