US4402053A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Estimating workpiece pose using the feature points method
Assignee: Rhode Island Department of Elementary and Secondary Education
•
Filing: 1980-09-25
•
Granted: 1983-08-30
•
Expires: 2000-09-25
Abstract
Abstract A robot assembly for acquiring unorientated workpieces from a bin. A sensing system views the bin and collects data. A computer analyzes the data to determine candidate holdsites on the workpiece. The hand of the robot assembly then engages a workpiece at a selected holdsite. The workpiece is moved to a pose where the position and orientation of the workpiece are determined. After this determination, the workpiece may be disengaged, or moved to an intermediate or final goalsite. The method is applicable to workpieces that have six continuous unknown degrees of freedom. Furthermore, partial occlusion of the workpiece by the robot hand is allowed.
Inventors
- 👤 Robert B. Kelley
- 👤 John R. Birk
- 👤 Nai-Yung Chen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 12:39
CPC Classifications
B; B65; B65G; B65G47/00; B65G47/02; B65G47/04; B65G47/12; B65G47/14; B65G47/1407; B65G47/1478; B65G47/1485; B23; B23P; B23P19/00; B23P19/001; B23P19/004; B25; B25J; B25J19/00; B25J19/02; B25J19/021; B25J19/023; G; G05; G05B; G05B2219/00; G05B2219/30; G05B2219/39; G05B2219/39533
Claims Analysis
Total Claims: 40
Claim 1
Independent Claim
211 words
A robot system for acquiring unoriented unmodified workpieces from a bin which comprises: (a) a robot assembly which includes a hand to engage unoriented workpieces stored in the bin, at least some of the workpieces having three angles of uncertainty; and an arm secured to the hand to translate and rotate the hand; (b) a video imaging device to provide data corresponding to the workpieces in the bin, the workpiece being structurally distinct from the device, which data includes information based on the three angles of uncertainty and is sufficient to allow a candidate holdsite to be determined, the device defines line of sight optical paths and the hand is secured to the arm and adapted for movement along a line of sight optical path; (c) means to store data corresponding to the relative positions of the bin, the device and the robot assembly, and the data provided by the device; and (e) a computer communicating with the robot assembly, the device and the means to store the data which includes means to determine the position of the candidate holdsites; and means to output data to the robot assembly to move the hand to engage the workpiece at the selective candidate holdsite and to remove subsequently the workpiece from the bin.
Claim 2
Dependent Claim
211 words
A robot system for acquiring unoriented unmodified workpieces from a bin which comprises: (a) a robot assembly which includes a hand to engage unoriented workpieces stored in the bin, at least some of the workpieces having three angles of uncertainty; and an arm secured to the hand to translate and rotate the hand; (b) a video imaging device to provide data corresponding to the workpieces in the bin, the workpiece being structurally distinct from the device, which data includes information based on the three angles of uncertainty and is sufficient to allow a candidate holdsite to be determined, the device defines line of sight optical paths and the hand is secured to the arm and adapted for movement along a line of sight optical path; (c) means to store data corresponding to the relative positions of the bin, the device and the robot assembly, and the data provided by the device; and (e) a computer communicating with the robot assembly, the device and the means to store the data which includes means to determine the position of the candidate holdsites; and means to output data to the robot assembly to move the hand to engage the workpiece at the selective candidate holdsite and to remove subsequently the workpiece from the bin.
Claim 3
Dependent Claim
24 words
The system of claim 1 which includes means to move the arm through at least six axes one of which is a linear axis.
Claim 4
Dependent Claim
11 words
The system of claim 1 wherein the hand includes clamping means.
Claim 5
Dependent Claim
15 words
The system of claim 1 wherein the hand includes vacuum means to engage the workpiece.
Claim 6
Dependent Claim
15 words
The system of claim 4 wherein the vacuum means includes a flexible vacuum cup extension.
Claim 7
Dependent Claim
15 words
The system of claim 1 where includes means to illuminate the workpieces in the bin.
Claim 8
Dependent Claim
63 words
The system of claim 1 which includes at least one intermediate goalsite, having means to engage the workpiece and wherein the means to store data includes data corresponding to the relative positions of the intermediate goalsite, the robot assembly and the engaged workpiece, and the means to output data to the robot assembly includes means to move the workpiece to the intermediate goalsite.
Claim 9
Dependent Claim
149 words
A robot system for determining the pose of an engaged workpiece which comprises: (a) a robot assembly which includes a hand to engage a workpiece and an arm to translate and rotate the hand; (b) a video imaging device which defines line of sight optical paths to the features of the workpiece, the features being defined in images obtained in at least two presentation poses; (c) means to store the data corresponding to the relative positions of the robot assembly and the device, and the data provided by the device; and (d) a computer communicating with the robot assembly, the device and the means to store, which includes means to compare the images obtained and to match them to a workpiece model and to determine the six dimensional position and orientation of the workpiece and means to output data to the robot assembly to control movement of the workpiece.
Claim 10
Dependent Claim
149 words
A robot system for determining the pose of an engaged workpiece which comprises: (a) a robot assembly which includes a hand to engage a workpiece and an arm to translate and rotate the hand; (b) a video imaging device which defines line of sight optical paths to the features of the workpiece, the features being defined in images obtained in at least two presentation poses; (c) means to store the data corresponding to the relative positions of the robot assembly and the device, and the data provided by the device; and (d) a computer communicating with the robot assembly, the device and the means to store, which includes means to compare the images obtained and to match them to a workpiece model and to determine the six dimensional position and orientation of the workpiece and means to output data to the robot assembly to control movement of the workpiece.
Claim 11
Dependent Claim
12 words
The system of claim 8 wherein the device is a non-tactile sensor.
Claim 12
Dependent Claim
13 words
The system of claim 9 wherein the non-tactile sensor is an imaging device.
Claim 13
Dependent Claim
15 words
The system of claim 8 wherein the hand includes vacuum means to engage the workpiece.
Claim 14
Dependent Claim
11 words
The system of claim 8 wherein the hand includes gripper means.
Claim 15
Dependent Claim
12 words
The system of claim 8 which includes means to illuminate the workpiece.
Claim 16
Dependent Claim
15 words
The system of claim 10 wherein the workpiece is illuminated symmetrically about an optical path.
Claim 17
Dependent Claim
49 words
The system of claim 8 which includes at least one intermediate goalsite having means to engage the workpieces, the means to store includes data relative to the position of the goalsite, the robot assembly and the workpiece; and means to output data to move the workpiece to the goalsite.
Claim 18
Dependent Claim
116 words
The system of claim 8 wherein the device is a first sensing means which includes means to acquire an unoriented workpiece from a bin which means comprises second sensing means to provide data corresponding to the workpieces in the bin which data is sufficient to allow a candidate holdsite to be determined, the means to store includes data corresponding to the relative positions of the bin, the second sensing means; and the computer includes means to determine the position of the candidate holdsite and means to output data to the robot assembly to move the hand to engage the workpiece at the selected candidate holdsites and to move the hand to one of the presentation poses.
Claim 19
Independent Claim
100 words
A method of acquiring unoriented unmodified workpieces from a bin, the workpieces being structurally distinct from a video imaging device which collects data, at least some of the workpieces having three angles of uncertainty, which includes: (a) collecting data about candidate holdsites with a video imaging device which defines line of sight optical paths; (b) locating a candidate holdsite relative to the hand of a robot assembly, the robot assembly including an arm to translate and rotate the hand; (c) moving the hand along a line of sight optical path to engage the selected holdsite; and, (d) engage the workpiece.
Claim 20
Independent Claim
100 words
A method of acquiring unoriented unmodified workpieces from a bin, the workpieces being structurally distinct from a video imaging device which collects data, at least some of the workpieces having three angles of uncertainty, which includes: (a) collecting data about candidate holdsites with a video imaging device which defines line of sight optical paths; (b) locating a candidate holdsite relative to the hand of a robot assembly, the robot assembly including an arm to translate and rotate the hand; (c) moving the hand along a line of sight optical path to engage the selected holdsite; and, (d) engage the workpiece.
Claim 21
Dependent Claim
14 words
The method of claim 17 which includes collecting the data with a non-tactile sensor.
Claim 22
Dependent Claim
17 words
The method of claim 17 which includes establishing at least one candidate holdsite for the collected data.
Claim 23
Dependent Claim
25 words
The method of claim 19 which includes matching the collected data with a model of holdsite data, the model corresponding to a desired candidate holdsite.
Claim 24
Dependent Claim
14 words
The method of claim 17 which includes illuminating the unoriented workpieces in the bin.
Claim 25
Dependent Claim
13 words
The method of claim 17 which includes removing the workpiece from the bin.
Claim 26
Dependent Claim
56 words
The method of claim 17 wherein the collecting of the data includes collecting images of the workpieces in the bin; setting all pixels whose brightness is below a threshold to zero, the rest to one; defining regions which relate to the dimensions of the hand; and selecting one of said defined regions as the candidate holdsite.
Claim 27
Dependent Claim
66 words
The method of claim 17 wherein the collecting of the data includes creating collecting images of the workpieces in the bin; setting all pixels whose brightness is below a threshold or whose gradient magnitude is above a second threshold to zero, the rest to one; defining regions which relate to the dimensions of the hand; and selecting one of said defined regions as the candidate holdsite.
Claim 28
Dependent Claim
34 words
The method of claim 17 which includes moving the engaged workpiece to an intermediate goalsite; and releasing the workpiece at the intermediate goalsite from the hand; and engaging the workpiece at the intermediate goalsite.
Claim 29
Independent Claim
168 words
A method of determining the pose of a workpiece which includes: (a) engaging a workpiece with the hand of a robot assembly, the robot assembly including an arm to translate and rotate the hand; (b) moving the workpiece relative to a first presentation pose; (c) collecting data about the pose of the workpiece in a first pose by a video imaging device along a line of sight which device obtains images corresponding to features of the workpiece; (d) moving the workpiece relative to a second presentation pose; (e) collecting data about the pose of the workpiece in the second presentation pose by a video imaging device along a line of sight which device obtains images corresponding to features of the workpiece; and (f) establishing the position and orientation of the workpiece from the collected data by comparing the images obtained; and matching the images to a workpiece model, which model comprises of three dimensional locations of features to determine the six dimensioned position and orientation of the workpiece.
Claim 30
Independent Claim
168 words
A method of determining the pose of a workpiece which includes: (a) engaging a workpiece with the hand of a robot assembly, the robot assembly including an arm to translate and rotate the hand; (b) moving the workpiece relative to a first presentation pose; (c) collecting data about the pose of the workpiece in a first pose by a video imaging device along a line of sight which device obtains images corresponding to features of the workpiece; (d) moving the workpiece relative to a second presentation pose; (e) collecting data about the pose of the workpiece in the second presentation pose by a video imaging device along a line of sight which device obtains images corresponding to features of the workpiece; and (f) establishing the position and orientation of the workpiece from the collected data by comparing the images obtained; and matching the images to a workpiece model, which model comprises of three dimensional locations of features to determine the six dimensioned position and orientation of the workpiece.
Claim 31
Dependent Claim
57 words
The method of claim 26 wherein the pose is established by: storing three-dimensional locations of image features of the workpiece during an instructional phase; and comparing the locations of the image features of the workpiece when it is moved to the presentation poses with the locations of the stored workpiece image features established during the instruction phase.
Claim 32
Dependent Claim
17 words
The method of claim 26 wherein the data collection includes collecting the data with a non-tactile sensor.
Claim 33
Dependent Claim
13 words
The method of claim 28 wherein the non-tactile sensor is an imaging device.
Claim 34
Dependent Claim
14 words
The method of claim 29 wherein the non-tactile sensor is a video imaging device.
Claim 35
Independent Claim
16 words
The method of claims 26 or 30 which includes engaging the workpiece in a fixed manner.
Claim 36
Independent Claim
21 words
The method of claims 26 or 30 which includes: moving the workpiece from the second presentation pose to a final goalsite.
Claim 37
Dependent Claim
14 words
The method of claim 32 which includes: releasing the workpiece at the final goalsite.
Claim 38
Independent Claim
36 words
The method of claims 26 or 30 which includes: moving the workpiece from the second presentation pose to an intermediate goalsite; releasing the workpiece at the intermediate goalsite; and engaging the workpiece at the intermediate goalsite.
Claim 39
Dependent Claim
18 words
The method of claim 34 which includes moving the workpiece from the intermediate goalsite to a final goalsite.
Claim 40
Independent Claim
49 words
The method of claims 26 or 30 which includes acquiring an unoriented workpiece from a bin by collecting data about candidate holdsites, locating a candidate holdsite relative to the hand; moving the hand to engage the selected holdsite; engaging the workpiece; and moving the hand to the presentation pose.
References Cited (Backward Citations)
US3804270A
Cited
US3888362A
Cited
US4017721A
Cited
US3986007A
Cited
US4146924A
Cited
US4271477A
Cited
US4187051A
Cited
US4305130A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1986-08-29 | 1987-02-28 | 1987-08-30 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1990-08-29 | 1991-02-28 | 1991-08-30 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1994-08-29 | 1995-02-28 | 1995-08-30 | $7700.00 | Window Closed / Lapsed |