US5371690A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for inspection of surface mounted devices
Assignee: Cognex Corp
•
Filing: 1992-01-17
•
Granted: 1994-12-06
•
Expires: 2012-01-17
Abstract
Abstract The invention provides methods and apparatus for inspecting a surface mounted device to estimate its position. The methods and apparatus provide for storing a description of the component to be inspected; devising a plan for inspecting features of the surface mounted device to determine their characteristics arid, from them, to estimate a position of the device itself; generating an image of at least a portion of the component being inspected; and estimating the component's position by inspecting successive features in accord with the plan. A resulting output signal provides that estimate, for example, to placement equipment which can make final adjustments in placement. According to one aspect of the invention, that plan is intended to reduce with inspection of each successive feature any uncertainty in the estimation of the position of the component.
Inventors
- 👤 Antonie J. Engel
- 👤 William M. Silver
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 20:27
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/70; G06T7/73; G06T2207/00; G06T2207/30; G06T2207/30108; G06T2207/30141
Claims Analysis
Total Claims: 70
Claim 1
Independent Claim
261 words
An apparatus for inspecting a surface mounted device to estimate a position thereof, said estimation including at least one of an axial placement and an angular orientation estimation, said apparatus comprising: A. UDL means for storing a UDL signal representative of a shape of at least a portion of a surface mounted device to be inspected, B. planning means, coupled with said UDL means, responsive to at least said UDL signal for generating a plan signal representative of a plan for application of a plurality of successive vision tools to an image signal, each vision tool for inspection of a selected feature of a surface mounted device to determine characteristics thereof and, thereby, to estimate a position of the device itself, wherein said plan reduces with inspection of each successive feature an uncertainty in the estimate of the position of said device, C. video input means for generating an image signal representative of at least a portion of a surface mounted device being inspected, and D. inspection means, coupled with said video input means and in communication with said planning means, for i) applying to said image signal a plurality of successive vision tools, each such vision tool for inspection of a selected feature of said surface mounted device to estimate a position of the device itself in accord with said plan and for generating in connection with application of each such vision tool an output signal representative of said estimate, ii) reducing with application of each such vision tool an uncertainty in said estimate of the position of said device.
Claim 2
Independent Claim
261 words
An apparatus for inspecting a surface mounted device to estimate a position thereof, said estimation including at least one of an axial placement and an angular orientation estimation, said apparatus comprising: A. UDL means for storing a UDL signal representative of a shape of at least a portion of a surface mounted device to be inspected, B. planning means, coupled with said UDL means, responsive to at least said UDL signal for generating a plan signal representative of a plan for application of a plurality of successive vision tools to an image signal, each vision tool for inspection of a selected feature of a surface mounted device to determine characteristics thereof and, thereby, to estimate a position of the device itself, wherein said plan reduces with inspection of each successive feature an uncertainty in the estimate of the position of said device, C. video input means for generating an image signal representative of at least a portion of a surface mounted device being inspected, and D. inspection means, coupled with said video input means and in communication with said planning means, for i) applying to said image signal a plurality of successive vision tools, each such vision tool for inspection of a selected feature of said surface mounted device to estimate a position of the device itself in accord with said plan and for generating in connection with application of each such vision tool an output signal representative of said estimate, ii) reducing with application of each such vision tool an uncertainty in said estimate of the position of said device.
Claim 3
Dependent Claim
30 words
An apparatus according to claim 1, wherein said UDL means includes means for storing a UDL signal representative of a geometric description of said surface mounted device to be inspected.
Claim 4
Dependent Claim
31 words
An apparatus according to claim 2, wherein said UDL means includes means for storing a UDL signal representative of at least an outline of said surface mounted device to be inspected.
Claim 5
Dependent Claim
31 words
An apparatus according to claim 2, wherein said UDL means includes means for storing a UDL signal representative of rectangular segments representing features of said surface mounted device to be inspected.
Claim 6
Dependent Claim
33 words
An apparatus according to claim 4, wherein said UDL means includes means for storing a UDL signal representative of at least one of a position, orientation and dimension of each said rectangular segment.
Claim 7
Dependent Claim
35 words
An apparatus according to claim 2, wherein said UDL means includes means for storing a UDL signal representative of polarities of one or more edges of features of said surface mounted device to be inspected.
Claim 8
Dependent Claim
31 words
An apparatus according to claim 1, wherein said UDL means includes means for storing a UDL signal representative of expected conditions under which said surface mounted device is to be inspected.
Claim 9
Dependent Claim
38 words
An apparatus according to claim 7, wherein said UDL means includes means for storing a UDL signal representative of at least one of expected lighting conditions, video resolution, pickup tool type and motion control parameters for said inspection.
Claim 10
Dependent Claim
33 words
An apparatus according to claim 7, wherein said UDL means includes means for storing a UDL signal representative of an expected position, and uncertainty therein, of the surface mounted device to be inspected.
Claim 11
Dependent Claim
56 words
An apparatus according to claim 1, wherein said planning means includes coarse edge detection planning means for generating said plan signal to call for inspection of one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge.
Claim 12
Dependent Claim
61 words
An apparatus according to claim 10, wherein A. at least one said edge of said device comprises a pair of substantially parallel edge points, referred to as an edge-pair, and B. said coarse edge detection planning means includes means for generating said plan signal to call for inspection of one or more edge-pairs to determine respective positions of the corresponding edges.
Claim 13
Dependent Claim
62 words
An apparatus according to claim 10, wherein said coarse edge detection planning means includes means for determining amounts by which said uncertainty would be reduced by inspection of a plurality of selected edges of said device, and generating said plan signal to call for inspection of one or more of those edges based, at least in part, on comparison of those amounts.
Claim 14
Dependent Claim
76 words
An apparatus according to claim 12, comprising A. a pickup nozzle for holding a device being inspected, B. said coarse edge detection planning means includes means for determining whether said pickup nozzle can protrude from any of said selected edges during inspection thereof, and C. said coarse edge detection planning means includes plan-tree means for responding to such determination for generating a plan signal to represent alternative plans for inspection of successive edges of said device.
Claim 15
Dependent Claim
42 words
An apparatus according to claim 1, wherein said planning means includes whole part analysis planning means for generating said plan signal to call for inspection of said device represented by said image signal to determine a gross physical characteristic of said device.
Claim 16
Dependent Claim
43 words
An apparatus according to claim 14, wherein said whole part analysis planning means includes means for determining at least one of an area, a principle moment, a center of mass, a bounding box and an orientation of a major axis of said device.
Claim 17
Dependent Claim
49 words
An apparatus according to claim 15, comprising A. a pickup nozzle for holding a device being inspected, and B. said whole part analysis planning means includes means for determining an effect, if any, that said pickup nozzle would have on a determination of an angular orientation of said device.
Claim 18
Dependent Claim
39 words
An apparatus according to claim 14, wherein said whole part analysis planning means includes means for generating from said UDL signal a synthetic image of said device to facilitate said determination of a gross physical characteristic of said device.
Claim 19
Dependent Claim
124 words
An apparatus according to claim 1, wherein said planning means includes A. coarse edge detection planning means for generating said plan signal to call for inspection of one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge, B. whole part analysis planning means for generating said plan signal to call for inspection of said device represented by said image signal to determine a gross physical characteristic of said device, C. means for selectively operating at least one of said coarse edge detection planning means and said whole part analysis planning means depending on an amounts by which said uncertainty which would be reduced thereby.
Claim 20
Dependent Claim
32 words
An apparatus according to claim 18, wherein said planning means includes segment detection planning means for generating said plan signal to represent a series of segments of said device to be inspected.
Claim 21
Dependent Claim
57 words
An apparatus according to claim 1, wherein said inspection means comprises coarse edge detection means responsive to said plan signal for inspecting, in an order determined thereby, one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge.
Claim 22
Dependent Claim
54 words
An apparatus according to claim 20, wherein said coarse edge detection means includes uncertainty determination means for determining from each inspection an uncertainty in the estimated position of said device, comparing that uncertainty with a prediction thereof represented by said plan signal, and responding to an unfavorable said comparison for generating an alert signal.
Claim 23
Dependent Claim
33 words
An apparatus according to claim 20, wherein said inspection means includes whole part analysis means responsive to said plan signal for determining from said image signal a gross physical characteristic of said device.
Claim 24
Dependent Claim
42 words
An apparatus according to claim 22, wherein said whole part analysis means includes means for determining at least one of an area, a principle moment, a center of mass, a bounding box, and an orientation of a major axis of said device.
Claim 25
Dependent Claim
33 words
An apparatus according to claim 23, wherein said whole part analysis means includes means for determining from said gross physical characteristic an estimated position of said device and an uncertainty of that estimation.
Claim 26
Dependent Claim
108 words
An apparatus according to claim 24, wherein said inspection means includes A. coarse edge detection means responsive to said plan signal for inspecting, in an order determined thereby, one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge, B. whole part analysis means responsive to said plan signal for determining from said image signal a gross physical characteristic of said device, and C. means for selectively operating at least one of said coarse edge detection means and said whole part analysis means in accord with said plan signal.
Claim 27
Dependent Claim
36 words
An apparatus according to claim 25, wherein said inspection means includes segment detection means responsive to said plan signal for inspecting segments of said device to identify at least one of the location and position thereof.
Claim 28
Dependent Claim
22 words
An apparatus according to claim 26, wherein said segment detection means includes means for inspecting said segments on a nearest neighbor-by-neighbor basis.
Claim 29
Dependent Claim
35 words
An apparatus according to claim 27, wherein said segment detection means includes means for updating, as a result of each such inspection of a segment of said device, an estimated position of the device itself.
Claim 30
Dependent Claim
126 words
An apparatus according to claim 26, wherein A. said video input means is coupled to a pickup nozzle for holding a device being inspected, B. said segment detection means includes i) point inspection means for identifying positions of a plurality of candidate points on a segment being inspected, ii) means coupled with said point inspection means for determining a position of said segment based on positions of one or more of said candidate points, C. said segment detection means further includes nozzle disambiguation means for i) determining whether a candidate point lies within an estimated position of said nozzle, ii) responding to at least a selected determination that a candidate point lies within an estimated position of said nozzle for excluding that point as a candidate.
Claim 31
Dependent Claim
66 words
An apparatus according to claim 29, wherein said nozzle disambiguation means includes means selectively responsive to a plurality of said candidate points lying within an estimated position of said nozzle for generating an estimate of a position of said nozzle with reduced uncertainty, and for determining a position of the associated segment based on positions of one or more candidate points lying outside that reduced-uncertainty estimate.
Claim 32
Dependent Claim
42 words
An apparatus according to claim 30, wherein a segment being inspected comprises a pair of edges, the improvement wherein said nozzle disambiguation means includes means for estimating a position of said nozzle by identifying widest adjacent points on said pair of edges.
Claim 33
Dependent Claim
131 words
An apparatus according to claim 23, wherein said whole part analysis means includes contour angle finder means for determining an orientation of a contour of said surface mounted device, said contour angle finder means including A. perimeter scan means for identifying a perimeter of said surface mounted device, and for generating a perimeter signal representative of coordinates of a plurality of points on that perimeter, B. segment slope means, coupled with said perimeter scan means, for determining at least a slope of each of a plurality of respective subsets of said perimeter points, C. histogram means, coupled with said segment slope means, for generating a histogram of normalized ones of those slopes, and D. means for identifying a peak of said histogram to determine an orientation of said surface mounted device.
Claim 34
Dependent Claim
96 words
An apparatus according to claim 20, comprising A. a pickup nozzle for holding a device being inspected, B. said planning means includes plan-tree means for generating a plan signal to represent alternative plans for inspection of successive edges of said device, C. said coarse edge detection means includes i) nozzle location means for determining what coarse edge, if any, of said device said pickup nozzle may be protruding from, ii) means coupled to said nozzle location means for inspecting one or more edges of said device according to selected alternative plan represented by said plan signal.
Claim 35
Dependent Claim
59 words
An apparatus according to claim 1, wherein said inspection means includes acceptability means for comparing at least one of an estimated position and size of at least one of i) said surface mounted device, and ii) a portion of that surface mounted device, with a predetermined standard, and for generating a signal representative of the result of that comparison.
Claim 36
Independent Claim
243 words
A method for inspecting a surface mounted device to estimate a position thereof, said estimation including at least one of an axial placement and an angular orientation estimation, said method comprising A. a shape defining step for defining, with a UDL signal, a shape of at least a portion of a surface mounted device to be inspected, B. a planning step for generating, from at least said UDL signal, a plan signal representative of a plan for application of a plurality of successive vision tools to an image signal, each vision tool for inspection of a selected feature of a surface mounted device to determine characteristics thereof and, thereby, to estimate a position of the device itself, wherein said plan reduces with inspection of each successive feature an uncertainty in the estimate of the position of said device, C. an image generating step generating an image signal representative of at least a portion of a surface mounted device being inspected, D. an inspection step including applying to said image signal a plurality of successive vision tools, each such vision tool for inspection of a selected feature of said surface mounted device to estimate a position of the device itself in accord with said plan and for generating in connection with application of each such vision tool an output signal representative of said estimate, ii) reducing with application of each such vision tool an uncertainty in said estimate of the position of said device.
Claim 37
Independent Claim
243 words
A method for inspecting a surface mounted device to estimate a position thereof, said estimation including at least one of an axial placement and an angular orientation estimation, said method comprising A. a shape defining step for defining, with a UDL signal, a shape of at least a portion of a surface mounted device to be inspected, B. a planning step for generating, from at least said UDL signal, a plan signal representative of a plan for application of a plurality of successive vision tools to an image signal, each vision tool for inspection of a selected feature of a surface mounted device to determine characteristics thereof and, thereby, to estimate a position of the device itself, wherein said plan reduces with inspection of each successive feature an uncertainty in the estimate of the position of said device, C. an image generating step generating an image signal representative of at least a portion of a surface mounted device being inspected, D. an inspection step including applying to said image signal a plurality of successive vision tools, each such vision tool for inspection of a selected feature of said surface mounted device to estimate a position of the device itself in accord with said plan and for generating in connection with application of each such vision tool an output signal representative of said estimate, ii) reducing with application of each such vision tool an uncertainty in said estimate of the position of said device.
Claim 38
Dependent Claim
32 words
A method according to claim 35, wherein said shape defining step includes the step of storing a UDL signal representative of a geometric description of said surface mounted device to be inspected.
Claim 39
Dependent Claim
33 words
A method according to claim 36, wherein said shape defining step includes the step of storing a UDL signal representative of at least an outline of said surface mounted device to be inspected.
Claim 40
Dependent Claim
33 words
A method according to claim 36, wherein said shape defining step includes the step of storing a UDL signal representative of rectangular segments representing features of said surface mounted device to be inspected.
Claim 41
Dependent Claim
35 words
A method according to claim 38, wherein said shape defining step includes the step of storing a UDL signal representative of at least one of a position, orientation and dimension of each said rectangular segment.
Claim 42
Dependent Claim
37 words
A method according to claim 36, wherein said shape defining step includes the step of storing a UDL signal representative of polarities of one or more edges of features of said surface mounted device to be inspected.
Claim 43
Dependent Claim
33 words
A method according to claim 35, wherein said shape defining step includes the step of storing a UDL signal representative of expected conditions under which said surface mounted device is to be inspected.
Claim 44
Dependent Claim
40 words
A method according to claim 41, wherein said shape defining step includes the step of storing a UDL signal representative of at least one of expected lighting conditions, video resolution, pickup tool type and motion control parameters for said inspection.
Claim 45
Dependent Claim
35 words
A method according to claim 41, wherein said shape defining step includes the step of storing a UDL signal representative of an expected position, and uncertainty therein, of the surface mounted device to be inspected.
Claim 46
Dependent Claim
57 words
A method according to claim 35, wherein said planning step includes a coarse edge detection planning step for generating said plan signal to call for inspection of one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge.
Claim 47
Dependent Claim
62 words
A method according to claim 44, wherein at least one said edge of said device comprises a pair of substantially parallel edge points, referred to as an edge-pair, the improvement wherein said coarse edge detection planning step includes the step of generating said plan signal to call for inspection of one or more edge-pairs to determine respective positions of the corresponding edges.
Claim 48
Dependent Claim
65 words
A method according to claim 44, wherein said coarse edge detection planning step includes the steps of A. determining amounts by which said uncertainty would be reduced by inspection of a plurality of selected edges of said device, and B. generating said plan signal to call for inspection of one or more of those edges based, at least in part, on comparison of those amounts.
Claim 49
Dependent Claim
75 words
A method according to claim 44, wherein A. said coarse edge detection planning step includes the step for determining whether a pickup nozzle holding the device to be inspected can protrude from any of said selected edges during inspection thereof, and B. said coarse edge detection planning step includes a plan-tree generating step for responding to such determination for generating a plan signal to represent alternative plans for inspection of successive edges of said device.
Claim 50
Dependent Claim
43 words
A method according to claim 35, wherein said planning step includes a whole part analysis planning step for generating said plan signal to call for inspection of said device represented by said image signal to determine a gross physical characteristic of said device.
Claim 51
Dependent Claim
44 words
A method according to claim 48, wherein said whole part analysis planning step includes a step for determining at least one of an area, a principle moment, a center of mass, a bounding box, and an orientation of a major axis of said device.
Claim 52
Dependent Claim
44 words
A method according to claim 49, wherein said whole part analysis planning step includes a step for determining an effect, if any, that a pickup nozzle holding the device to be inspected would have on a determination of an angular orientation of said device.
Claim 53
Dependent Claim
40 words
A method according to claim 48, wherein said whole part analysis planning step includes a step for generating from said UDL signal a synthetic image of said device to facilitate said determination of a gross physical characteristic of said device.
Claim 54
Dependent Claim
117 words
A method according to claim 35, wherein said planning step includes a step of selectively performing at least one of the following steps depending on an amounts by which said uncertainty which would be reduced thereby: A. a coarse edge detection planning step for generating said plan signal to call for inspection of one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge, and B. a whole part analysis planning step for generating said plan signal to call for inspection of said device represented by said image signal to determine a gross physical characteristic of said device.
Claim 55
Dependent Claim
33 words
A method according to claim 52, wherein said planning step includes a segment detection planning step for generating said plan signal to represent a series of segments of said device to be inspected.
Claim 56
Dependent Claim
58 words
A method according to claim 35, wherein said inspection step comprises a coarse edge detection step responsive to said plan signal for inspecting, in an order determined thereby, one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge.
Claim 57
Dependent Claim
55 words
A method according to claim 54, wherein said coarse edge detection step includes an uncertainty determination step for determining from each inspection an uncertainty in the estimated position of said device, comparing that uncertainty with a prediction thereof represented by said plan signal, and responding to an unfavorable said comparison for generating an alert signal.
Claim 58
Dependent Claim
34 words
A method according to claim 55, wherein said inspection step includes a whole part analysis step responsive to said plan signal for determining from said image signal a gross physical characteristic of said device.
Claim 59
Dependent Claim
43 words
A method according to claim 56, wherein said whole part analysis step includes a step for determining at least one of an area, a principle moment, a center of mass and an orientation, a bounding box, of a major axis of said device.
Claim 60
Dependent Claim
33 words
A method according to claim 57, wherein said whole part analysis step includes step for determining from said gross physical characteristic an estimated position of said device and an uncertainty of that estimation.
Claim 61
Dependent Claim
125 words
A method according to claim 57, wherein said whole part analysis step includes a contour angle finding step for determining an orientation of a contour of said surface mounted device, said contour angle finding step including a A. a perimeter scan step for identifying a perimeter of said surface mounted device, and for generating a perimeter signal representative of coordinates of a plurality of points on that perimeter, B. a segment slope step for determining at least a slope of each of a plurality of respective subsets of said perimeter points, C. a histogram-generating step for generating a histogram of normalized ones of those slopes, and D. a step for identifying a peak of said histogram to determine an orientation of said surface mounted device.
Claim 62
Dependent Claim
82 words
A method according to claim 56, comprising A. said planning step includes a plan-tree generating step for generating a plan signal to represent alternative plans for inspection of successive edges of said device, and B. said coarse edge detection step includes i) a nozzle location step for determining what coarse edge, if any, of said device said pickup nozzle may be protruding from, ii) inspecting one or more edges of said device according to selected alternative plan represented by said plan signal.
Claim 63
Dependent Claim
93 words
A method according to claim 54, wherein said inspection step includes a step for selectively performing at least one of the following steps in accord with said plan signal: A. a coarse edge detection step, in an order determined by said plan signal, one or more edges of said device to determine respective positions thereof, said positions including at least one of an axial placement and an angular orientation of the respective edge, and B. a whole part analysis step for determining from said image signal a gross physical characteristic of said device.
Claim 64
Dependent Claim
37 words
A method according to claim 61, wherein said inspection step includes a segment detection step responsive to said plan signal for inspecting segments of said device to identify at least one of the location and position thereof.
Claim 65
Dependent Claim
22 words
A method according to claim 62, wherein said segment detection step includes step for inspecting said segments on a nearest neighbor-by-neighbor basis.
Claim 66
Dependent Claim
35 words
A method according to claim 63, wherein said segment detection step includes step for updating, as a result of each such inspection of a segment of said device, an expected position of the device itself.
Claim 67
Dependent Claim
109 words
A method according to claim 62, wherein A. said segment detection step includes i) a point inspection step for identifying positions of a plurality of candidate points on a segment being inspected, ii) step coupled for determining a position of said segment based on positions of one or more of said candidate points, B. said segment detection step further includes nozzle disambiguation step i) determining whether a candidate point lies within an estimated position of a nozzle holding said device under inspection, ii) responding to at least a selected determination that a candidate point lies within an estimated position of said nozzle for excluding that point as a candidate.
Claim 68
Dependent Claim
68 words
A method according to claim 65, wherein said nozzle disambiguation step includes a step of selectively responding to a plurality of said candidate points lying within an estimated position of said nozzle for generating an estimate of a position of said nozzle with reduced uncertainty, and for determining a position of the associated segment based on positions of one or more candidate points lying outside that reduced-uncertainty estimate.
Claim 69
Dependent Claim
43 words
A method according to claim 66, wherein a segment being inspected comprises a pair of edges, the improvement wherein said nozzle disambiguation step includes a step of estimating a position of said nozzle by identifying widest adjacent points on said pair of edges.
Claim 70
Dependent Claim
55 words
A method according to claim 35, wherein said inspection step includes a placement acceptability step for comparing at least one of an estimated position and size of at least one of said surface mounted device, or a portion thereof, with a predetermined standard, and for generating a signal representative of the result of that comparison.
References Cited (Backward Citations)
US3936800A
Cited
US3968475A
Cited
US4115702A
Cited
US4200861A
Cited
US4254400A
Cited
US4441206A
Cited
US4736437A
Cited
US4630306A
Cited
US4922543A
Cited
US4876728A
Cited
US4783828A
Cited
US4955062A
Cited
US4972359A
Cited
US4926492A
Cited
US4907169A
Cited
US5081656A
Cited
US5091861A
Cited
US5073958A
Cited
US5134575A
Cited
US4959898A
Cited
US5113565A
Cited
US5133022A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1997-12-05 | 1998-06-06 | 1998-12-06 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2001-12-05 | 2002-06-06 | 2002-12-06 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2005-12-05 | 2006-06-06 | 2006-12-06 | $7700.00 | Window Closed / Lapsed |