US5455870A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus and method for inspection of high component density printed circuit board
Assignee: Raytheon Co
•
Filing: 1994-06-24
•
Granted: 1995-10-03
•
Expires: 2014-06-24
Abstract
Abstract An automated electronic module inspection system having illumination sources that produce digitized gray scale images that are then analyzed by a computer. The inspection system illuminates the module including solder joints, components and printed circuit board using a sequence of illumination that produce visual images which are used to identify defects. The inspection system inspects for all defects as specified in MIL-STD-2000A (Section 4.4) by using both surface reflectance properties as well as topological properties of objects. The system comprises two video cameras. A positioning table aligns a module-under-test with the optical axis of each camera thereby enabling the same field-of-view to be observed under different lighting conditions. A dark field illumination associated with a first camera preferentially illuminates non-flat surfaces, but not vertical surfaces. A bright field illumination associated with a second camera preferentially illuminates relatively flat surfaces. The flat-surface illumination light source is collimated with the optical axis of the camera using a conventional partially reflecting angled mirror that reflects the light along the camera's optical axis onto a circuit board of the module. The angled surfaces are illuminated using four ring-lights concentrically aligned with the optical axis of the second camera. The images observed by the camera are then analyzed by inspection programs for discrepancies between image model attributes and the images, and such programs provide compensation for nonuniformities of the light sources and cameras and compensation of shadows resulting from the dark field illumination light source.
Inventors
- 👤 Dinyar Sepai
- 👤 Kevin R. Daly
- 👤 Brian L. Whalen
- 👤 Khanh Hong
- 👤 George B. Jones
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-03 20:40
CPC Classifications
G; G01; G01N; G01N21/00; G01N21/84; G01N21/88; G01N21/95; G01N21/956; G01N21/95684; H; H05; H05K; H05K13/00; H05K13/08; H05K13/081; H05K13/0815; G01N21/8806; G01N2021/8822; G01N2021/8825
Claims Analysis
Total Claims: 56
Claim 1
Independent Claim
315 words
Apparatus for inspection of surface mount solder joints of an electronic module comprising: means for positioning and aligning said module during said inspection; a first light source means for providing a dark field illumination to non-flat surfaces of said module on said positioning means; a first sensing means disposed above said first light source means for sensing an intensity of reflected light from said first light source to obtain a first image; a second light source means for providing a bright field illumination to flat surfaces of said module on said positioning means; a second sensing means disposed above said second light source means for sensing an intensity of reflected light from said second light source to obtain a second image; processing means for compensating said first image for nonuniformities resulting from said first light source means and said first sensing means and for compensating said second image for nonuniformities resulting from said second light source means and said second sensing means; means included in said processing means for providing information describing predetermined shadows to said detecting and compensating means using a PCB module data base and said second compensated image to compensate for predetermined shadows; means included in said processing means for differentiating between a low light intensity region of said first image and said predetermined shadows of said first image; means included in said processing means for detecting and compensating for said predetermined shadows resulting from surface mount components attached to said electronic module and said first light source means, said shadows including omni-directional and uni-directional shadows; means included in said processing means for performing a transposition on said first image and said second image for establishing a three-dimensional topography of said module; and means included in said processing means for analyzing said three-dimensional topography and said intensity of said first image and said second image to determine the condition of said module.
Claim 2
Dependent Claim
315 words
Apparatus for inspection of surface mount solder joints of an electronic module comprising: means for positioning and aligning said module during said inspection; a first light source means for providing a dark field illumination to non-flat surfaces of said module on said positioning means; a first sensing means disposed above said first light source means for sensing an intensity of reflected light from said first light source to obtain a first image; a second light source means for providing a bright field illumination to flat surfaces of said module on said positioning means; a second sensing means disposed above said second light source means for sensing an intensity of reflected light from said second light source to obtain a second image; processing means for compensating said first image for nonuniformities resulting from said first light source means and said first sensing means and for compensating said second image for nonuniformities resulting from said second light source means and said second sensing means; means included in said processing means for providing information describing predetermined shadows to said detecting and compensating means using a PCB module data base and said second compensated image to compensate for predetermined shadows; means included in said processing means for differentiating between a low light intensity region of said first image and said predetermined shadows of said first image; means included in said processing means for detecting and compensating for said predetermined shadows resulting from surface mount components attached to said electronic module and said first light source means, said shadows including omni-directional and uni-directional shadows; means included in said processing means for performing a transposition on said first image and said second image for establishing a three-dimensional topography of said module; and means included in said processing means for analyzing said three-dimensional topography and said intensity of said first image and said second image to determine the condition of said module.
Claim 3
Dependent Claim
24 words
The apparatus as recited in claim 1 wherein: said positioning means comprises means for moving said module in an X-axis and a Y-axis directions.
Claim 4
Dependent Claim
21 words
The apparatus as recited in claim 2 wherein: said positioning means comprises means for moving said module in a circular direction.
Claim 5
Dependent Claim
36 words
The apparatus as recited in claim 1 wherein: said apparatus comprises means coupled to said first sensing means and said second sensing means for transferring said first image and said second image to said processing means.
Claim 6
Dependent Claim
32 words
The apparatus as recited in claim 1 wherein: said means for performing a transposition comprises conversion of said intensity of said first image and said second image to a surface angle representation.
Claim 7
Dependent Claim
59 words
The apparatus as recited in claim 1 wherein: said means for performing a transposition comprises means for performing a gradient analysis, a component interconnect boundary detection, a supervised segmentation and histogram analysis in predefined windows, an unsupervised segmentation connectivity analysis and a circular feature identification on said first image and said second image for establishing said three dimensional topography.
Claim 8
Dependent Claim
29 words
The apparatus as recited in claim 1 wherein: said means for analyzing said three-dimensional topography comprises means for comparing said established three-dimensional topography to a predetermined three-dimensional topography criteria.
Claim 9
Dependent Claim
22 words
The apparatus as recited in claim 6 wherein: said analyzing means further comprises an expert system having a plurality of decision levels.
Claim 10
Dependent Claim
20 words
The apparatus as recited in claim 7 wherein said analyzing means comprises an expert system having a neural network means.
Claim 11
Dependent Claim
33 words
The apparatus as recited in claim 1 wherein: said means for analyzing said three-dimensional topography comprises means for determining a defective condition of solder connections, components, and printed circuit materials of said module.
Claim 12
Dependent Claim
19 words
The apparatus as recited in claim 1 wherein: said first light source means comprises a plurality of ring lamps.
Claim 13
Dependent Claim
34 words
The apparatus as recited in claim 11 wherein: said apparatus further comprises means for individually activating each of said plurality of ring lamps in accordance with a control signal generated by said processing means.
Claim 14
Dependent Claim
29 words
The apparatus as recited in claim 11 wherein: said apparatus comprises means for activating said ring lamps simultaneously in accordance with a control signal generated by said processing means.
Claim 15
Dependent Claim
328 words
An automated vision inspection system comprising: a computer means for controlling the operation of said vision inspection system; a positioning table having a plurality of axes for positioning and aligning a module during an inspection in accordance with a command signal from said computer means; a dark field illumination means positioned above said module for illuminating non-flat surfaces of said module; a first camera disposed above said dark field illumination means for sensing an intensity of reflected light from said module to obtain a first image; a bright field illumination means positioned above said module and adjacent to said dark field illumination means for illuminating flat surfaces of said module; a second camera disposed above said bright field illumination means for sensing an intensity of reflected light from said module to obtain a second image; processing means within said computer means for compensating said first image for nonuniformities from said dark field illumination means and said first camera and for compensating said second image for nonuniformities resulting from said bright field illumination means and said second camera; means included in said processing means for providing information describing predetermined shadows to said detecting and compensating means using a PCB module data base to compensate for said predetermined shadows; means included in said processing means for differentiating between a low light intensity region of said first image and said predetermined shadows of said first image; means included in said processing means for detecting and compensating for said predetermined shadows resulting from surface mount components attached to an electronic module and said dark field illumination means, said shadows including omni-directional and uni-directional shadows; means included in said processing means for performing a transposition on said first image and said second image for establishing a three-dimensional topography of said module; means for comparing said established three-dimensional topography to a predetermined three-dimensional topography criteria; and expert system means for analyzing the results of said comparing means to detect a defect in said module.
Claim 16
Dependent Claim
328 words
An automated vision inspection system comprising: a computer means for controlling the operation of said vision inspection system; a positioning table having a plurality of axes for positioning and aligning a module during an inspection in accordance with a command signal from said computer means; a dark field illumination means positioned above said module for illuminating non-flat surfaces of said module; a first camera disposed above said dark field illumination means for sensing an intensity of reflected light from said module to obtain a first image; a bright field illumination means positioned above said module and adjacent to said dark field illumination means for illuminating flat surfaces of said module; a second camera disposed above said bright field illumination means for sensing an intensity of reflected light from said module to obtain a second image; processing means within said computer means for compensating said first image for nonuniformities from said dark field illumination means and said first camera and for compensating said second image for nonuniformities resulting from said bright field illumination means and said second camera; means included in said processing means for providing information describing predetermined shadows to said detecting and compensating means using a PCB module data base to compensate for said predetermined shadows; means included in said processing means for differentiating between a low light intensity region of said first image and said predetermined shadows of said first image; means included in said processing means for detecting and compensating for said predetermined shadows resulting from surface mount components attached to an electronic module and said dark field illumination means, said shadows including omni-directional and uni-directional shadows; means included in said processing means for performing a transposition on said first image and said second image for establishing a three-dimensional topography of said module; means for comparing said established three-dimensional topography to a predetermined three-dimensional topography criteria; and expert system means for analyzing the results of said comparing means to detect a defect in said module.
Claim 17
Dependent Claim
27 words
The automated vision inspection system as recited in claim 17 wherein: said positioning table comprises means for moving said module in an X-axis and a Y-axis directions.
Claim 18
Dependent Claim
24 words
The automated vision inspection system as recited in claim 14 wherein: said positioning table comprises means for moving said module in a circular direction.
Claim 19
Dependent Claim
40 words
The automated vision inspection system as recited in claim 14 wherein: said inspection system comprises means coupled to said first sensing means and said second sensing means for transferring said first image and said second image to said computer means.
Claim 20
Dependent Claim
35 words
The automated vision inspection system as recited in claim 14 wherein: said means for performing a transposition comprises conversion of said intensity of said first image and said second image to a surface angle representation.
Claim 21
Dependent Claim
62 words
The automated vision inspection system as recited in claim 14 wherein: said means for performing a transposition comprises means for performing a gradient analysis, a component interconnect boundary detection, a supervised segmentation and histogram analysis in predefined windows, an unsupervised segmentation connectivity analysis, and a circular feature identification on said first image and said second image for establishing said three dimensional topography.
Claim 22
Dependent Claim
21 words
The automated vision inspection system as recited in claim 14 wherein: said expert system means comprises a plurality of decision levels.
Claim 23
Dependent Claim
20 words
The automated vision inspection system as recited in claim 14 wherein: said expert system means comprises a neural network means.
Claim 24
Dependent Claim
29 words
The automated vision inspection system as recited in claim 14 wherein: said expert system determines a defective condition of solder connections, components, and printed circuit materials of said module.
Claim 25
Dependent Claim
22 words
The automated vision inspection system as recited in claim 14 wherein: said dark field illumination means comprises a plurality of ring lamps.
Claim 26
Dependent Claim
37 words
The automated vision inspection system as recited in claim 23 wherein: said system further comprises means for individually activating each of said plurality of ring lamps in accordance with a control signal generated by said computer means.
Claim 27
Dependent Claim
32 words
The automated vision inspection system as recited in claim 23 wherein: said system comprises means for activating said ring lamps simultaneously in accordance with a control signal generated by said computer means.
Claim 28
Independent Claim
302 words
A method for inspection of surface mount solder joints of an electronic module comprising the steps of: positioning and aligning said module for said inspection with a positioning means having a plurality of axes; illuminating non-flat surfaces of said module with a first light source having a dark field illumination means positioned above said module; sensing an intensity of reflected light from said first light source with a first sensing means to obtain a first image; repositioning said module for said inspection; illuminating flat surfaces of said module with a second light source having a bright field illumination means positioned above said module and adjacent to said first light source; sensing an intensity of reflected light from said second light source with a second sensing means to obtain a second image; compensating in a processing means said first image for nonuniformities resulting from said first light source and compensating said second image for nonuniformities resulting from said second light source and said second sensing means; providing information describing predetermined shadows to said detecting and compensating means with means included in said processing means using a PCB module data base to compensate for said predetermined shadows; differentiating in said processing means between a low light intensity region of said first image and said predetermined shadows of said first image; detecting and compensating in said processing means for said predetermined shadows resulting from surface mount components attached to said electronic module and said first light source means, said, shadows including omni-directional and uni-directional shadows; performing in said processing means a transposition on said first image and said second image for establishing a three-dimensional topography of said module; and analyzing said three-dimensional topography and said intensity of said first image and said second image in said processing means to determine the condition of said module.
Claim 29
Independent Claim
302 words
A method for inspection of surface mount solder joints of an electronic module comprising the steps of: positioning and aligning said module for said inspection with a positioning means having a plurality of axes; illuminating non-flat surfaces of said module with a first light source having a dark field illumination means positioned above said module; sensing an intensity of reflected light from said first light source with a first sensing means to obtain a first image; repositioning said module for said inspection; illuminating flat surfaces of said module with a second light source having a bright field illumination means positioned above said module and adjacent to said first light source; sensing an intensity of reflected light from said second light source with a second sensing means to obtain a second image; compensating in a processing means said first image for nonuniformities resulting from said first light source and compensating said second image for nonuniformities resulting from said second light source and said second sensing means; providing information describing predetermined shadows to said detecting and compensating means with means included in said processing means using a PCB module data base to compensate for said predetermined shadows; differentiating in said processing means between a low light intensity region of said first image and said predetermined shadows of said first image; detecting and compensating in said processing means for said predetermined shadows resulting from surface mount components attached to said electronic module and said first light source means, said, shadows including omni-directional and uni-directional shadows; performing in said processing means a transposition on said first image and said second image for establishing a three-dimensional topography of said module; and analyzing said three-dimensional topography and said intensity of said first image and said second image in said processing means to determine the condition of said module.
Claim 30
Dependent Claim
27 words
The method as recited in claim 26 wherein: said step of positioning said module comprises moving said module in an X axis and a Y axis direction.
Claim 31
Dependent Claim
22 words
The method as recited in claim 26 wherein: said step of positioning said module comprises moving said module in a circular direction.
Claim 32
Dependent Claim
52 words
The method as recited in claim 26 wherein: said steps of sensing an intensity of reflected light from said first light source and said second light source to obtain said first image and said second image comprises the steps of transferring said first image and said second image to a processing means.
Claim 33
Dependent Claim
34 words
The method as recited in claim 26 wherein: said step of performing a transposition comprises the step of converting said intensity of said first image and said second image to a surface angle representation.
Claim 34
Dependent Claim
60 words
The method as recited in claim 26 wherein: said step of performing a transposition comprises the steps of performing a gradient analysis, a component interconnect boundary detection, a supervised segmentation and histogram analysis in predefined windows, an unsupervised segmentation connectivity analysis, and a circular feature identification on said first image and said second image for establishing said three dimensional topography.
Claim 35
Dependent Claim
30 words
The method as recited in claim 26 wherein: said step of analyzing said three-dimensional topography comprises the step of comparing said established three-dimensional topography to a predetermined three-dimensional topography criteria.
Claim 36
Dependent Claim
37 words
The method as recited in claim 32 wherein: said step of analyzing said established three dimensional topography to a predetermined three dimensional criteria comprises the step of employing an expert system comprising a plurality of decision levels.
Claim 37
Dependent Claim
36 words
The method as recited in claim 32 wherein: said step of analyzing said established three dimensional topography to a predetermined three dimensional criteria comprises the step of employing an expert system comprising a neural network means.
Claim 38
Dependent Claim
30 words
The method as recited in claim 26 wherein: said step of determining the condition of said module includes detecting a defective condition in devices, solder connections and printed circuit materials.
Claim 39
Dependent Claim
30 words
The method as recited in claim 26 wherein: said step of illuminating said module with a first light source includes said first light source having a plurality of ring lamps.
Claim 40
Dependent Claim
42 words
The method as recited in claim 36 wherein said step of illuminating said module with a plurality of ring lamps further comprises the step of individually activating each of said ring lamps in accordance with a control signal from said processing means.
Claim 41
Independent Claim
338 words
A method of inspecting surface mount solder joints of an electronics module with an automated vision inspection system comprising the steps of: controlling the operation of said vision inspection system with a computer means; positioning a module during an inspection in accordance with a command signal from said computer means to a positioning table having a plurality of axes; aligning said positioned module to a first camera and to a second camera;. illuminating non-flat surfaces of said module with a dark field illumination means positioned above said module; sensing an intensity of reflected light from said module to obtain a first image using said first camera disposed above said dark field illumination means; illuminating flat surfaces of said module with a bright field illumination means positioned above said module and adjacent to said dark field illumination means; sensing an intensity of reflected light from said module to obtain a second image using said second camera disposed above said bright field illumination means; compensating said first image for nonuniformities from said dark field illumination means and said first camera and compensating said second image for non uniformities resulting from said bright field illumination means and said second camera with a processing means within said computer means; providing information describing predetermined shadows to said processing means using a PCB module data base to compensate for said predetermined shadows; differentiating in said processing means between a low light intensity region of said first image and said predetermined shadows of said first image; performing detection and compensation in said processing means for said predetermined shadows resulting from surface mount components attached to said electronic modules and said dark field illumination means, said shadows including omni-directional and uni-directional shadows; performing in said processing means a transposition on said first image and said second image for establishing a three-dimensional topography of said module; comparing said established three-dimensional topography to a predetermined three-dimensional topography criteria; and analyzing the results of said comparing means to detect a defect in said module with an expert system means.
Claim 42
Independent Claim
338 words
A method of inspecting surface mount solder joints of an electronics module with an automated vision inspection system comprising the steps of: controlling the operation of said vision inspection system with a computer means; positioning a module during an inspection in accordance with a command signal from said computer means to a positioning table having a plurality of axes; aligning said positioned module to a first camera and to a second camera;. illuminating non-flat surfaces of said module with a dark field illumination means positioned above said module; sensing an intensity of reflected light from said module to obtain a first image using said first camera disposed above said dark field illumination means; illuminating flat surfaces of said module with a bright field illumination means positioned above said module and adjacent to said dark field illumination means; sensing an intensity of reflected light from said module to obtain a second image using said second camera disposed above said bright field illumination means; compensating said first image for nonuniformities from said dark field illumination means and said first camera and compensating said second image for non uniformities resulting from said bright field illumination means and said second camera with a processing means within said computer means; providing information describing predetermined shadows to said processing means using a PCB module data base to compensate for said predetermined shadows; differentiating in said processing means between a low light intensity region of said first image and said predetermined shadows of said first image; performing detection and compensation in said processing means for said predetermined shadows resulting from surface mount components attached to said electronic modules and said dark field illumination means, said shadows including omni-directional and uni-directional shadows; performing in said processing means a transposition on said first image and said second image for establishing a three-dimensional topography of said module; comparing said established three-dimensional topography to a predetermined three-dimensional topography criteria; and analyzing the results of said comparing means to detect a defect in said module with an expert system means.
Claim 43
Dependent Claim
32 words
The automated vision inspection system method as recited in claim 38 wherein: said step of positioning said module comprises the steps of moving said module in an X-axis and a Y-axis directions.
Claim 44
Dependent Claim
29 words
The automated vision inspection system method as recited in claim 38 wherein: said step of positioning said module comprises the step of moving said module in a circular direction.
Claim 45
Dependent Claim
56 words
The automated vision inspection system method as recited in claim 38 wherein: said step of sensing an intensity of reflected light from said first light source and said second light source to obtain said first image and said second image comprises the steps of transferring said first image and said second image to said computer means.
Claim 46
Dependent Claim
38 words
The automated vision inspection system method as recited in claim 38 wherein: said step of performing a transformation comprises the step of converting said intensity of said first image and said second image to a surface angle representation.
Claim 47
Dependent Claim
62 words
The vision inspection system as recited in claim 38 wherein: said step of performing a transposition comprises the steps of performing a gradient analysis, a component interconnect boundary detection, a supervised segmentation and histogram analysis in predefined windows, an unsupervised segmentation connectivity analysis, and a circular feature identification on said first image and said second image for establishing said three dimensional topography.
Claim 48
Dependent Claim
26 words
The vision inspection system as recited in claim 38 wherein: said step of analyzing with an expert system means comprises a plurality of decision level steps.
Claim 49
Dependent Claim
31 words
The automated vision inspection system method as recited in claim 38 wherein: said step of analyzing with an expert system means comprises a step of analyzing with a neural network means.
Claim 50
Dependent Claim
35 words
The automated vision inspection system method as recited in claim 38 wherein: said step of analyzing with said expert system determines a defective condition of solder connections, components, and printed circuit materials of said module.
Claim 51
Dependent Claim
37 words
The automated vision inspection system method as recited in claim 38 wherein: said step of illuminating non-flat surfaces of said module with a dark field illumination means comprises the step of illuminating a plurality of ring lamps.
Claim 52
Dependent Claim
45 words
The automated vision inspection system method as recited in claim 47 wherein: said step of illuminating said plurality of ring lamps comprises the steps of sequentially activating each of said plurality of ring lamps in accordance with a control signal generated by said computer means.
Claim 53
Dependent Claim
36 words
The vision inspection system as recited in claim 55 wherein: said step of illuminating said plurality of ring lamps comprises activating said ring lamps simultaneously in accordance with a control signal generated by said computer means.
Claim 54
Dependent Claim
37 words
The apparatus as recited in claim 1 wherein: said means for detecting and compensating for shadows comprises correcting a reduction in intensity of said first image due to shadows by increasing said intensity by an equivalent amount.
Claim 55
Dependent Claim
55 words
The method as recited in claim 26 wherein: said step of detecting and compensating in said processing means for shadows resulting from said first light source means comprises the step of correcting a reduction in intensity of said first image due to shadows by increasing said intensity of said first image by an equivalent amount.
Claim 56
Dependent Claim
61 words
The automated vision inspection system method as recited in claim 38 wherein: said step of performing detection and compensation in said processing means for shadows resulting from said dark field illumination means further comprises the step of correcting a reduction in intensity of said first image due to shadows by increasing said intensity of said first image by an equivalent amount.
References Cited (Backward Citations)
US4343553A
Cited
US4538909A
Cited
US4999285A
Cited
US4696104A
Cited
US4677473A
Cited
US4688939A
Cited
US4809308A
Cited
US4926452A
Cited
US4876455A
Cited
US5247344A
Cited
US5015097A
Cited
US5030008A
Cited
US5039868A
Cited
US5127726A
Cited
US4988202A
Cited
US5058178A
Cited
US5060065A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-10-02 | 1999-04-03 | 1999-10-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-10-02 | 2003-04-03 | 2003-10-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-10-02 | 2007-04-03 | 2007-10-03 | $7700.00 | Window Closed / Lapsed |