§
Luxuse
Patent Intelligence
Sign In
← Back to Patent Explorer
US5960125A Expired / Lapsed US ⏱️ 0.0 years remaining

Nonfeedback-based machine vision method for determining a calibration relationship between a camera and a moveable object

Assignee: Cognex Corp
•
Filing: 1996-11-21
•
Granted: 1999-09-28
•
Expires: 2016-11-21
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method is provided for determining a calibration relationship between a reference frame of motion of an object and a reference frame of a camera that generates images of the object. The method includes the steps of coupling a target to an object and placing the object at each of plural locations and orientations that are known with respect to the motion reference frame of the object. The location of the target(s) with respect to the object need not be known. An image of the object and target is generated while the object is at each of those locations/orientations. From each those images, the method determines the location/orientation of the target with respect to the reference frame of the camera. The method then calls for determining the calibration relationship between the reference frame of motion of the object and the camera reference frame as a function of the locations/orientations of the object with respect to the motion reference frame of the object and the locations/orientations of the target in the corresponding images with respect to the reference frame of the camera.

Inventors

  • 👤 David J. Michael
  • 👤 Aaron Wallack

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-03 22:55
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/70; G06T7/80; G06T7/85

Claims Analysis

Total Claims: 5
Claim 1
Independent Claim 468 words
A method of determining a calibration relationship between a reference frame of a motion stage and a reference frame of each of plural image acquisition devices that generate images of that stage, the method comprising the steps of: A. placing a calibration plate on the motion stage, the calibration plate including plural targets, where each target (i) as a known location (w xi ,w yi ,) on the calibration plate, where at least one target is in the field of view of each image acquisition device, and where the motion stage is at a first known location/orientation (m x ,m y , θ) j , where (j)=1, and generating with each of the image acquisition devices a first image of the motion stage; B. determining a location (i x ,i y where (j)=1, of the target in each of those first images; C. moving the motion stage to one or more other known locations/orientations (m x ,m y ,θ) j , where (j)>1. such that at least one target is in the field of view of each image acquisition device, and generating with each image acquisition device additional images of the motion stage; D. determining locations (i x ,i y ) ij , where (j)>1, of the target in each of those additional images; and E. determining a calibration relationship between the reference frame of the motion stage and the reference frames of the image acquisition devices as a function of (i) the known locations/orientations of the motion stage (m x ,m y ,θ) j , where (j)≧1, (ii) the locations (i x ,i y ) ij , where (j)≧1, of the targets in the corresponding images, and (iii) the known locations (w xi ,w yi ) of the targets on the calibration plate, wherein step (E) comprises the step of determining the calibration relationship by minimizing an error E ij between known locations/orientations of the motion stage and estimates thereof in accord with the mathematical relationship ##EQU10## where (m x ,m y ,θ) j represents the known motion stage locations/orientations, (i x ,i y ) ij represents locations of the targets in the images, (w xi ,w yi ) represents the known locations of each target on the calibration plate, G i (u,v), H( i (u,v) represent a lens distortion correction functions mapping coordinates (u,v) in an image to an orthonormal image coordinate system (ix,iy), P xi ,P yi represent a position of target (i) in motion stage coordinates when the motion stage is at (x=0,y=0,θ=0), α i , β i represent pixel width and height for camera field of view i, U and V represent the cosine and sine, respectively, of each image acquisition device's coordinate frame, (O xi ,O yi ) represents a physical position corresponding to specified location for camera field of view i.
Claim 2
Independent Claim 468 words
A method of determining a calibration relationship between a reference frame of a motion stage and a reference frame of each of plural image acquisition devices that generate images of that stage, the method comprising the steps of: A. placing a calibration plate on the motion stage, the calibration plate including plural targets, where each target (i) as a known location (w xi ,w yi ,) on the calibration plate, where at least one target is in the field of view of each image acquisition device, and where the motion stage is at a first known location/orientation (m x ,m y , θ) j , where (j)=1, and generating with each of the image acquisition devices a first image of the motion stage; B. determining a location (i x ,i y where (j)=1, of the target in each of those first images; C. moving the motion stage to one or more other known locations/orientations (m x ,m y ,θ) j , where (j)>1. such that at least one target is in the field of view of each image acquisition device, and generating with each image acquisition device additional images of the motion stage; D. determining locations (i x ,i y ) ij , where (j)>1, of the target in each of those additional images; and E. determining a calibration relationship between the reference frame of the motion stage and the reference frames of the image acquisition devices as a function of (i) the known locations/orientations of the motion stage (m x ,m y ,θ) j , where (j)≧1, (ii) the locations (i x ,i y ) ij , where (j)≧1, of the targets in the corresponding images, and (iii) the known locations (w xi ,w yi ) of the targets on the calibration plate, wherein step (E) comprises the step of determining the calibration relationship by minimizing an error E ij between known locations/orientations of the motion stage and estimates thereof in accord with the mathematical relationship ##EQU10## where (m x ,m y ,θ) j represents the known motion stage locations/orientations, (i x ,i y ) ij represents locations of the targets in the images, (w xi ,w yi ) represents the known locations of each target on the calibration plate, G i (u,v), H( i (u,v) represent a lens distortion correction functions mapping coordinates (u,v) in an image to an orthonormal image coordinate system (ix,iy), P xi ,P yi represent a position of target (i) in motion stage coordinates when the motion stage is at (x=0,y=0,θ=0), α i , β i represent pixel width and height for camera field of view i, U and V represent the cosine and sine, respectively, of each image acquisition device's coordinate frame, (O xi ,O yi ) represents a physical position corresponding to specified location for camera field of view i.
Claim 3
Independent Claim 448 words
A method of determining a calibration relationship between a reference frame of a motion stage and a reference frame of each of plural image acquisition devices that generate images of that stage, the method comprising the steps of: A. placing a calibration plate on the motion stage, the calibration plate including plural targets, where each target (i) as a known location (w xi ,w yi ) on the calibration plate, where at least one target is in the field of view of each image acquisition device, and where the motion stage is at a first known location/orientation (m x ,m y ,θ) j , where (j)=1, and generating with each of the image acquisition devices a first image of the motion stage; B. determining a location (i x ,i y ) ij , where (j)=1, of the target in each of those first images; C. moving the motion stage to one or more other known locations/orientations (m x ,m y ,θ) j , where (j)>1, such that at least one target is in the field of view of each image acquisition device, and generating with each image acquisition device additional images of the motion stage; D. determining locations (i x ,i y ) ij , where (j)>1, of the target in each of those additional images; and E. determining a calibration relationship between the reference frame of the motion stage and the reference frames of the image acquisition devices as a function of (i) the known locations/orientations of the motion stage (m x ,m y ,θ) j , where (j)≦1, (ii) the locations (i x , i y ) ij , where (j)≧1, of the targets in the corresponding images and (iii) the known locations (w xi ,w yi ) of the targets on the calibration plate, wherein step (E) comprises the step of determining the calibration relationship by minimizing an error E ij between known locations/orientations of the motion stage and estimates thereof in accord with the following mathematical relationship ##EQU11## where (m x ,m y ,θ) j represents the known motion stage locations/orientations, (i x ,i y ) ij represents locations of the targets in the images, (w xi ,w yi ) represents the known locations of each target on the calibration plate, (x c , y c , θ c ) represent unknown locations/orientations of the calibration plate with respect to the motion stage, α i , β i represent pixel width and height for camera field of view i, U and V represent the cosine and sine, respectively, of each image acquisition device's coordinate frame, (O xi ,O yi ) represents a physical position corresponding to specified location for camera field of view i.
Claim 4
Independent Claim 448 words
A method of determining a calibration relationship between a reference frame of a motion stage and a reference frame of each of plural image acquisition devices that generate images of that stage, the method comprising the steps of: A. placing a calibration plate on the motion stage, the calibration plate including plural targets, where each target (i) as a known location (w xi ,w yi ) on the calibration plate, where at least one target is in the field of view of each image acquisition device, and where the motion stage is at a first known location/orientation (m x ,m y ,θ) j , where (j)=1, and generating with each of the image acquisition devices a first image of the motion stage; B. determining a location (i x ,i y ) ij , where (j)=1, of the target in each of those first images; C. moving the motion stage to one or more other known locations/orientations (m x ,m y ,θ) j , where (j)>1, such that at least one target is in the field of view of each image acquisition device, and generating with each image acquisition device additional images of the motion stage; D. determining locations (i x ,i y ) ij , where (j)>1, of the target in each of those additional images; and E. determining a calibration relationship between the reference frame of the motion stage and the reference frames of the image acquisition devices as a function of (i) the known locations/orientations of the motion stage (m x ,m y ,θ) j , where (j)≦1, (ii) the locations (i x , i y ) ij , where (j)≧1, of the targets in the corresponding images and (iii) the known locations (w xi ,w yi ) of the targets on the calibration plate, wherein step (E) comprises the step of determining the calibration relationship by minimizing an error E ij between known locations/orientations of the motion stage and estimates thereof in accord with the following mathematical relationship ##EQU11## where (m x ,m y ,θ) j represents the known motion stage locations/orientations, (i x ,i y ) ij represents locations of the targets in the images, (w xi ,w yi ) represents the known locations of each target on the calibration plate, (x c , y c , θ c ) represent unknown locations/orientations of the calibration plate with respect to the motion stage, α i , β i represent pixel width and height for camera field of view i, U and V represent the cosine and sine, respectively, of each image acquisition device's coordinate frame, (O xi ,O yi ) represents a physical position corresponding to specified location for camera field of view i.
Claim 5
Dependent Claim 45 words
A method according to claim 2, wherein step (E) comprises the steps of iteratively (i) using gradient descent to vary θ c , and (ii) determining the calibration relationship by solving for the error E ij at each of those values of θ c .

References Cited (Backward Citations)

US3816722A Cited
US3936800A Cited
US3967100A Cited
US3968475A Cited
US3978326A Cited
US4011403A Cited
US4115702A Cited
US4183013A Cited
US4115762A Cited
US4200861A Cited
US4385322A Cited
US4254400A Cited
US4305130A Cited
US4300164A Cited
US4441206A Cited
US4441124A Cited
US4570180A Cited
US4534813A Cited
US4442361A Cited
US4736437A Cited
US4577344A Cited
US4783829A Cited
US4630306A Cited
US4581762A Cited
US4606065A Cited
US4541116A Cited
US4860374A Cited
US4688088A Cited
US4731858A Cited
US4914553A Cited
US4953224A Cited
US4730260A Cited
US4922543A Cited
US4876728A Cited
US4831580A Cited
US4727471A Cited
US4617619A Cited
US4742551A Cited
US4706168A Cited
US4860375A Cited
US4728195A Cited
US5297256A Cited
US4707647A Cited
US4783828A Cited
US4771469A Cited
US4783826A Cited
US4955062A Cited
US4972359A Cited
US4764870A Cited
US4982438A Cited
US5093867A Cited
US4926492A Cited
US4831549A Cited
US5185855A Cited
US4903218A Cited
US4841460A Cited
US5119435A Cited
US4907169A Cited
US5081656A Cited
US5287449A Cited
US5012402A Cited
US4962423A Cited
US5159645A Cited
US5124622A Cited
US5046190A Cited
US5311598A Cited
US5054096A Cited
US4876457A Cited
US4932065A Cited
US5090576A Cited
US5583949A Cited
US5091861A Cited
US5081689A Cited
US5027419A Cited
US5153925A Cited
US5060276A Cited
US5253308A Cited
US5073958A Cited
US5432525A Cited
US5063608A Cited
US5134575A Cited
US5164994A Cited
US5253306A Cited
US5271068A Cited
US5151951A Cited
US5495424A Cited
US4959898A Cited
US5329469A Cited
US5243607A Cited
US5113565A Cited
US5189712A Cited
US5363507A Cited
US5206820A Cited
US5230027A Cited
US5388252A Cited
US5115309A Cited
US5168269A Cited
US5327156A Cited
US5086478A Cited
US5091968A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2002-09-27 2003-03-29 2003-09-28 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2006-09-27 2007-03-29 2007-09-28 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2010-09-27 2011-03-29 2011-09-28 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag