Patent US5699444A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5699444A Expired / Lapsed US ⏱️ 0.0 years remaining

Methods and apparatus for using image data to determine camera location and orientation

Assignee: Benhov GmbH LLC
•
Filing: 1995-03-31
•
Granted: 1997-12-16
•
Expires: 2015-03-31
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Methods and apparatus for accurately surveying and determining the physical location of objects in a scene are disclosed which use image data captured by one or more cameras and three points from the scene which may either be measured after the images are captured or may be included in the calibrated target placed in the scene at the time of image capture. Objects are located with respect to a three dimensional coordinate system defined with reference to the three points. The methods and apparatus permit rapid set up and capture of precise location data using simple apparatus and simple image processing. The precise location and orientation of the camera utilized to capture each scene is determined from image data, from the three point locations and from optical parameters of the camera.

Inventors

  • 👤 Charles S. Palm

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-02 10:45
CPC Classifications
G; G01; G01C; G01C11/00; G01C11/04; G01C11/06; G06; G06T; G06T7/00; G06T7/50; G06T7/55; G06T7/70; G06T7/73; G06V; G06V10/00; G06V10/10; G06V10/12; G06V10/14; G06V10/147; H; H04; H04N; H04N13/00; H04N13/20; H04N13/204; H04N13/239; H04N13/246; G06T2207/00; G06T2207/30; G06T2207/30204; G06T2207/30244; H04N2013/0074; H04N2013/0081

Claims Analysis

Total Claims: 26
Claim 1
Independent Claim 128 words
A method of measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing two images of a scene containing the points of B, C and D, using one or more cameras of known principal distance, b. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using 3 to 5 points from said images, principal distance and said known distances, c. using the locations of the one or more cameras at the time the images were captured to determine the location of said point D from image data.
Claim 2
Independent Claim 128 words
A method of measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing two images of a scene containing the points of B, C and D, using one or more cameras of known principal distance, b. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using 3 to 5 points from said images, principal distance and said known distances, c. using the locations of the one or more cameras at the time the images were captured to determine the location of said point D from image data.
Claim 3
Independent Claim 318 words
A method of measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing two images of a scene containing the points A, B, C and D, using one or more cameras of known principal distance, b. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using information derived from said images, principal distance and said known distances, and c. using the locations of the one or more cameras at the time the images were captured to determine the location of said point D from image data by c1. defining an auxiliary coordinate system with origin along the line joining the locations of the cameras, c2. defining the center point of each image as an origin of a set of image reference axes pointing in X', Y' and Z' directions, respectively, c3. measuring offset in at least one of the X' and Y' directions of a point on the first image and of a corresponding point of a second image, c4. determining the angles formed between a line joining point D, the principal point of the objective and the image of point D on one of the X' or Y' planes for each of the images, c5. determining a distance h representing a distance of point d to a line joining principle points of said one or more cameras used to capture said two images using the measured offsets, the focal length and the angles, c6. determining the X' and Y' coordinates of point D in the auxiliary coordinate system, and c7. transforming coordinates (X', Y', h) of the auxiliary coordinate system to a representation in said coordinate system defined using said three points, A, B and C.
Claim 4
Independent Claim 318 words
A method of measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing two images of a scene containing the points A, B, C and D, using one or more cameras of known principal distance, b. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using information derived from said images, principal distance and said known distances, and c. using the locations of the one or more cameras at the time the images were captured to determine the location of said point D from image data by c1. defining an auxiliary coordinate system with origin along the line joining the locations of the cameras, c2. defining the center point of each image as an origin of a set of image reference axes pointing in X', Y' and Z' directions, respectively, c3. measuring offset in at least one of the X' and Y' directions of a point on the first image and of a corresponding point of a second image, c4. determining the angles formed between a line joining point D, the principal point of the objective and the image of point D on one of the X' or Y' planes for each of the images, c5. determining a distance h representing a distance of point d to a line joining principle points of said one or more cameras used to capture said two images using the measured offsets, the focal length and the angles, c6. determining the X' and Y' coordinates of point D in the auxiliary coordinate system, and c7. transforming coordinates (X', Y', h) of the auxiliary coordinate system to a representation in said coordinate system defined using said three points, A, B and C.
Claim 5
Independent Claim 315 words
A method of measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing two images of a scene containing the points A, B, C and D, usinq one or more cameras of known principal distance, b. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using information derived from said images, principal distance and said known distances by, b1. representing the distance between point A, B and C and the principal point of a camera O as a viewing pyramid, b2. modifying the representation of the pyramid to a three triangle flattened representation, b3. selecting a low estimate Ob 1 for one interior side of a first triangle of said flattened representation, b4. solving the first triangle using image data, principal distance and said known distances, yielding, inter alia, a first calculated value for length OA, given estimate Ob 1 , b5. solving the second triangle using results obtained, b6. solving the third triangle using results obtained, yielding, inter alia, a second calculated value for length OA, b7. subtracting the second calculated value for length OA from the first calculated value for length OA to produce a difference value, b8. revising the value of estimate Ob 1 by adding said difference value to achieve a revised estimate, b9. iterating steps d-h using the revised estimate until said difference value is less than a desired accuracy, and b10. deriving values for camera location using one or more sets of values for distances OA, OB and OC, and c. using the locations of the one or more cameras at the time the images were captured to determine the location of said point D from image data.
Claim 6
Independent Claim 315 words
A method of measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing two images of a scene containing the points A, B, C and D, usinq one or more cameras of known principal distance, b. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using information derived from said images, principal distance and said known distances by, b1. representing the distance between point A, B and C and the principal point of a camera O as a viewing pyramid, b2. modifying the representation of the pyramid to a three triangle flattened representation, b3. selecting a low estimate Ob 1 for one interior side of a first triangle of said flattened representation, b4. solving the first triangle using image data, principal distance and said known distances, yielding, inter alia, a first calculated value for length OA, given estimate Ob 1 , b5. solving the second triangle using results obtained, b6. solving the third triangle using results obtained, yielding, inter alia, a second calculated value for length OA, b7. subtracting the second calculated value for length OA from the first calculated value for length OA to produce a difference value, b8. revising the value of estimate Ob 1 by adding said difference value to achieve a revised estimate, b9. iterating steps d-h using the revised estimate until said difference value is less than a desired accuracy, and b10. deriving values for camera location using one or more sets of values for distances OA, OB and OC, and c. using the locations of the one or more cameras at the time the images were captured to determine the location of said point D from image data.
Claim 7
Dependent Claim 49 words
The method of claim 3 in which the step of deriving values for camera location using one or more sets of values for distances OA, OB and OC comprises solving simultaneously equations for spheres centered at points A, B and C with respective radii of OA, OB and OC.
Claim 8
Dependent Claim 36 words
The method of claim 3, further comprising: k. determining the orientation of one of more of said cameras by calculating the azimuthal and elevational adjustment required to direct the camera to the location of point A.
Claim 9
Dependent Claim 40 words
The method of claim 5, further comprising: l. determining the orientation of one of more of said cameras by calculating the amount of rotation about the optical axis required to align point B once the camera points at point A.
Claim 10
Dependent Claim 24 words
The method of claim 5 further comprising iterating steps k and l until the degree of alignment is within the desired degree of accuracy.
Claim 11
Dependent Claim 13 words
The method of claim 1 used to measure the distance between two points.
Claim 12
Dependent Claim 13 words
The method of claim 1 used to measure distances in a vertical direction.
Claim 13
Dependent Claim 17 words
The method of claim 1 used to locate physical position accurately of objects visible in said images.
Claim 14
Dependent Claim 26 words
The method of claim 1 used to create a three dimensional wireframe representation or a three dimensional surface model comprising 3 or 4 vertices surface element.
Claim 15
Dependent Claim 15 words
The method of claim 1 used to document the as built condition of an object.
Claim 16
Independent Claim 94 words
A method of measuring the absolute three dimensional location O of a camera with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing an image of a scene containing the points A, B, and C, using a camera, b. determining the principal distance of said camera, c. determining the location of said camera at the time said image was captured with reference to said coordinate system using 3 to 5 points from said image, principal distance and said known distances.
Claim 17
Independent Claim 94 words
A method of measuring the absolute three dimensional location O of a camera with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing an image of a scene containing the points A, B, and C, using a camera, b. determining the principal distance of said camera, c. determining the location of said camera at the time said image was captured with reference to said coordinate system using 3 to 5 points from said image, principal distance and said known distances.
Claim 18
Independent Claim 90 words
A method of measuring the absolute three dimensional location O of a camera with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing an images of a scene containing the points A, B, and C, using a camera of known principal distance, b. determining the location of said camera at the time said image was captured with reference to said coordinate system using 3 to 5 points from said image, principal distance and said known distances.
Claim 19
Independent Claim 90 words
A method of measuring the absolute three dimensional location O of a camera with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. capturing an images of a scene containing the points A, B, and C, using a camera of known principal distance, b. determining the location of said camera at the time said image was captured with reference to said coordinate system using 3 to 5 points from said image, principal distance and said known distances.
Claim 20
Independent Claim 185 words
A method of measuring distance including vertical height comprising: a. measuring the absolute three dimensional location of points D, E and F with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data by: a1. capturing two images of a scene containing the points A, B, C, D, E and F, using one or more cameras of known principal distance, a2. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using points A, B, and C from said images, principal distance and said known distances, a3. using the locations of the one or more cameras at the time the images were captured to determine the locations of said points D, E and F from image data, b. determining distances between points D, E and F, and c. using the location of said points D, E and F and the location of one or more cameras at the time images were captured to determine the location of other points.
Claim 21
Independent Claim 185 words
A method of measuring distance including vertical height comprising: a. measuring the absolute three dimensional location of points D, E and F with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data by: a1. capturing two images of a scene containing the points A, B, C, D, E and F, using one or more cameras of known principal distance, a2. determining the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system using points A, B, and C from said images, principal distance and said known distances, a3. using the locations of the one or more cameras at the time the images were captured to determine the locations of said points D, E and F from image data, b. determining distances between points D, E and F, and c. using the location of said points D, E and F and the location of one or more cameras at the time images were captured to determine the location of other points.
Claim 22
Dependent Claim 44 words
The method of claim 15 in which the locations of points D, E and F are used to determine the location of said other points using image data from images different from those used to determine the location of points D, E and F.
Claim 23
Dependent Claim 142 words
Apparatus for measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. one or more cameras for capturing images of a scene containing the points A, B, C and D, b. means for storing images captured by said one or more cameras, c. means for processing stored images to determine the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system, using 3 to 5 points from said images, principal distance and said known distances, d. means for using the locations of said one or more cameras at the time the images were captured to determine the location of said point D from image data.
Claim 24
Dependent Claim 142 words
Apparatus for measuring the absolute three dimensional location of a point D with respect to a coordinate system defined using three points, A, B and C, separated by known distances using image data comprising: a. one or more cameras for capturing images of a scene containing the points A, B, C and D, b. means for storing images captured by said one or more cameras, c. means for processing stored images to determine the location and orientation of said one or more cameras at the time each of said images was captured with reference to said coordinate system, using 3 to 5 points from said images, principal distance and said known distances, d. means for using the locations of said one or more cameras at the time the images were captured to determine the location of said point D from image data.
Claim 25
Dependent Claim 26 words
Apparatus as claimed in claim 17 in which the location of point D is stored in a database utilized to store a three dimensional wireframe representation.
Claim 26
Dependent Claim 23 words
Apparatus as claimed in claim 18 in which the location of point D is stored in a database of locations of points surveyed.

References Cited (Backward Citations)

US4965840A Cited
US4969106A Cited
US5259037A Cited
US5146346A Cited
US5525883A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2000-12-15 2001-06-16 2001-12-16 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2004-12-15 2005-06-16 2005-12-16 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2008-12-15 2009-06-16 2009-12-16 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag