← Back to Patent Explorer
US6094501A Expired / Lapsed US ⏱️ 0.0 years remaining

Determining article location and orientation using three-dimensional X and Y template edge matrices

Assignee: Shell USA Inc
•
Filing: 1998-04-30
•
Granted: 2000-07-25
•
Expires: 2018-04-30
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method to identify the location and orientation of an article is provided, the method comprising the steps of: obtaining an image of the article with the article having a known orientation and location relative to a camera; creating a X and Y template edge matrix from the image of the article; creating a plurality of sets of modified template edge matrices, each of the sets of modified template edge matrices being a X and Y template edge matrix with the article in a different orientation; capturing an digital visual image containing the article, the digital image being a matrix of pixels; creating X and Y article edge matrices from the matrix of pixels; quantifying difference between each of the sets of modified template edge matrices and the X and Y article edge matrices with the modified template edge matrices placed at a plurality of locations within the bounds of the article edge matrices; and identifying the location and orientation of the article as the orientation of the article represented by the set of modified template edge matrices at the location within the bounds of the X and Y article edge matrices with the minimal quantified differences between the modified template edge matrices and the X and Y article edge matrices wherein a plurality of images are obtained and three dimensional images are created of the article in both the known and the unknown position. The three dimensional images are used either in the initial matching of the article, or to verify a position and orientation of the article in the article determined from matching two dimensional images.

Inventors

  • 👤 David Andrew Beatty

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 09:59
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/70; G06V10/74; G06V10/75; G06V10/751; G06V10/7515

Claims Analysis

Total Claims: 11
Claim 1
Independent Claim 363 words
A method to identify the location and orientation of an article, the article placed on a surface, the method comprising the steps of: obtaining an plurality of images of the article with the article having a known orientation and location relative to a camera with the plurality of images representing views from a plurality of positions; creating X and Y template edge matrices from each of the images of the article; creating a three dimensional X edge matrix from the plurality of X template edge matrices; creating a three dimensional Y edge matrix from the plurality of Y template edge matrices; creating a plurality of sets of modified three dimensional template edge matrices, each of the sets of modified three dimensional template edge matrices being a three dimensional X or Y template edge matrix with the article in a different orientation; obtaining an plurality of images of the article with the article having a unknown orientation or location relative to a camera with the plurality of images representing views from a plurality of positions; creating X and Y edge matrices from each of the images of the article in an unknown orientation and location; creating a three dimensional X edge matrix from the plurality of X edge matrices with the article in an unknown orientation and location; creating a three dimensional Y edge matrix from the plurality of Y edge matrices with the article in an unknown orientation and location; quantifying difference between each of the sets of modified three dimensional template edge matrices and the three dimensional X and Y edge matrices of the article in an unknown orientation and location with the modified three dimensional template edge matrices placed at a plurality of locations within the bounds of the three dimensional edge matrices of the article in an unknown orientation and location; and identifying the location and orientation of the article as the location and orientation of the article represented by the set of modified three dimensional template edge matrices with the minimal quantified differences between the modified three dimensional template edge matrices and the three dimensional X and Y edge matrices of the article in an unknown orientation and location.
Claim 2
Independent Claim 363 words
A method to identify the location and orientation of an article, the article placed on a surface, the method comprising the steps of: obtaining an plurality of images of the article with the article having a known orientation and location relative to a camera with the plurality of images representing views from a plurality of positions; creating X and Y template edge matrices from each of the images of the article; creating a three dimensional X edge matrix from the plurality of X template edge matrices; creating a three dimensional Y edge matrix from the plurality of Y template edge matrices; creating a plurality of sets of modified three dimensional template edge matrices, each of the sets of modified three dimensional template edge matrices being a three dimensional X or Y template edge matrix with the article in a different orientation; obtaining an plurality of images of the article with the article having a unknown orientation or location relative to a camera with the plurality of images representing views from a plurality of positions; creating X and Y edge matrices from each of the images of the article in an unknown orientation and location; creating a three dimensional X edge matrix from the plurality of X edge matrices with the article in an unknown orientation and location; creating a three dimensional Y edge matrix from the plurality of Y edge matrices with the article in an unknown orientation and location; quantifying difference between each of the sets of modified three dimensional template edge matrices and the three dimensional X and Y edge matrices of the article in an unknown orientation and location with the modified three dimensional template edge matrices placed at a plurality of locations within the bounds of the three dimensional edge matrices of the article in an unknown orientation and location; and identifying the location and orientation of the article as the location and orientation of the article represented by the set of modified three dimensional template edge matrices with the minimal quantified differences between the modified three dimensional template edge matrices and the three dimensional X and Y edge matrices of the article in an unknown orientation and location.
Claim 3
Dependent Claim 57 words
The method of claim 1 wherein, prior to quantifying difference between the modified three dimensional X and Y template edge matrices and the three dimensional X and Y edge matrices with the article in an unknown orientation and position, portions of the three dimensional X and Y article edge matrices that are at the surface are deleted.
Claim 4
Dependent Claim 23 words
The method of claim 1 wherein three images of the article in the known and in the unknown portions and orientation are captured.
Claim 5
Dependent Claim 131 words
The method of claim 1 further comprising the steps of smoothing the modified template edge matrices and the three dimensional X and Y edge matrices by averaging adjacent pixels and subsampling to obtain reduced matrices with a reduced number of pixels; quantifying the difference between each of the reduced modified template edge matrices and the reduced article edge matrices with the reduced modified template edge matrices placed at a plurality of locations within the bounds of the article edge matrices; and quantifying the difference between each of the sets of modified template edge matrices and the three dimensional X and Y edge matrices with the modified template edge matrices placed at a plurality of locations only for locations near the location and the orientation having minimum differences between the reduced matrices.
Claim 6
Dependent Claim 29 words
The method of claim 1 wherein the edge matrices are obtained by applying to the image to obtain horizontal and vertical edge matrices respectively the operators: ##EQU15## and; ##EQU16##
Claim 7
Dependent Claim 33 words
The method of claim 1 wherein a plurality of modified three dimensional template edge matrices are created with the template edge matrices transformed to represent different angles from normal to the optical axis.
Claim 8
Dependent Claim 40 words
The method of claim 1 wherein portions of the modified three dimensional template edge matrices outside of outlines of the article are ignored when quantifying the difference between each of the modified template edge matrices and the article edge matrices.
Claim 9
Dependent Claim 33 words
The method of claim 1 wherein the plurality of locations is every contiguous set of pixels within the three dimensional edge matrices within which a modified three dimensional template edge matrices will fit.
Claim 10
Dependent Claim 49 words
The method of claim 4 wherein the plurality of locations for which the difference between each of the reduced modified three dimensional template edge matrices and the reduced three dimensional edge matrices are quantified include every contiguous set of pixels within the reduced modified template edge matrices will fit.
Claim 11
Dependent Claim 38 words
The method of claim 1 wherein the edge matrices are obtained by applying to the image to obtain horizontal edge matrices by the minimum of: and ##EQU17## and vertical edge matrices by the minimum of: ##EQU18## and ##EQU19##

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-07-25 2004-01-24 2004-07-25 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-07-25 2008-01-24 2008-07-25 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-07-25 2012-01-24 2012-07-25 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag