← Back to Patent Explorer
US6532301B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Object recognition with occurrence histograms

Assignee: Microsoft Technology Licensing LLC
•
Filing: 1999-06-18
•
Granted: 2003-03-11
•
Expires: 2019-06-18
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract This invention is directed toward an object recognition system and process that identifies the location of a modeled object in a search image. This involves first capturing model images of the object whose location is to be identified in the search image. A co-occurrence histogram (CH) is then computed for each model images. A model image CH is computed by generating counts of every pair of pixels whose pixels exhibit colors that fall within the same combination of a series of pixel color ranges and which are separated by a distance falling within the same one of a series of distance ranges. Next, a series of search windows, of a prescribed size, are generated from overlapping portions of the search image. A CH is also computed for each of these search windows using the pixel color and distance ranges established for the model image CHs. A comparison between each model image CH and each search window CH is conducted to assess their similarity. A search window that is associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold is designated as potentially containing the object being sought. This designation can be presumed final, or further refined. This system and process requires that the size of the search window, color ranges and distance ranges be chosen ahead of time. The choice of these parameters can be optimized via a false alarm analysis.

Inventors

  • 👤 John Krumm
  • 👤 Peng Chang

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 10:06
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/40; G06V10/42

Claims Analysis

Total Claims: 76
Claim 1
Independent Claim 161 words
A computer-implemented object recognition process for finding an object being sought in a search image, said object recognition process comprising using a computer to perform the following acts: capturing model images of the object from a plurality of viewpoints around the object; computing a co-occurrence histogram (CH) for each model image; generating a plurality of search windows each comprising a portion of the search image; computing a CH for each search window; assessing a degree of similarity between each model image CH and each of the search window CHs; and designating a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as potentially containing the object being sought; wherein, a CH is computed by generating a count of every possible pair of pixels in an image that exhibit the same combination of a prescribed pixel characteristic and which are separated by the same distance.
Claim 2
Dependent Claim 161 words
A computer-implemented object recognition process for finding an object being sought in a search image, said object recognition process comprising using a computer to perform the following acts: capturing model images of the object from a plurality of viewpoints around the object; computing a co-occurrence histogram (CH) for each model image; generating a plurality of search windows each comprising a portion of the search image; computing a CH for each search window; assessing a degree of similarity between each model image CH and each of the search window CHs; and designating a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as potentially containing the object being sought; wherein, a CH is computed by generating a count of every possible pair of pixels in an image that exhibit the same combination of a prescribed pixel characteristic and which are separated by the same distance.
Claim 3
Dependent Claim 36 words
The process of claim 1 , wherein the act of capturing model images of the object comprises the act of capturing the model images from viewpoint spaced at equal angles from each other around the object.
Claim 4
Dependent Claim 120 words
The process of claim 2 , wherein the act of capturing the model images from viewpoint spaced at equal angles from each other around the object, comprises the acts of: selecting a series of candidiate separation angles for spacing said viewpoints around the object; for each candidate separation angle, assessing a degree of similarity between at least one pair of model images having adjacent viewpoints separated by the candidate separation angle; identifying the largest candidate separation angle associated with the model images which has an assessed degree of similarity exceeding a prescribed model image separation angle threshold; and designating the identified largest candidate separation angle as the separation angle to be employed in capturing the model images of the object.
Claim 5
Dependent Claim 35 words
The process of claim 1 , wherein the act of capturing model images of the object comprises the act of capturing each model image from viewpoints located at the same distance away from the object.
Claim 6
Dependent Claim 53 words
The process of claim 1 , wherein the act of capturing model images of the object comprises the act of capturing multiple model images of the object at each viewpoint around the object, and wherein each model image captured at the same viewpoint is captured at a different distance away from the object.
Claim 7
Dependent Claim 50 words
The process of claim 5 , wherein the act of capturing multiple model images of the object at each viewpoint around the object at a different distance away from the object, comprises the act of capturing each of the multiple model images at the same separation distance from each other.
Claim 8
Dependent Claim 129 words
The process of claim 6 , wherein the act of capturing multiple model images of the object at each viewpoint around the object at a different distance away from the object, comprises the acts of: selecting a series of candidate separation distances for spacing said multiple model images from each other at a particular viewpoint; for each candidate separation distance, assessing a degree of similarity between at least one pair of adjacent model images separated by the candidate separation distance, identifying the largest candidate separation distance associated with the model images which has an assessed degree of similarity exceeding a prescribed model image separation distance threshold; and designating the identified largest candidate separation distance as the separation distance to be employed in capturing the model images of the object.
Claim 9
Dependent Claim 211 words
The process of claim 1 , wherein the act of computing a CH for each model image, comprises the acts of: determining said prescribed pixel characteristic exhibited by each pixel in the model image; dividing the overall gamut of said prescribed pixel characteristic into a series of pixel characteristic ranges; respectively quantizing the prescribed pixel characteristic of each pixel in the model image by assigning the pixel to the pixel characteristic range into which the pixel's prescribed characteristic belongs; identifying every possible unique, non-ordered pair of pixels in the model image; respectively quantizing the distance separating the two pixels of each identified pixel pair of the model image by assigning the pixel pair to a one of a series of prescribed distance ranges to which its separation distance belongs, wherein said series of prescribed distance ranges is established by selecting a maximum separation distance of interest and dividing it into a number of smaller distance ranges; categorizing each pixel pair by the assigned pixel characteristic range of each of its respective pixels and the distance range assigned to the pair, wherein the resulting categories are hereinafter referred to as pixel characteristic mix/distance categories; and establishing a count of the number of pixel pairs belonging to the same pixel characteristic mix/distance category.
Claim 10
Dependent Claim 42 words
The process of claim 8 , wherein the act of dividing the overall gamut of said prescribed pixel characteristic into a series of pixel characteristic ranges, comprises the act of dividing the overall gamut into a series of equally-sized pixel characteristic ranges.
Claim 11
Dependent Claim 16 words
The process of claim 8 , wherein the series of distance ranges comprises equally-sized distance ranges.
Claim 12
Dependent Claim 15 words
The process of claim 8 , wherein the prescribed pixel characteristic is the pixel color.
Claim 13
Dependent Claim 23 words
The process of claim 8 , wherein the model image is a depth image and the prescribed pixel characteristic is the pixel depth.
Claim 14
Dependent Claim 46 words
The process of claim 1 , wherein the act of generating the plurality of search windows, comprises the acts of: cordoning off the entire search image into a series of regions having a prescribed size and shape; and designating each region as a separate search window.
Claim 15
Dependent Claim 20 words
The process of claim 13 , wherein the prescribed shape of each region is rectangular, thereby forming rectangular search windows.
Claim 16
Dependent Claim 18 words
The process of claim 13 , wherein each region is of equal size, thereby forming equally-sized search windows.
Claim 17
Dependent Claim 17 words
The process of claim 13 , wherein each region of the search image overlaps all adjacent regions.
Claim 18
Dependent Claim 49 words
The process of claim 16 , wherein each region of the search image overlaps its adjacent regions by one half of its width if the adjacent regions are beside the overlapping region, and by one-half of its height if the adjacent regions are above or below the overlapping region.
Claim 19
Dependent Claim 166 words
The process of claim 8 , wherein the act of computing the CH for each search window, comprises the acts of: respectively quantizing the prescribed pixel characteristic of those pixels of the search window having a prescribed pixel characteristic falling within one of the pixel characteristic ranges by assigning the pixel to the pixel characteristic range into which the pixel's prescribed characteristic belongs; identifying every possible unique, non-ordered pair of pixels in the search window; respectively quantizing the distance separating the two pixels of those identified pixel pairs of the search window having separation distances that fall within one of the distance ranges by assigning the pixel pair to the distance range to which its separation distance belongs; categorizing each pixel pair having quantized pixel characteristics and distance by the assigned pixel characteristic range of each of its respective pixels and the distance range assigned to the pair, and establishing a count of the number of categorized pixel pairs having the same pixel characteristic mix/distance category.
Claim 20
Dependent Claim 93 words
The process of claim 18 , wherein the act of assessing the degree of similarity between each model image CH and each of the search window CHs comprises, for each model image and search window assessed, the acts of: comparing the count for each pixel characteristic mix/distance category of the model image to the count for the corresponding pixel characteristic mix/distance category of the search window; identify the smaller of the two counts in each corresponding category; and add the identified smaller count from each corresponding category together to produce a similarity value.
Claim 21
Dependent Claim 82 words
The process of claim 19 , wherein the act of designating a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as potentially containing the object being sought, comprises the act of designating a search window as potentially containing the object being sought if the similarity value computed for the search window CH and one of the model image CHs exceeds the prescribed search threshold.
Claim 22
Dependent Claim 97 words
The process of claim 20 , wherein the act of designating a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as potentially containing the object being sought, comprises the act of designating each search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds the prescribed search threshold, whenever it is anticipated that there will be more than one of the sought after objects in the search image.
Claim 23
Dependent Claim 28 words
The process of claim 21 , further comprising the act of declaring each search window designated as potentially containing the object being sought as actually containing the object.
Claim 24
Dependent Claim 107 words
The process of claim 20 , wherein the act of designating a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as potentially containing the object being sought, comprises the acts of: determining which of the search windows associated with a search window CH having a degree of similarity to one of the model image CHs that exceeds the prescribed search threshold has the largest computed similarity value; and designating only said search window determined to be associated with the largest similarity value as potentially containing the object being sought.
Claim 25
Dependent Claim 29 words
The process of claim 23 , further comprising the act of declaring the sole search window designated as potentially containing the object being sought as actually containing the object.
Claim 26
Dependent Claim 281 words
The process of claim 1 , further comprising, for each search window designated as potentially containing the object being sought, the acts of: (a) naming the search window designated as potentially containing the object being sought the current primary search window; (b) generating additional search windows having the same shape and size as the current primary search window from portions of the search image which are translated in comparison to the portion of the search image associated with the primary search window; (c) computing a CH for each of the additional search windows; (d) assessing the degree of similarity between each additional search window CH and the model image CH associated with the primary search window; (e) determining whether any of the additional search windows have a higher degree of similarity to the model image CH associated with the primary search window than the primary search window itself; (f) whenever none of the additional search windows has a higher degree of similarity to the model image CH associated with the primary search window than the primary search window itself, declaring the current primary search window as actually containing the object being sought; (g) whenever one or more of the additional search windows has a higher degree of similarity to the model image CH associated with the currently named primary search window than that primary search window itself, naming the additional search window having the highest degree of similarity to the model image CH associated with the previously named primary search window as the current primary search window in place of the previously named primary search window; and (h) repeating acts (b) through (g) for each newly named current primary search window.
Claim 27
Dependent Claim 59 words
The process of claim 25 , wherein the act of generating additional search windows comprises the act of using portions of the search image translated in as many of the following directions as possible: (i) one pixel row up, (ii) one pixel row down; (iii) one pixel column to the right; and (iv) one pixel column to the left.
Claim 28
Dependent Claim 167 words
The process of claim 19 , wherein the scale of the search image is different from that of the model image, and wherein the process further comprises: performing, prior to the act of quantizing the separation distances of the pixel pairs, the act of multiplying the distance ranges computed for the model image by a factor representing the ratio of the search image scale to the model image scale; and wherein the act of comparing the count for each pixel characteristic mix/distance category of the model image to the count for the corresponding pixel characteristic mix/distance category of the search window comprises comparing the count for each pixel characteristic mix/distance category of the model image to the count for the pixel characteristic mix/distance category of the search window associated with the same mix of pixel characteristic ranges but with a distance range corresponding the distance range of the model image multiplied by the factor representing the ratio of the search image scale to the model image scale.
Claim 29
Dependent Claim 248 words
An object recognition system for finding an object being sought in a search image, comprising: a general purpose computing device; a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, capture model images of the object from a plurality of viewpoints around the object; compute a co-occurrence histogram (CH) for each model image, wherein a model image CH is computed by generating counts of every pair of pixels whose pixels exhibit a prescribed pixel characteristic that fall within the same combination of a series of pixel characteristic ranges and which are separated by a distance falling within the same one of a series of distance ranges; generating a plurality of search windows each comprising a portion of the search image; computing a CH for each search window, wherein a search window CH is computed by generating counts of every pair of pixels whose pixels exhibit a prescribed pixel characteristic that fall within the same combination of said series of pixel characteristic ranges and which are separated by a distance falling within the same one of said series of distance ranges; assess a degree of similarity between each model image CH and each of the search window CHs; and designate a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as containing the object being sought.
Claim 30
Dependent Claim 248 words
An object recognition system for finding an object being sought in a search image, comprising: a general purpose computing device; a computer program comprising program modules executable by the computing device, wherein the computing device is directed by the program modules of the computer program to, capture model images of the object from a plurality of viewpoints around the object; compute a co-occurrence histogram (CH) for each model image, wherein a model image CH is computed by generating counts of every pair of pixels whose pixels exhibit a prescribed pixel characteristic that fall within the same combination of a series of pixel characteristic ranges and which are separated by a distance falling within the same one of a series of distance ranges; generating a plurality of search windows each comprising a portion of the search image; computing a CH for each search window, wherein a search window CH is computed by generating counts of every pair of pixels whose pixels exhibit a prescribed pixel characteristic that fall within the same combination of said series of pixel characteristic ranges and which are separated by a distance falling within the same one of said series of distance ranges; assess a degree of similarity between each model image CH and each of the search window CHs; and designate a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as containing the object being sought.
Claim 31
Dependent Claim 37 words
The system of claim 28 , wherein the program module for capturing model images of the object comprises a sub-module for capturing the model images from viewpoint spaced at equal angles from each other around the object.
Claim 32
Dependent Claim 119 words
The system of claim 29 , wherein the sub-module for capturing the model images from viewpoint spaced at equal angles from each other around the object, comprises sub-modules for: selecting a series of candidate separation angles for spacing said viewpoints around the object; for each candidate separation angle, assessing a degree of similarity between at least one pair of model images having adjacent viewpoints separated by the candidate separation angle; identifying the largest candidate separation angle associated with the model images which has an assessed degree of similarity exceeding a prescribed model image separation angle threshold; and designating the identified largest candidate separation angle as the separation angle to be employed in capturing the model images of the object.
Claim 33
Dependent Claim 36 words
The system of claim 28 , wherein the program module for capturing model images of the object comprises a sub-module for capturing each model image from viewpoints located at the same distance away from the object.
Claim 34
Dependent Claim 54 words
The system of claim 28 , wherein the program module for capturing model images of the object comprises a sub-module for capturing multiple model images of the object at each viewpoint around the object, and wherein each model image captured at the same viewpoint is captured at a different distance away from the object.
Claim 35
Dependent Claim 50 words
The system of claim 32 , wherein the sub-module for capturing multiple model images of the object at each viewpoint around the object at a different distance away from the object, comprises a sub-module for capturing each of the multiple model images at the same separation distance from each other.
Claim 36
Dependent Claim 128 words
The system of claim 33 , wherein the sub-module for capturing multiple model images of the object at each viewpoint around the object at a different distance away from the object, comprises sub-modules for: selecting a series of candidate separation distances for spacing said multiple model images from each other at a particular viewpoint; for each candidate separation distance, assessing a degree of similarity between at least one pair of adjacent model images separated by the candidate separation distance; identifying the largest candidate separation distance associated with the model images which has an assessed degree of similarity exceeding a prescribed model image separation distance threshold; and designating the identified largest candidate separation distance as the separation distance to be employed in capturing the model images of the object.
Claim 37
Dependent Claim 211 words
The system of claim 28 , wherein the program module for computing a CH for each model image, comprises sub-modules for: determining said prescribed pixel characteristic exhibited by each pixel in the model image; dividing the overall gamut of said prescribed pixel characteristic into a series of pixel characteristic ranges; respectively quantizing the prescribed pixel characteristic of each pixel in the model image by assigning the pixel to the pixel characteristic range into which the pixel's prescribed characteristic belongs; identifying every possible unique, non-ordered pair of pixels in the model image; respectively quantizing the distance separating the two pixels of each identified pixel pair of the model image by assigning the pixel pair to a one of a series of prescribed distance ranges to which its separation distance belongs, wherein said series of prescribed distance ranges is established by selecting a maximum separation distance of interest and dividing it into a number of smaller distance ranges; categorizing each pixel pair by the assigned pixel characteristic range of each of its respective pixels and the distance range assigned to the pair, wherein the resulting categories are hereinafter referred to as pixel characteristic mix/distance categories; and establishing a count of the number of pixel pairs belonging to the same pixel characteristic mix/distance category.
Claim 38
Dependent Claim 42 words
The system of claim 35 , wherein the sub-module for dividing the overall gamut of said prescribed pixel characteristic into said series of pixel characteristic ranges, comprises a sub-module for dividing the overall gamut into a series of equally-sized pixel characteristic ranges.
Claim 39
Dependent Claim 16 words
The system of claim 35 , wherein the series of distance ranges comprises equally-sized distance ranges.
Claim 40
Dependent Claim 15 words
The system of claim 35 , wherein the prescribed pixel characteristic is the pixel color.
Claim 41
Dependent Claim 45 words
The system of claim 28 , wherein the program module for generating the plurality of search windows, comprises sub-modules for: dividing the entire search image into a series of regions having a prescribed size and shape; and designating each region as a separate search window.
Claim 42
Dependent Claim 20 words
The system of claim 39 , wherein the prescribed shape of each region is rectangular, thereby forming rectangular search windows.
Claim 43
Dependent Claim 18 words
The system of claim 39 , wherein each region is of equal size, thereby forming equally-sized search windows.
Claim 44
Dependent Claim 17 words
The system of claim 39 , wherein each region of the search image overlaps all adjacent regions.
Claim 45
Dependent Claim 166 words
The system of claim 35 , wherein the program module for computing the CH for each search window, comprises sub-modules for: respectively quantizing the prescribed pixel characteristic of those pixels of the search window having a prescribed pixel characteristic falling within one of the pixel characteristic ranges by assigning the pixel to the pixel characteristic range into which the pixel's prescribed characteristic belongs; identifying every possible unique, non-ordered pair of pixels in the search window; respectively quantizing the distance separating the two pixels of those identified pixel pairs of the search window having separation distances that fall within one of the distance ranges by assigning the pixel pair to the distance range to which its separation distance belongs; categorizing each pixel pair having quantized pixel characteristics and distance by the assigned pixel characteristic range of each of its respective pixels and the distance range assigned to the pair; and establishing a count of the number of categorized pixel pairs having the same pixel characteristic mix/distance category.
Claim 46
Dependent Claim 92 words
The system of claim 43 , wherein the sub-module for assessing the degree of similarity between each model image CH and each of the search window CHs comprises, for each model image and search window assessed, sub-modules for: comparing the count for each pixel characteristic mix/distance category of the model image to the count for the corresponding pixel characteristic mix/distance category of the search window; identify the smaller of the two counts in each corresponding category, and add the identified smaller count from each corresponding category together to produce a similarity value.
Claim 47
Dependent Claim 58 words
The system of claim 44 , wherein the program module for designating a search window as containing the object being sought, comprises a sub-module for designating a search window as potentially containing the object being sought if the similarity value computed for the search window CH and one of the model image CHs exceeds the prescribed search threshold.
Claim 48
Dependent Claim 80 words
The system of claim 45 , wherein the program module for designating a search window as containing the object being sought, further comprises a sub-module for designating each search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds the prescribed search threshold as containing the object being sought, whenever it is anticipated that there will be more than one of the sought after objects in the search image.
Claim 49
Dependent Claim 82 words
The system of claim 45 , wherein the program module for designating a search window as containing the object being sought, comprises the acts of: determining which of the search windows associated with a search window CH having a degree of similarity to one of the model image CHs that exceeds the prescribed search threshold has the largest computed similarity value; and designating only said search window determined to be associated with the largest similarity value as containing the object being sought.
Claim 50
Dependent Claim 308 words
The system of claim 28 , further comprising, for each search window designated as containing the object being sought, a program module for refining the location of the search window in the search image, said program module for refining comprising sub-modules for: (a) naming the search window designated as containing the object being sought the current primary search window, (b) generating additional search windows having the same shape and size as the current primary search window from portions of the search image which are translated in comparison to the portion of the search image associated with the primary search window; (c) computing a search window CH for each of the additional search windows; (d) assessing the degree of similarity between each additional search window CH and the model image CH associated with the primary search window; (e) determining whether any of the additional search windows have a higher degree of similarity to the model image CH associated with the primary search window than the primary search window itself; (f) whenever none of the additional search windows has a higher degree of similarity to the model image CH associated with the primary search window than the primary search window itself, declaring the current primary search window as representing the exact location n the search image of the object being sought; (g) whenever one or more of the additional search windows has a higher degree of similarity to the model image CH associated with the currently named primary search window than that primary search window itself, naming the additional search window having the highest degree of similarity to the model image CH associated with the previously named primary search window as the current primary search window in place of the previously named primary search window; and (h) repeating acts (b) through (g) for each newly named current primary search window.
Claim 51
Dependent Claim 59 words
The system of claim 48 , wherein the sub-module for generating additional search windows comprises a sub-module for using portions of the search image translated in as many of the following directions as possible: (i) one pixel row up, (ii) one pixel row down; (iii) one pixel column to the right; and (iv) one pixel column to the left.
Claim 52
Dependent Claim 171 words
The system of claim 44 , wherein the scale of the search image is different from that of the model image, and wherein the system further comprises a program module for: performing, prior to the act of quantizing the separation distances of the pixel pairs, the act of multiplying the distance ranges computed for the model image by a factor representing the ratio of the search image scale to the model image scale; and wherein the act of comparing the count for each pixel characteristic mix/distance category of the model image to the count for the corresponding pixel characteristic mix/distance category of the search window comprises comparing the count for each pixel characteristic mix/distance category of the model image to the count for the pixel characteristic mix/distance category of the search window associated with the same mix of pixel characteristic ranges but with a distance range corresponding the distance range of the model image multiplied by the factor representing the ratio of the search image scale to the model image scale.
Claim 53
Dependent Claim 187 words
A computer readable storage medium for storing an executable computer program in a general purpose computer to perform an object recognition procedure for finding an object being sought in a search image, comprising: a computer program comprising program modules stored in a storage medium, wherein the computer is directed by the program modules to, capture model images of the object from a plurality of viewpoints around the object; compute a co-occurrence histogram (CH) for each model image; generate a plurality of search windows each comprising a portion of the search image; compute a CH for each search window; assess a degree of similarity between each model image CH and each of the search window CHs; and designate a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as containing the object being sought; and wherein, a CH is computed by generating a count of every possible pair of pixels in an image that exhibit the same combination of a prescribed pixel characteristic and which are separated by the same distance.
Claim 54
Dependent Claim 187 words
A computer readable storage medium for storing an executable computer program in a general purpose computer to perform an object recognition procedure for finding an object being sought in a search image, comprising: a computer program comprising program modules stored in a storage medium, wherein the computer is directed by the program modules to, capture model images of the object from a plurality of viewpoints around the object; compute a co-occurrence histogram (CH) for each model image; generate a plurality of search windows each comprising a portion of the search image; compute a CH for each search window; assess a degree of similarity between each model image CH and each of the search window CHs; and designate a search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds a prescribed search threshold as containing the object being sought; and wherein, a CH is computed by generating a count of every possible pair of pixels in an image that exhibit the same combination of a prescribed pixel characteristic and which are separated by the same distance.
Claim 55
Dependent Claim 39 words
The computer-readable storage medium of claim 51 , wherein the program module for capturing model images of the object comprises a sub-module for capturing the model images from viewpoint spaced at equal angles from each other around the object.
Claim 56
Dependent Claim 121 words
The computer-readable storage medium of claim 52 , wherein the sub-module for capturing the model images from viewpoint spaced at equal angles from each other around the object, comprises sub-modules for: selecting a series of candidate separation angles for spacing said viewpoints around the object; for each candidate separation angle, assessing a degree of similarity between at least one pair of model images having adjacent viewpoints separated by the candidate separation angle; identifying the largest candidate separation angle associated with the model images which has an assessed degree of similarity exceeding a prescribed model image separation angle threshold; and designating the identified largest candidate separation angle as the separation angle to be employed in capturing the model images of the object.
Claim 57
Dependent Claim 38 words
The computer-readable storage medium of claim 51 , wherein the program module for capturing model images of the object comprises a sub-module for capturing each model image from viewpoints located at the same distance away from the object.
Claim 58
Dependent Claim 56 words
The computer-readable storage medium of claim 51 , wherein the program module for capturing model images of the object comprises a sub-module for capturing multiple model images of the object at each viewpoint around the object, and wherein each model image captured at the same viewpoint is captured at a different distance away from the object.
Claim 59
Dependent Claim 52 words
The computer-readable storage medium of claim 55 , wherein the sub-module for capturing multiple model images of the object at each viewpoint around the object at a different distance away from the object, comprises a sub-module for capturing each of the multiple model images at the same separation distance from each other.
Claim 60
Dependent Claim 130 words
The computer-readable storage medium of claim 56 , wherein the sub-module for capturing multiple model images of the object at each viewpoint around the object at a different distance away from the object, comprises sub-modules for: selecting a series of candidate separation distances for spacing said multiple model images from each other at a particular viewpoint; for each candidate separation distance, assessing a degree of similarity between at least one pair of adjacent model images separated by the candidate separation distance; identifying the largest candidate separation distance associated with the model images which has an assessed degree of similarity exceeding a prescribed model image separation distance threshold; and designating the identified largest candidate separation distance as the separation distance to be employed in capturing the model images of the object.
Claim 61
Dependent Claim 213 words
The computer-readable storage medium of claim 51 , wherein the program module for computing a CH for each model image, comprises sub-modules for: determining said prescribed pixel characteristic exhibited by each pixel in the model image; dividing the overall gamut of said prescribed pixel characteristic into a series of pixel characteristic ranges; respectively quantizing the prescribed pixel characteristic of each pixel in the model image by assigning the pixel to the pixel characteristic range into which the pixel's prescribed characteristic belongs; identifying every possible unique, non-ordered pair of pixels in the model image; respectively quantizing the distance separating the two pixels of each identified pixel pair of the model image by assigning the pixel pair to a one of a series of prescribed distance ranges to which its separation distance belongs, wherein said series of prescribed distance ranges is established by selecting a maximum separation distance of interest and dividing it into a number of smaller distance ranges; categorizing each pixel pair by the assigned pixel characteristic range of each of its respective pixels and the distance range assigned to the pair, wherein the resulting categories are hereinafter referred to as pixel characteristic mix/distance categories; and establishing a count of the number of pixel pairs belonging to the same pixel characteristic mix/distance category.
Claim 62
Dependent Claim 44 words
The computer-readable storage medium of claim 58 , wherein the sub-module for dividing the overall gamut of said prescribed pixel characteristic into a series of pixel characteristic ranges, comprises a sub-module for dividing the overall gamut into a series of equally-sized pixel characteristic ranges.
Claim 63
Dependent Claim 18 words
The computer-readable storage medium of claim 58 , wherein the series of distance ranges comprises equally-sized distance ranges.
Claim 64
Dependent Claim 17 words
The computer-readable storage medium of claim 58 , wherein the prescribed pixel characteristic is the pixel color.
Claim 65
Dependent Claim 47 words
The computer-readable storage medium of claim 51 , wherein the program module for generating the plurality of search windows, comprises sub-modules for: dividing the entire search image into a series of regions having a prescribed size and shape; and designating each region as a separate search window.
Claim 66
Dependent Claim 22 words
The computer-readable storage medium of claim 62 , wherein the prescribed shape of each region is rectangular, thereby forming rectangular search windows.
Claim 67
Dependent Claim 20 words
The computer-readable storage medium of claim 62 , wherein each region is of equal size, thereby forming equally-sized search windows.
Claim 68
Dependent Claim 19 words
The computer-readable storage medium of claim 62 , wherein each region of the search image overlaps all adjacent regions.
Claim 69
Dependent Claim 168 words
The computer-readable storage medium of claim 58 , wherein the program module for computing the CH for each search window, comprises sub-modules for: respectively quantizing the prescribed pixel characteristic of those pixels of the search window having a prescribed pixel characteristic falling within one of the pixel characteristic ranges by assigning the pixel to the pixel characteristic range into which the pixel's prescribed characteristic belongs; identifying every possible unique, non-ordered pair of pixels in the search window; respectively quantizing the distance separating the two pixels of those identified pixel pairs of the search window having separation distances that fall within one of the distance ranges by assigning the pixel pair to the distance range to which its separation distance belongs; categorizing each pixel pair having quantized pixel characteristics and distance by the assigned pixel characteristic range of each of its respective pixels and the distance range assigned to the pair; and establishing a count of the number of categorized pixel pairs having the same pixel characteristic mix/distance category.
Claim 70
Dependent Claim 94 words
The computer-readable storage medium of claim 66 , wherein the sub-module for assessing the degree of similarity between each model image CH and each of the search window CHs comprises, for each model image and search window assessed, sub-modules for: comparing the count for each pixel characteristic mix/distance category of the model image to the count for the corresponding pixel characteristic mix/distance category of the search window; identify the smaller of the two counts in each corresponding category; and add the identified smaller count from each corresponding category together to produce a similarity value.
Claim 71
Dependent Claim 60 words
The computer-readable storage medium of claim 67 , wherein the program module for designating a search window as containing the object being sought, comprises a sub-module for designating a search window as potentially containing the object being sought if the similarity value computed for the search window CH and one of the model image CHs exceeds the prescribed search threshold.
Claim 72
Dependent Claim 82 words
The computer-readable storage medium of claim 68 , wherein the program module for designating a search window as containing the object being sought, further comprises a sub-module for designating each search window associated with a search window CH having a degree of similarity to one of the model image CHs which exceeds the prescribed search threshold as containing the object being sought, whenever it is anticipated that there will be more than one of the sought after objects in the search image.
Claim 73
Dependent Claim 84 words
The computer-readable storage medium of claim 68 , wherein the program module for designating a search window as containing the object being sought, comprises the acts of: determining which of the search windows associated with a search window CH having a degree of similarity to one of the model image CHs that exceeds the prescribed search threshold has the largest computed similarity value; and designating only said search window determined to be associated with the largest similarity value as containing the object being sought.
Claim 74
Dependent Claim 310 words
The computer-readable storage medium of claim 51 , further comprising, for each search window designated as containing the object being sought, a program module for refining the location of the search window in the search image, said program module for refining comprising sub-modules for: (a) naming the search window designated as containing the object being sought the current primary search window; (b) generating additional search windows having the same shape and size as the current primary search window from portions of the search image which are translated in comparison to the portion of the search image associated with the primary search window; (c) computing a search window CH for each of the additional search windows; (d) assessing the degree of similarity between each additional search window CH and the model image CH associated with the primary search window; (e) determining whether any of the additional search windows have a higher degree of similarity to the model image CH associated with the primary search window than the primary search window itself; (f) whenever none of the additional search windows has a higher degree of similarity to the model image CH associated with the primary search window than the primary search window itself, declaring the current primary search window as representing the exact location n the search image of the object being sought; (g) whenever one or more of the additional search windows has a higher degree of similarity to the model image CH associated with the currently named primary search window than that primary search window itself, naming the additional search window having the highest degree of similarity to the model image CH associated with the previously named primary search window as the current primary search window in place of the previously named primary search window; and (h) repeating acts (b) through (g) for each newly named current primary search window.
Claim 75
Dependent Claim 61 words
The computer-readable storage medium of claim 71 , wherein the sub-module for generating additional search windows comprises a sub-module for using portions of the search image translated in as many of the following directions as possible: (i) one pixel row up, (ii) one pixel row down; (iii) one pixel column to the right; and (iv) one pixel column to the left.
Claim 76
Dependent Claim 173 words
The computer-readable storage medium of claim 67 , wherein the scale of the search image is different from that of the model image, and wherein the system further comprises a program module for: performing, prior to the act of quantizing the separation distances of the pixel pairs, the act of multiplying the distance ranges computed for the model image by a factor representing the ratio of the search image scale to the model image scale; and wherein the act of comparing the count for each pixel characteristic mix/distance category of the model image to the count for the corresponding pixel characteristic mix/distance category of the search window comprises comparing the count for each pixel characteristic mix/distance category of the model image to the count for the pixel characteristic mix/distance category of the search window associated with the same mix of pixel characteristic ranges but with a distance range corresponding the distance range of the model image multiplied by the factor representing the ratio of the search image scale to the model image scale.

References Cited (Backward Citations)

US5608820A Cited
US5671290A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2006-03-10 2006-09-09 2007-03-11 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2010-03-10 2010-09-09 2011-03-11 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2014-03-10 2014-09-09 2015-03-11 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag