Patent US9025866B2 successfully refreshed from Google Patents.
US9025866B2
Active / In Force
US
⏱️ 6.6 years remaining
Material recognition from an image
Assignee: Microsoft Technology Licensing LLC
•
Filing: 2013-06-27
•
Granted: 2015-05-05
•
Expires: 2033-06-27
Abstract
Abstract A method of operating a computer system to perform material recognition based on multiple features extracted from an image is described. A combination of low-level features extracted directly from the image and multiple novel mid-level features extracted from transformed versions of the image are selected and used to assign a material category to a single image. The novel mid-level features include non-reflectance based features such as the micro-texture features micro-jet and micro-SIFT and the shape feature curvature, and reflectance-based features including edge slice and edge ribbon. An augmented Latent Dirichlet Allocation (LDA) model is provided as an exemplary Bayesian framework for selecting a subset of features useful for material recognition of objects in an image.
Inventors
- 👤 Ce Liu
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:15
CPC Classifications
G06K9/6229; G; G06; G06V; G06V20/00; G06V20/80; G06F; G06F18/00; G06F18/20; G06F18/21; G06F18/211; G06F18/2111; G06F18/29; G06F18/295; G06K9/00577; G06K9/4671; G06K9/6297; G06V10/00; G06V10/40; G06V10/46; G06V10/462; G06V10/70; G06V10/84; G06V10/85
Claims Analysis
Total Claims: 15
Claim 1
Independent Claim
122 words
A computer system comprising: a processing device, and a memory device storing computer-executable instructions which, when executed by the processing device, cause the processing device to: extract a plurality of features from a plurality of images assigned to a plurality of material categories, wherein the plurality of features comprises at least one reflectance-based feature and at least one non-reflectance based feature; and select a subset of the plurality of features, wherein the subset of the plurality of features is selected by a learning procedure in which combinations of features are analyzed to determine the subset of the plurality of features, wherein the learning procedure is a greedy algorithm that considers contributions of each of the plurality of features in a stepwise manner.
Claim 2
Dependent Claim
122 words
A computer system comprising: a processing device, and a memory device storing computer-executable instructions which, when executed by the processing device, cause the processing device to: extract a plurality of features from a plurality of images assigned to a plurality of material categories, wherein the plurality of features comprises at least one reflectance-based feature and at least one non-reflectance based feature; and select a subset of the plurality of features, wherein the subset of the plurality of features is selected by a learning procedure in which combinations of features are analyzed to determine the subset of the plurality of features, wherein the learning procedure is a greedy algorithm that considers contributions of each of the plurality of features in a stepwise manner.
Claim 3
Dependent Claim
29 words
The computer system of claim 1 , wherein the greedy algorithm is configured to select additional features for the subset of the plurality of features one at a time.
Claim 4
Dependent Claim
24 words
The computer system of claim 2 , wherein the greedy algorithm is further configured to determine separate material recognition rates for the additional features.
Claim 5
Dependent Claim
40 words
The computer system of claim 3 , wherein the greedy algorithm is further configured to select the additional features until an individual material recognition rate of the separate material recognition rates is less than a previous individual material recognition rate.
Claim 6
Dependent Claim
30 words
The computer system of claim 4 , wherein the greedy algorithm is further configured to select the subset of the plurality of features based on maximizing the material recognition rate.
Claim 7
Independent Claim
74 words
A method implemented by one or more computer processing devices, the method comprising: receiving a training set of images assigned to multiple material categories; extracting multiple features from the training set of images; and analyzing combinations of the multiple features using a learning procedure to select a subset of the multiple features, wherein the learning procedure is a greedy algorithm that considers contributions of individual features of the multiple features one at a time.
Claim 8
Independent Claim
74 words
A method implemented by one or more computer processing devices, the method comprising: receiving a training set of images assigned to multiple material categories; extracting multiple features from the training set of images; and analyzing combinations of the multiple features using a learning procedure to select a subset of the multiple features, wherein the learning procedure is a greedy algorithm that considers contributions of individual features of the multiple features one at a time.
Claim 9
Dependent Claim
36 words
The method of claim 6 , further comprising: dividing the training set of images into a first portion used by the learning procedure for training a model and a second portion for evaluation of the model.
Claim 10
Dependent Claim
30 words
The method of claim 7 , further comprising evaluating the model by determining a material recognition rate of the model for the second portion of the training set of images.
Claim 11
Dependent Claim
35 words
The method of claim 8 , further comprising receiving an initial material recognition rate and comparing the determined material recognition rate to the initial material recognition rate to select the subset of the multiple features.
Claim 12
Dependent Claim
19 words
The method of claim 6 , the method further comprising: repeating at least the analyzing for different material categories.
Claim 13
Dependent Claim
120 words
A hardware computer-readable storage medium storing computer readable instructions that, when executed by one or more processing devices, cause the one or more processing devices to perform acts comprising: receiving a set of images assigned to multiple material categories, the images of the set having multiple image features; dividing the set of images into a training set and an evaluation set; joining individual dictionaries of the multiple image features to create a combined dictionary; using the combined dictionary to train a recognition model on the training set to obtain a trained recognition model; and determining a material recognition rate for the trained recognition model based on recognition of individual material categories in the evaluation set by the trained recognition model.
Claim 14
Dependent Claim
120 words
A hardware computer-readable storage medium storing computer readable instructions that, when executed by one or more processing devices, cause the one or more processing devices to perform acts comprising: receiving a set of images assigned to multiple material categories, the images of the set having multiple image features; dividing the set of images into a training set and an evaluation set; joining individual dictionaries of the multiple image features to create a combined dictionary; using the combined dictionary to train a recognition model on the training set to obtain a trained recognition model; and determining a material recognition rate for the trained recognition model based on recognition of individual material categories in the evaluation set by the trained recognition model.
Claim 15
Dependent Claim
97 words
The hardware computer-readable storage medium of claim 11 , the training the model further comprising: extracting the multiple image features from the training set; quantizing individual extracted features; combining the quantized individual extracted features into a single document model; analyzing combinations of the quantized individual extracted features using a learning procedure to select a subset of the multiple image features, wherein the trained recognition model is obtained using the subset of the multiple image features; and assigning an individual material category to another image by comparing the single document model to one or more pre-stored feature distributions.
References Cited (Backward Citations)
US5794788A
Cited
US6711293B1
Cited
US6140643A
Cited
US20020054237A1
Cited
US20040213459A1
Cited
US20050036690A1
Cited
US20070239315A1
Cited
US7706918B2
Cited
US20060133650A1
Cited
US7519200B2
Cited
US20070091320A1
Cited
US20070133866A1
Cited
US20090304280A1
Cited
US20080075361A1
Cited
US20120268612A1
Cited
US8194953B2
Cited
US20090087026A1
Cited
US20090208106A1
Cited
US8311344B2
Cited
US8218913B1
Cited
US20110170768A1
Cited
US20110182477A1
Cited
US8805083B1
Cited
US20110243450A1
Cited
US20140245463A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2018-05-04 | 2018-11-03 | 2019-05-05 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2022-05-04 | 2022-11-03 | 2023-05-05 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2026-05-04 | 2026-11-03 | 2027-05-05 | $7700.00 | Surcharge Window Open |