Patent US5612928A successfully refreshed from Google Patents.
US5612928A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for classifying objects in sonar images
Assignee: Northrop Grumman Systems Corp
•
Filing: 1992-05-28
•
Granted: 1997-03-18
•
Expires: 2012-05-28
Abstract
Abstract A method and apparatus for classifying objects in images utilize means for selecting portions of those images which contain objects and means for classifying those objects based upon parameters of the selected portions, which parameters are useful for classifying the objects. The selecting means preferably is a shadow and highlight detector, a statistical window detector and a neural network window detector whose output is combined in a combined cuer. The parameters are determined from the greylevels and positions of pixels using one or more modules which perform certain mathematical operations on this data. Such parameters include edge parameters, smoothness, clutter, presence and characteristics of highlights and shadows, and texture. The invention is particularly useful for classifying objects in sonar images as natural or man-made.
Inventors
- 👤 Paul H. Haley
- 👤 James J. Oravec
- 👤 Walter J. Petlevich, Jr.
- 👤 Philipp F. Schweizer
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 01:20
CPC Classifications
G; G06; G06V; G06V10/00; G06V10/40
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
100 words
A scene classifier for classifying objects in images consisting of a matrix of pixels, each pixel having a known greyness level comprising: (a) snippet selection means for selecting portions of images for classification; (b) a scene classifier connected to and receiving input from the snippet selection means, said scene classifier containing (i) at least two parameter extraction modules selected from the group consisting of edge parameter module, smoothness module, frame parameter module, cuer detection module, highlight and shadow module and texture module, and (ii) a Bayesian Classifier connected to and receiving input from said at least two parameter extraction modules.
Claim 2
Dependent Claim
100 words
A scene classifier for classifying objects in images consisting of a matrix of pixels, each pixel having a known greyness level comprising: (a) snippet selection means for selecting portions of images for classification; (b) a scene classifier connected to and receiving input from the snippet selection means, said scene classifier containing (i) at least two parameter extraction modules selected from the group consisting of edge parameter module, smoothness module, frame parameter module, cuer detection module, highlight and shadow module and texture module, and (ii) a Bayesian Classifier connected to and receiving input from said at least two parameter extraction modules.
Claim 3
Dependent Claim
36 words
The scene classifier of claim 1 wherein the snippet selection means is comprised of at least one detector selected from the group consisting of shadow and highlight detectors, statistical window detectors and neural network window detectors.
Claim 4
Dependent Claim
53 words
The scene classifier of claim 1 wherein the shipper selection means is comprised of at least two detectors selected from the group consisting of shadow and highlight detectors, statistical window detectors and neural network window detectors and also comprising means for combining outputs received from the detectors for transmission to the scene classifier.
Claim 5
Dependent Claim
28 words
The scene classifier of claim 1 also comprising means for displaying the images with indicia classifying objects within the image, said means being connected to the Bayesian Classifier.
Claim 6
Dependent Claim
25 words
The scene classifier of claim 4 wherein the means for displaying the images is one of a cathode ray tube, a printer and a screen.
Claim 7
Dependent Claim
22 words
The scene classifier of claim 4 wherein the indicia is comprised of at least one line encircling at least one classified object.
Claim 8
Dependent Claim
22 words
The scene classifier of claim 4 wherein the indicia is comprised of at least one word identifying at least one classified object.
Claim 9
Dependent Claim
20 words
The scene classifier of claim 1 wherein the images are sonar images and objects are classified as man-made or natural.
Claim 10
Dependent Claim
25 words
The scene classifier of claim 1 wherein the snippet selection means is comprised of a processing unit and memory for storing programs and intermediate results.
Claim 11
Dependent Claim
40 words
The scene classifier of claim 1 wherein the edge parameter module performs for each snippet at least one of edge detecting, edge thinning, searching for straight lines, recording characteristics of each straight line found, and determining straightness of the snippet.
Claim 12
Dependent Claim
26 words
The scene classifier of claim 1 wherein the smoothness module determines smoothness of a snippet by measuring pixel uniformity in selected directions using selected position patterns.
Claim 13
Dependent Claim
28 words
The scene classifier of claim 1 wherein the frame parameter module determines for each snippet at least one of clutter, image mean, image standard deviation and mean shift.
Claim 14
Dependent Claim
65 words
The scene classifier of claim 1 wherein the cuer detection module determines at least one of a quantity of object detections from the shipper selection means, areas of each shipper, average area of snippets, distances between centroids of nearby snippets, standard deviation based upon said distances, a matrix of second order moments of centroid point distribution and a ratio of eigenvalues derived from the matrix.
Claim 15
Dependent Claim
60 words
The scene classifier of claim 1 wherein the highlight and shadow module determines for each shipper at least one of highlight area, shadow area, highlight extent, shadow extent, average greylevel of highlights, average greylevel of shadows, highlight perimeter, shadow perimeter, highlight blobs, shadow blobs, shadow depth, shadow quality, shadow compactness, number of shadow blobs and area of a shadow blob.
Claim 16
Dependent Claim
32 words
The scene classifier of claim 1 wherein the texture module performs for each shipper convolution with templates to detect dots, lines and edges, computation of co-occurrence matrices, and application of Fourier transforms.
Claim 17
Dependent Claim
24 words
The scene classifier of claim 1 wherein the Bayesian Classifier contains at least one equation for determining that an object is man-made or natural.
Claim 18
Independent Claim
196 words
A method of classifying into at least one category, objects in an image comprised of a matrix of pixels, each pixel having a known greyness level comprising the steps of: a) defining a set of windows, each window comprised of a set of adjacent pixels such that each pixel of the image is included in at least one window; b) classifying each window as a highlight, shadow or background according to the greyness levels of the pixels in each window; c) selecting those windows which have been classified as containing at least one of a highlight and a shadow; d) grouping the selected windows into snippets, each snippet containing at least one selected window; e) determining at least one parameter which is useful for classifying objects in the image and which can be obtained from the greyness levels and position of selected pixels in the image; f) establishing a probability of objects found in an image being within the at least one category based upon the determined parameters; g) examining each shipper for the presence and values of the determined parameters; and h) classifying objects within each snippet by comparing the values to the established probability.
Claim 19
Independent Claim
196 words
A method of classifying into at least one category, objects in an image comprised of a matrix of pixels, each pixel having a known greyness level comprising the steps of: a) defining a set of windows, each window comprised of a set of adjacent pixels such that each pixel of the image is included in at least one window; b) classifying each window as a highlight, shadow or background according to the greyness levels of the pixels in each window; c) selecting those windows which have been classified as containing at least one of a highlight and a shadow; d) grouping the selected windows into snippets, each snippet containing at least one selected window; e) determining at least one parameter which is useful for classifying objects in the image and which can be obtained from the greyness levels and position of selected pixels in the image; f) establishing a probability of objects found in an image being within the at least one category based upon the determined parameters; g) examining each shipper for the presence and values of the determined parameters; and h) classifying objects within each snippet by comparing the values to the established probability.
Claim 20
Dependent Claim
21 words
The method of claim 17 also comprising the step of displaying the image with indicia that classifies objects in the image.
Claim 21
Dependent Claim
21 words
The method of claim 17 wherein the image is a sonar image and the objects are classified as natural or man-made.
Claim 22
Dependent Claim
113 words
The method of claim 17 wherein the at least one parameter is selected from the group of parameters consisting of straight line characteristics, straightness of the snippet, smoothness of the snippet, clutter, image mean, image standard deviation, mean shift, snippet area, average area of snippets, distances between centroids of nearby snippets, standard deviation based upon said distances, a ratio of eigenvalues derived from a matrix of second order moments of centroid point distribution, highlight area, shadow area, highlight extent, shadow extent, average greylevel of highlights, average greylevel of shadows, highlight perimeter, shadow perimeter, highlight blobs, shadow blobs, shadow depth, shadow quality, shadow compactness, number of shadow blobs, area of shadow blobs, and texture.
References Cited (Backward Citations)
US5181254A
Cited
US5214744A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-03-17 | 2000-09-16 | 2001-03-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-03-17 | 2004-09-16 | 2005-03-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-03-17 | 2008-09-16 | 2009-03-18 | $7700.00 | Window Closed / Lapsed |