US5675663A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Artificial visual system and method for image recognition
Assignee: Honda Motor Co Ltd
•
Filing: 1996-03-21
•
Granted: 1997-10-07
•
Expires: 2016-03-21
Abstract
Abstract An artificial visual apparatus and method for image recognition having a simple adaptive scaling mechanism enables the definition of scale invariant visual icons in a processing area corresponding to the anterior inferotemporal cortex (AIT) in a one-step, value-based decision making process. Icon related activity states resulting from sensory filtering to a fourth stage KL filter corresponding to the V4 area are recognized independent of the scale and position of the item to be recognized within the maximum visual field. The AIT processing area controls the window of attention in the V4 area and confines further processing onto this selected spotlight. The invention presents a biologically plausible method for scale invariant mapping from the V4 stage filter to the AIT processor. Filtering based on principal component analysis (PCA), or Karhunen-Loeve (KL) filtering, yields image data of the item of interest in the V4 stage filter, such data then being supplied to the AIT processor by a scale-invariant mapping process which controls the number of inputs to the KL filters to achieve constant resolution independent of the scale of the item of interest in the maximum visual field. Thus, the problem of scale-invariant mapping is reduced to a simple adaptive thresholding by feedforward inhibition at the AIT processor.
Inventors
- 👤 Edgar Koerner
- 👤 Hiroshi Tsujino
- 👤 Tomohiko Masutani
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-30 04:54
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/164
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
209 words
An artificial visual system comprising: video camera means for picking up a visual image; conversion means for converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized by said visual system, said item occupying a portion of said matrix of pixels; KL (Karhunen-Loeve) filtering means for focusing attention on said item within said matrix of pixels thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; means for supplying pixel information of said item to a memory means, said means for supplying comprising constant resolution filtering means for limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparator means for comparing said pixel information supplied from said means for supplying with stored data in said memory means of a similar item in order to recognize said pixel information as corresponding to said item; and means for triggering formation of an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 2
Dependent Claim
209 words
An artificial visual system comprising: video camera means for picking up a visual image; conversion means for converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized by said visual system, said item occupying a portion of said matrix of pixels; KL (Karhunen-Loeve) filtering means for focusing attention on said item within said matrix of pixels thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; means for supplying pixel information of said item to a memory means, said means for supplying comprising constant resolution filtering means for limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparator means for comparing said pixel information supplied from said means for supplying with stored data in said memory means of a similar item in order to recognize said pixel information as corresponding to said item; and means for triggering formation of an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 3
Dependent Claim
58 words
An artificial visual system according to claim 1 wherein said constant resolution filtering means limits the number of KL components according to the following equation (1) such that, RF=C (1) wherein R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, and C is a constant.
Claim 4
Dependent Claim
84 words
An artificial visual system according to claim 1 or claim 2, wherein said constant resolution filtering means limits the number of KL components to a predetermined number M depending on the input, based on the following equation (2), such that, ##EQU5## wherein R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, ActPCA(i,F) is an activity (vector value) of an i-th principal component of said frequency F, and C is a constant.
Claim 5
Dependent Claim
42 words
An artificial visual system according to claim 1, wherein said KL filtering means comprises a plurality of KL filter systems interconnected together, each KL filter system defining said item as a plurality of vectors defined by a predetermined number of KL components.
Claim 6
Dependent Claim
22 words
An artificial visual system according to claim 4, wherein said plurality of KL filter systems comprises first through fourth KL filter systems.
Claim 7
Dependent Claim
32 words
An artificial visual system according to claim 5, wherein an output from at least one of said first through fourth KL filter systems is supplied as an input to said memory means.
Claim 8
Dependent Claim
26 words
An artificial visual system according to claim 1, further comprising a low pass filter for low pass filtering said image processed by said KL filtering means.
Claim 9
Dependent Claim
30 words
An artificial visual system according to claim 1, wherein a pre-attentive processing means defines said visual image containing at least one item therein to be recognized by said visual system.
Claim 10
Dependent Claim
29 words
An artificial visual system according to claim 8, wherein said pre-attentive processing means determines a window of attention within said visual image by low pass filtering and/or color filtering.
Claim 11
Dependent Claim
50 words
An artificial visual system according to claim 9, further comprising means for supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to said KL filtering means, to enable more refined filtering of said window of attention identified by said pre-attentive processing means.
Claim 12
Dependent Claim
77 words
An artificial visual system according to claim 9, further comprising means for supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to a control means for controlling said video camera to thereby cause said video camera to zoom or selectively scan an area within said image identified by the triggered icon so as to optimize a matching of the triggered icon with respective outputs from said KL filtering means.
Claim 13
Independent Claim
182 words
A method for image recognition based on adaptive scaling including the steps of: picking up a visual image; converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized, said item occupying a portion of said matrix of pixels; filtering said image through KL (Karhunen-Loeve) filtering to focus attention on said item within said matrix of pixels, thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; supplying pixel information of said item to a memory means while limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparing the supplied pixel information with stored data of a similar item in order to recognize said pixel information as corresponding to said item; and triggering an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 14
Independent Claim
182 words
A method for image recognition based on adaptive scaling including the steps of: picking up a visual image; converting said visual image into a matrix of pixels, said visual image containing at least one item therein to be recognized, said item occupying a portion of said matrix of pixels; filtering said image through KL (Karhunen-Loeve) filtering to focus attention on said item within said matrix of pixels, thereby defining said item as a plurality of vectors defining a sub-space of said item within said image, each of said vectors being defined by a predetermined number of KL components; supplying pixel information of said item to a memory means while limiting the number of KL components per vector in order to maintain a resolution of said item at a predetermined constant resolution; comparing the supplied pixel information with stored data of a similar item in order to recognize said pixel information as corresponding to said item; and triggering an icon representing said item when a result of the comparison indicates an agreement between said pixel information of said item and said stored data.
Claim 15
Dependent Claim
51 words
A method for image recognition according to claim 12, wherein the constant resolution is maintained according to the following equation (1): RF=C (1) where R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, and C is a constant.
Claim 16
Dependent Claim
83 words
A method for image recognition according to claim 12 or 13, wherein the constant resolution is maintained by limiting the number of KL components to a predetermined number M depending on the input according to the following equation (2): ##EQU6## where R is a radius of a window of attention circumscribing said item, F is a maximum frequency of said window of attention, ActPCA(i,F) is an activity (vector value) of an i-th principal component of the frequency F, and C is a constant.
Claim 17
Dependent Claim
44 words
A method for image recognition according to claim 12, wherein said step of filtering includes filtering said image through a plurality of interconnected KL filters, each KL filter defining said item as a plurality of vectors each having a predetermined number of KL components.
Claim 18
Dependent Claim
22 words
A method for image recognition according to claim 15, wherein said plurality of KL filters comprises first through fourth KL filter systems.
Claim 19
Dependent Claim
33 words
A method for image recognition according to claim 12, wherein an output from at least one of said first through fourth KL filter systems is supplied as an input to said memory means.
Claim 20
Dependent Claim
40 words
A method for image recognition according to claim 12, further comprising a step of low pass and/or color filtering said image processed in said KL filtering step so as to pre-attentively select a window of attention within said visual image.
Claim 21
Dependent Claim
47 words
A method for image recognition according to claim 18, further comprising a step of supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to said KL filtering step, to enable more refined KL filtering of said window of attention.
Claim 22
Dependent Claim
86 words
A method for image recognition according to claim 18, further comprising a step of supplying a feedback signal from said memory means, following triggering of said icon in said memory means, to a control means for controlling a video camera that is picking up said visual image to thereby cause said video camera to zoom or selectively scan an area within said image identified by the triggered icon so as to optimize a matching of the triggered icon with respective outputs from said KL filtering step.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-10-06 | 2001-04-07 | 2001-10-07 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-10-06 | 2005-04-07 | 2005-10-07 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-10-06 | 2009-04-07 | 2009-10-07 | $7700.00 | Window Closed / Lapsed |