← Back to Patent Explorer
US5850470A Expired / Lapsed US ⏱️ 0.0 years remaining

Neural network for locating and recognizing a deformable object

Assignee: Siemens Corp
•
Filing: 1995-08-30
•
Granted: 1998-12-15
•
Expires: 2015-08-30
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A system for automatically detecting and recognizing the identity of a deformable object such as a human face, within an arbitrary image scene. The system comprises an object detector implemented as a probabilistic DBNN, for determining whether the object is within the arbitrary image scene and a feature localizer also implemented as a probabilistic DBNN, for determining the position of an identifying feature on the object such as the eyes. A feature extractor is coupled to the feature localizer and receives coordinates sent from the feature localizer which are indicative of the position of the identifying feature and also extracts from the coordinates information relating to other features of the object such as the eyebrows and nose, which are used to create a low resolution image of the object. A probabilistic DBNN based object recognizer for determining the identity of the object receives the low resolution image of the object inputted from the feature extractor to identify the object.

Inventors

  • 👤 Sun-Yuan Kung
  • 👤 Shang-Hung Lin
  • 👤 Long-Ji Lin
  • 👤 Ming Fang

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-01 06:06
CPC Classifications
G; G07; G07C; G07C9/00; G07C9/30; G07C9/32; G07C9/37; G06; G06F; G06F18/00; G06F18/20; G06F18/24; G06F18/241; G06F18/2413; G06F18/24133; G06F18/24137; G06F18/2414; G06F18/2415; G06F18/24155; G06F18/243; G06F18/24317; G06V; G06V10/00; G06V10/20; G06V10/24; G06V40/00; G06V40/10; G06V40/16; G06V40/161; G06V40/164

Claims Analysis

Total Claims: 22
Claim 1
Independent Claim 271 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a decision-based neural network; wherein said decision-based neural network comprises a one-class-in-one network structure having a plurality of subnets and a plurality of classes, wherein each one of said subnets is designated to one of said classes in order to distinguish it from said other classes; and wherein said decision-based neural network includes a training scheme having a first phase and a second phase, wherein said first phase includes individually training each of said subnets without mutually exchanging information between said classes and said second phase includes reinforcing learning and anti-reinforcing learning obtained during said first phase.
Claim 2
Independent Claim 271 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a decision-based neural network; wherein said decision-based neural network comprises a one-class-in-one network structure having a plurality of subnets and a plurality of classes, wherein each one of said subnets is designated to one of said classes in order to distinguish it from said other classes; and wherein said decision-based neural network includes a training scheme having a first phase and a second phase, wherein said first phase includes individually training each of said subnets without mutually exchanging information between said classes and said second phase includes reinforcing learning and anti-reinforcing learning obtained during said first phase.
Claim 3
Dependent Claim 60 words
The system according to claim 1, wherein said decision-based neural network comprises a probabilistic decision-based neural network, said reinforcing and anti-reinforcing learning being provided by a training pattern X.sup.(m) belonging to a class and: φ(x.sup.(m), w.sub.j.sup.(m))>φ(x.sup.(m), w.sub.l.sup.(m)), ∀l≠j wherein reinforced learning is performed according to: w.sub.i.sup.(m+1) =w.sub.i.sup.(m) +η∇φ(x, w.sub.i) and antireinforced learning is performed according to: w.sub.j.sup.(m+1) =w.sub.j.sup.(m) -η∇φ(x, w.sub.j).
Claim 4
Dependent Claim 57 words
The system according to claim 1, wherein said decision-based neural network comprises a probabilistic decision-based neural network that includes a plurality of probabilistic outputs, each of which have a threshold value which is trained according to an adaptive learning rule: T.sub.i.sup.(j+1) =T.sub.i.sup.(j) -ηl'(d) if x.di-elect cons.ω.sub.i (reinforced learning) T.sub.i.sup.(j+1) =T.sub.i.sup.(j) +ηl'(d) if x.epsilon slash.ω.sub.i (antireinforced learning). 4.
Claim 5
Independent Claim 209 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of subnets, each of said subnets having a plurality of cluster basis functions which include cluster prior probabilities according to: ##EQU18##
Claim 6
Independent Claim 209 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of subnets, each of said subnets having a plurality of cluster basis functions which include cluster prior probabilities according to: ##EQU18##
Claim 7
Independent Claim 205 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of subnets, each of said subnets includes a plurality of elliptic basis functions according to: ##EQU19##
Claim 8
Independent Claim 205 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of subnets, each of said subnets includes a plurality of elliptic basis functions according to: ##EQU19##
Claim 9
Independent Claim 204 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of subnets, each of said subnets including a discriminant function which comprises a nonlinearity operator.
Claim 10
Independent Claim 204 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of subnets, each of said subnets including a discriminant function which comprises a nonlinearity operator.
Claim 11
Dependent Claim 20 words
The system according to claim 6, wherein said discriminant function comprises a log operator which approximates a log-likelihood function: ##EQU20##
Claim 12
Dependent Claim 20 words
The system according to claim 6, wherein said discriminant function comprises a normalization operator which approximates a class posterior probability.
Claim 13
Independent Claim 225 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and further comprising object verifier means implemented as a probabilistic decision-based neural network for verifying the decision of said object recognizer means, said object verifier receiving additional information about said object which is cascaded in sequential processing stages in a hierarchical manner by said object verifier.
Claim 14
Independent Claim 225 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and further comprising object verifier means implemented as a probabilistic decision-based neural network for verifying the decision of said object recognizer means, said object verifier receiving additional information about said object which is cascaded in sequential processing stages in a hierarchical manner by said object verifier.
Claim 15
Independent Claim 205 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of classifier channels each having an output, said outputs being laterally fused by weighting said channels.
Claim 16
Independent Claim 205 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of classifier channels each having an output, said outputs being laterally fused by weighting said channels.
Claim 17
Independent Claim 208 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of classifier channels each having an output, said outputs being laterally fused by class-dependent channel fusion according to: ##EQU21##
Claim 18
Independent Claim 208 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of classifier channels each having an output, said outputs being laterally fused by class-dependent channel fusion according to: ##EQU21##
Claim 19
Independent Claim 208 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of classifier channels each having an output, said outputs being laterally fused by data-dependent channel fusion according to: ##EQU22##
Claim 20
Independent Claim 208 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature locator means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object; wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a probabilistic decision-based neural network; and wherein said probabilistic decision-based neural network comprises a plurality of classifier channels each having an output, said outputs being laterally fused by data-dependent channel fusion according to: ##EQU22##
Claim 21
Independent Claim 261 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature localizer means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object, wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a decision-based one-class-in-one neural network structure having a plurality of subnets and a plurality of classes, wherein each one of said subnets is designated to one of said classes in order to distinguish it from said other classes, wherein said neural network includes a training scheme having a first phase and a second phase, wherein said first phase includes individually training each of said subnets without mutually exchanging information between said classes and said second phase includes reinforcing learning and anti-reinforcing learning obtained during said first phase.
Claim 22
Independent Claim 261 words
A system for automatically detecting and recognizing the identity of a deformable object within an arbitrary image scene, said system comprising: object detector means for determining whether said object is within said arbitrary image scene; feature localizer means for determining the position of an identifying feature on said object, said feature localizer means being coupled to said object detector means; feature extractor means coupled to said feature localizer, for receiving coordinates sent from said feature localizer which are indicative of the position of said identifying feature and for extracting from said coordinates information relating to other features of said object which is used to create a low resolution image of said object; and object recognizer means for determining the identity of said object, said object recognizer means being coupled to said feature extractor means and being operative to receive said low resolution image of said object inputted from said feature extractor means to identify said object, wherein said object detector means, said feature localizer means, and said object recognizer means are each implemented in a decision-based one-class-in-one neural network structure having a plurality of subnets and a plurality of classes, wherein each one of said subnets is designated to one of said classes in order to distinguish it from said other classes, wherein said neural network includes a training scheme having a first phase and a second phase, wherein said first phase includes individually training each of said subnets without mutually exchanging information between said classes and said second phase includes reinforcing learning and anti-reinforcing learning obtained during said first phase.

References Cited (Backward Citations)

US5579444A Cited
US5588091A Cited
US5465308A Cited
US5561718A Cited
US5412738A Cited
US5469512A Cited
US5497430A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2001-12-14 2002-06-15 2002-12-15 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2005-12-14 2006-06-15 2006-12-15 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2009-12-14 2010-06-15 2010-12-15 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag