§
Luxuse
Patent Intelligence
Sign In
← Back to Patent Explorer
US6151592A Expired / Lapsed US ⏱️ 0.0 years remaining

Recognition apparatus using neural network, and learning method therefor

Assignee: Seiko Epson Corp
•
Filing: 1998-01-20
•
Granted: 2000-11-21
•
Expires: 2018-01-20
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A recognition apparatus and method using a neural network is provided. A neuron-like element stores a value of its inner condition. The neuron-like element also updates a values of its internal status on the basis of an output from the neuron-like element itself, outputs from other neuron-like elements and an external input, and an output value generator a value of its internal status into an external output. Accordingly, the neuron-like element itself can retain the history of input data. This enables the time series data, such as speech, to be processed without providing any special devices in the neural network.

Inventors

  • 👤 Mitsuhiro Inazumi

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-29 18:52
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/16

Claims Analysis

Total Claims: 14
Claim 1
Independent Claim 279 words
A recognition apparatus comprising: feature extracting means for extracting values of an input to be recognized and for inputting extracted values into a recurrent neural network, and a learning section for causing said recurrent neural network to learn, the learning section comprising: input data storage means for storing input learning data of a plurality of continuous data streams within a plurality of categories; input data selection means for selecting input learning data of a plurality of continuous data streams to be learned within a plurality of categories from said input data storage means; output data storage means comprising a positive output data storage means and a negative output data storage means for storing output learning data of a plurality of continuous data streams within a plurality of categories each of which corresponds to an input learning data category; output data selection means for selecting output learning data of a plurality of continuous data streams to be learned, each of which corresponds to an input learning data category selected by said input data selection means from said output data storage means; input data connecting means for connecting the input learning data selected by said input data selection means into a single continuous data stream; output data connecting means for connecting the output learning data selected by said output data selection means into a single continuous data stream in correlation with the connection of said input learning data; and learning control means for inputting said connected input learning data stream into said feature extracting means and for changing weightings at connections of neuron elements on the basis of outputs of said recurrent neural network and said connected output learning data stream.
Claim 2
Dependent Claim 279 words
A recognition apparatus comprising: feature extracting means for extracting values of an input to be recognized and for inputting extracted values into a recurrent neural network, and a learning section for causing said recurrent neural network to learn, the learning section comprising: input data storage means for storing input learning data of a plurality of continuous data streams within a plurality of categories; input data selection means for selecting input learning data of a plurality of continuous data streams to be learned within a plurality of categories from said input data storage means; output data storage means comprising a positive output data storage means and a negative output data storage means for storing output learning data of a plurality of continuous data streams within a plurality of categories each of which corresponds to an input learning data category; output data selection means for selecting output learning data of a plurality of continuous data streams to be learned, each of which corresponds to an input learning data category selected by said input data selection means from said output data storage means; input data connecting means for connecting the input learning data selected by said input data selection means into a single continuous data stream; output data connecting means for connecting the output learning data selected by said output data selection means into a single continuous data stream in correlation with the connection of said input learning data; and learning control means for inputting said connected input learning data stream into said feature extracting means and for changing weightings at connections of neuron elements on the basis of outputs of said recurrent neural network and said connected output learning data stream.
Claim 3
Dependent Claim 129 words
The recognition apparatus as in claim 1, the recurrent neural network comprising layered and partially recurrent components comprising output limiting type, dynamic neuron elements, each of the neuron elements comprising: internal state value storage means, for storing a current internal state value, said storage means comprising an integrator for integrating accumulated values; internal state value updating means for inputting accumulated values into said internal state value storage means comprising a weighted accumulator for performing weighted accumulations of input values to said dynamic neuron element and the current internal state value; and an output value limiter for converting said internal state value into an external output value between an upper preset limit and a lower preset limit, said integrator and accumulator forming a feedback loop in said dynamic neuron element.
Claim 4
Dependent Claim 17 words
The recognition apparatus as in claim 1, wherein the number of said categories is equal to 2.
Claim 5
Dependent Claim 82 words
The recognition apparatus as in claim 1, wherein said learning section further comprises: noise data storage means for storing noise data; noise overlaying means for overlaying said selected input learning data with the noise data from noise data storage means, the selected input learning data overlaid with the noise data by said noise overlying means causing said recurrent neural network to learn; and means for shifting said noise data to different overlaying positions on said selected input learning data to repeat learning.
Claim 6
Dependent Claim 41 words
The recognition apparatus as in claim 4, further comprising: means for training the recurrent neural network to learn selected input learning data not overlaid with the noise data, and selected portions of the input learning data overlaid with the noise data.
Claim 7
Dependent Claim 45 words
The recognition apparatus as in claim 1, further comprising a limiter for converting an internal state value into an external output value between an upper preset limit and a lower preset limit and outputting a symmetrical range of values in both positive and negative directions.
Claim 8
Dependent Claim 29 words
The recognition apparatus as in claim 1, wherein said recurrent neural network has a plurality of outputs each of which is corresponding to a said input learning data category.
Claim 9
Independent Claim 200 words
A method for recognizing signals, comprising: extracting values of an input to be recognized; inputting the extracted values into a recurrent neural network; storing input learning data of a plurality of continuous data streams within a plurality of categories; selecting input learning data of a plurality of continuous data streams to be learned within a plurality of categories; storing positive output learning data of a plurality of continuous data streams within a plurality of categories corresponding to an input learning data category; storing negative output learning data of a plurality of continuous data streams within a plurality of categories corresponding to an input learning data category; selecting output learning data of a plurality of continuous data streams to be learned, each of which corresponds to an input learning data category; connecting the selected input learning data into a single continuous data stream; connecting the selected output learning data into a single continuous data stream in correlation with the connection of said input learning data; inputting said connected input learning data stream to the extraction step; and changing weightings at connections of neuron elements on the basis of outputs of said recurrent neural network and said connected output learning data streams.
Claim 10
Independent Claim 200 words
A method for recognizing signals, comprising: extracting values of an input to be recognized; inputting the extracted values into a recurrent neural network; storing input learning data of a plurality of continuous data streams within a plurality of categories; selecting input learning data of a plurality of continuous data streams to be learned within a plurality of categories; storing positive output learning data of a plurality of continuous data streams within a plurality of categories corresponding to an input learning data category; storing negative output learning data of a plurality of continuous data streams within a plurality of categories corresponding to an input learning data category; selecting output learning data of a plurality of continuous data streams to be learned, each of which corresponds to an input learning data category; connecting the selected input learning data into a single continuous data stream; connecting the selected output learning data into a single continuous data stream in correlation with the connection of said input learning data; inputting said connected input learning data stream to the extraction step; and changing weightings at connections of neuron elements on the basis of outputs of said recurrent neural network and said connected output learning data streams.
Claim 11
Dependent Claim 22 words
The method for recognizing signals as in claim 8, wherein the number of said input learning data categories is equal to two.
Claim 12
Dependent Claim 60 words
The method for recognizing signals as in claim 8, further comprising: storing noise data; overlaying said selected input learning data with noise data selected from the stored noise data, the selected input learning data overlaid with the noise data causing said recurrent neural network to learn so that said noise data contained in said input learning data can be differentiated.
Claim 13
Dependent Claim 28 words
The method for recognizing signals as in claim 10, further comprising shifting said noise data to different overlaying positions on said selected input learning data to repeat learning.
Claim 14
Dependent Claim 37 words
The method for recognizing signals as in claim 10, wherein selected input learning data not overlaid with the noise data and selected portions of the input learning data overlaid with the noise data are used for learning.

References Cited (Backward Citations)

US5175794A Cited
EP0318858A2 Cited
JPH0272398A Cited
US5040215A Cited
JPH0281160A Cited
US5093899A Cited
US5185848A Cited
US5297237A Cited
US5119469A Cited
US5150323A Cited
US5627942A Cited
EP0435282B1 Cited
US5182794A Cited
JPH04295897A Cited
JPH04295894A Cited
EP0510632A2 Cited
US5787393A Cited
US5809461A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-11-21 2004-05-22 2004-11-21 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-11-21 2008-05-22 2008-11-21 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-11-21 2012-05-22 2012-11-21 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag