← Back to Patent Explorer
US4868879A Expired / Lapsed US ⏱️ 0.0 years remaining

Apparatus and method for recognizing speech

Assignee: Oki Electric Industry Co Ltd
•
Filing: 1985-03-26
•
Granted: 1989-09-19
•
Expires: 2005-03-26
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract In a speech recognition system for effecting substantially linear matching, a start point of an input speech pattern is detected to start counting the frames of the input speech pattern for updating a speech frame number. Each time the speech frame number is updated, a plurality of frame numbers of reference templates are generated in substantially a linear relationship to the frame number, thus providing a plurality of matching paths between each of the reference templates and the input speech pattern. The distance between the input pattern data and the reference template data between the corresponding frames specified by each matching path is calculated each time the speech frame number is updated. An accumulated value of the distances along a matching path from the start point of the input speech until a desired speech frame is regarded as a dissimilarity, and the dissimilarity corresponding to each matching path in each reference template is calculated each time the speech frame is updated. The number of the reference template which gives a minimum dissimilarity is detected and stored. At the time of confirming an end of the input speech, the number of the reference template with the minimum dissimilarity is determined to be the recognized result of input speech.

Inventors

  • 👤 Makoto Morito
  • 👤 Masao Takeuchi
  • 👤 Akihiko Fujisawa
  • 👤 Yukio Tabei
  • 👤 Keiko Takahashi

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-08 19:21
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/12

Claims Analysis

Total Claims: 16
Claim 1
Independent Claim 575 words
An apparatus for recognizing speech, comprising: a means for frequency analyzing an input speech periodically at each input frame, which is a predetermined time interval, for extracting an input pattern composed of time series information of frequency components in a plurality of channels; a means for spectrally normalizing said components of said input pattern in each of the channels in each frame to generate spectrally normalized data W(i,j); a means for detecting start and end points and a speech sound condition of the input speech based on said spectrally normalized data; and a distance calculating and discriminating means comprising: a reference template memory for storing a plurality of reference templates composed of spectrally normalized data Sn(i,kp) in plural frames and plural channels which are produced by frequency analyzing and spectrally normalizing a plurality of predetermined reference speech samples; an input pattern memory for storing the spectrally normalized data W(i,j) in all of the channels for one frame of the input pattern, output from said spectrally normalizing means; a means for starting counting of a speech frame number j of the input pattern after the start point of the input speech has been detected; a means for updating said speech frame number j every input frame while the input speech is in the speech sound condition; a means for holding said speech frame number j while the input speech is in a silent condition; a means for restarting to update said speech frame number j every input frame when the input speech is again in the speech sound condition before the end point of the input speech is detected; a means for setting plural substantially linear matching paths, each having different slopes, between said input pattern and said reference templates by generating plural path-related frame numbers lp, each of which is related to each of said matching paths, in substantially a linear relationship to said speech frame number j according to the equation ##EQU7## where the denominators C p are plural positive real constants each of which is predetermined with respect to each of said matching paths and [] represents a Gaussian symbol, each time said speech frame number j is updated; a means for generating plural reference template frame numbers kp, each of which is related to each of said matching paths, based on said path-related frame numbers lp and the frame length SL(n) of each reference template each time said speech frame number j is updated, according to the following equation; kp=lp (if lp≦SL(n)) SL(n) (if lp>SL(n)) a means for calculating the distance between the spectrally normalized data W(i,j) of said speech frame number j of said input pattern and the spectrally normalized data Sn(i,kp) of said reference template frame number kp of each reference template in each matching path each time said speech frame number j is updated; a means for calculating a dissimilarity relating to each of the matching paths for each of the reference templates by accumulating said distances each time said speech frame number j is updated; a means for detecting a minimum dissimilarity each time said speech frame number j is updated and storing the number of the reference template corresponding to said minimum dissimilarity; and a means for determining the number of said reference template relating to said minimum dissimilarity stored at the speech frame corresponding to the end point of the input speech as the recognized result of the input speech when said end point is detected.
Claim 2
Independent Claim 575 words
An apparatus for recognizing speech, comprising: a means for frequency analyzing an input speech periodically at each input frame, which is a predetermined time interval, for extracting an input pattern composed of time series information of frequency components in a plurality of channels; a means for spectrally normalizing said components of said input pattern in each of the channels in each frame to generate spectrally normalized data W(i,j); a means for detecting start and end points and a speech sound condition of the input speech based on said spectrally normalized data; and a distance calculating and discriminating means comprising: a reference template memory for storing a plurality of reference templates composed of spectrally normalized data Sn(i,kp) in plural frames and plural channels which are produced by frequency analyzing and spectrally normalizing a plurality of predetermined reference speech samples; an input pattern memory for storing the spectrally normalized data W(i,j) in all of the channels for one frame of the input pattern, output from said spectrally normalizing means; a means for starting counting of a speech frame number j of the input pattern after the start point of the input speech has been detected; a means for updating said speech frame number j every input frame while the input speech is in the speech sound condition; a means for holding said speech frame number j while the input speech is in a silent condition; a means for restarting to update said speech frame number j every input frame when the input speech is again in the speech sound condition before the end point of the input speech is detected; a means for setting plural substantially linear matching paths, each having different slopes, between said input pattern and said reference templates by generating plural path-related frame numbers lp, each of which is related to each of said matching paths, in substantially a linear relationship to said speech frame number j according to the equation ##EQU7## where the denominators C p are plural positive real constants each of which is predetermined with respect to each of said matching paths and [] represents a Gaussian symbol, each time said speech frame number j is updated; a means for generating plural reference template frame numbers kp, each of which is related to each of said matching paths, based on said path-related frame numbers lp and the frame length SL(n) of each reference template each time said speech frame number j is updated, according to the following equation; kp=lp (if lp≦SL(n)) SL(n) (if lp>SL(n)) a means for calculating the distance between the spectrally normalized data W(i,j) of said speech frame number j of said input pattern and the spectrally normalized data Sn(i,kp) of said reference template frame number kp of each reference template in each matching path each time said speech frame number j is updated; a means for calculating a dissimilarity relating to each of the matching paths for each of the reference templates by accumulating said distances each time said speech frame number j is updated; a means for detecting a minimum dissimilarity each time said speech frame number j is updated and storing the number of the reference template corresponding to said minimum dissimilarity; and a means for determining the number of said reference template relating to said minimum dissimilarity stored at the speech frame corresponding to the end point of the input speech as the recognized result of the input speech when said end point is detected.
Claim 3
Dependent Claim 59 words
An apparatus according to claim 1, wherein said means for detecting a minimum dissimilarity and storing the number of the corresponding reference template updates and stores the number of the reference template corresponding to the minimum dissimilarity each time said speech frame is updated; and the number of said matching paths for each of said reference templates is 3.
Claim 4
Dependent Claim 143 words
An apparatus according to claim 2, wherein said distance calculating and discriminating means includes: a means for storing path selection information to specify one of said matching paths at an address specified by each of said speech frame numbers and the number of each said reference templates, and for outputting one of said path selection information to select one of said dissimilarities corresponding to each of said reference templates each time said speech frame number is updated; and said means for detecting a minimum dissimilarity and storing the number of the corresponding reference template, selects dissimilarities out of all of said dissimilarities which correspond to said path selection information, and detects the minimum dissimilarity out of said selected dissimilarities, and updates and stores the number of the reference template correpsonding to said detected minimum dissimilarity, each time said speech frame number is updated.
Claim 5
Dependent Claim 150 words
An apparatus according to claim 2, wherein said distance calculating and discriminating means further comprises: a means for storing path selection information to specify one or two of said matching paths at an address specified by each of said speech frame numbers and the number of each said reference templates, and for outputting one or two of said path selection information to select one or two of said dissimilarities corresponding to each of said reference templates each time said speech frame number is updated; and said means for detecting a minimum dissimilarity and storing the number of the corresponding reference template, selects dissimilarities out of all of said dissimilarities which correspond to said path selection information, and detects the minimum dissimilarity out of said selected dissimilarities, and updates and stores the number of the reference template corresponding to said detected minimum dissimilarity, each time said speech frame number is updated.
Claim 6
Dependent Claim 209 words
An apparatus according to claim 2, wherein said distance calculating and discriminating means further comprises: a means for storing one or two of path selection information to select one or two of said dissimilarities at an address specified by said speech frame number and the number of said reference template, if said speech frame number is in a predetermined interval to be discriminated of a desired one of said reference templates, said interval being provided for each of said reference templates to indicate an area containing many pronounced lengths of words of the category of the reference templates in their distribution, and for storing information not to select any path at an address specified by said speech frame number and the number of said reference template, if said speech frame number is outside of said predetermined interval to be discriminated of a desired one of said reference templates, and for outputting said one or two of said path selection information or the information not to select any path, dependent on the reference template, each time said speech frame number is updated; and said means for detecting a minimum dissimilarity and storing the number of the corresponding reference template, stops the detection of the minimum dissimilarity under the silent condition.
Claim 7
Dependent Claim 73 words
An apparatus according to claim 2, wherein said means for updating a speech frame number continues to update said speech frame number even in the silent condition after the start point of the input speech has been detected until the end point thereof is detected; and said means for detecting a minimum dissimilarity and storing the number of the corresponding reference template, stops the detection of the minimum dissimilarity under the silent condition.
Claim 8
Dependent Claim 50 words
An apparatus according to claim 1, wherein said means for detecting a minimum dissimilarity and storing the number of the corresponding reference template, starts to detect the minimum dissimilarity by detecting a substantially silent condition; and the number of said matching paths for each of said reference templates is 3.
Claim 9
Independent Claim 466 words
A method of recognizing speech, comprising the steps of: providing a plurality of reference templates composed of spectrally normalized data in a plurality of frames and a plurality of channels; analyzing the frequencies of an input speech periodically at each input frame, which is a predetermined time interval, to extract an input pattern composed of time series information of frequency components in a plurality of channels; spectrally normalizing said components of said input pattern in each of the channels in each frame to generate spectrally normalized data; starting counting of a speech frame number j of the input pattern after a start point of the input speech is detected; updating said speech frame number j every input frame while the input speech is in the speech sound condition; holding said speech frame number j while the input speech is in a silent condition; restarting to update said speech frame number j every input frame when the input speech is again in the speech sound condition before the end point of the input speech is detected; setting plural substantially linear matching paths, cash having different slopes, between said input pattern and said reference templates by generating plural path-related frame numbers lp, each of which is related to each of said matching paths, in substantially a linear relationship to said speech frame number j according to the equation ##EQU8## where the denominators C p are plural positive real constants each of which is predetermined with respect to each of said matching paths and where [] represents a Gaussian symbol, each time said speech frame number j is updated; generating plural reference template frame numbers kp, each of which is related to each of said matching paths, based on said path-related frame number lp and the frame length SL(n) of each reference template each time said speech frame number j is updated, according to the following equation; kp=lp (if lp≦SL(n)) SL(n) (if lp>(SL(n)) calculating the distance between the spectrally normalized data W(i,j) of said speech frame number j of said input pattern and the spectrally normalized data Sn(i,kp) of said reference template frame number kp of each reference template in each matching path each time said speech frame number j is updated; calculating a dissimilarity relating to each of the matching paths for each of the reference templates by accumulating said distances each time said speech frame number j is updated; detecting a minimum dissimilarity each time said speech frame number j is updated and storing the number of the reference template corresponding to said minimum dissimilarity; and determining the number of said reference template relating to said minimum dissimilarity stored correspondingly to the speech frame number at the end point of the input speech as the recognized result of the input speech when said end point is detected.
Claim 10
Independent Claim 466 words
A method of recognizing speech, comprising the steps of: providing a plurality of reference templates composed of spectrally normalized data in a plurality of frames and a plurality of channels; analyzing the frequencies of an input speech periodically at each input frame, which is a predetermined time interval, to extract an input pattern composed of time series information of frequency components in a plurality of channels; spectrally normalizing said components of said input pattern in each of the channels in each frame to generate spectrally normalized data; starting counting of a speech frame number j of the input pattern after a start point of the input speech is detected; updating said speech frame number j every input frame while the input speech is in the speech sound condition; holding said speech frame number j while the input speech is in a silent condition; restarting to update said speech frame number j every input frame when the input speech is again in the speech sound condition before the end point of the input speech is detected; setting plural substantially linear matching paths, cash having different slopes, between said input pattern and said reference templates by generating plural path-related frame numbers lp, each of which is related to each of said matching paths, in substantially a linear relationship to said speech frame number j according to the equation ##EQU8## where the denominators C p are plural positive real constants each of which is predetermined with respect to each of said matching paths and where [] represents a Gaussian symbol, each time said speech frame number j is updated; generating plural reference template frame numbers kp, each of which is related to each of said matching paths, based on said path-related frame number lp and the frame length SL(n) of each reference template each time said speech frame number j is updated, according to the following equation; kp=lp (if lp≦SL(n)) SL(n) (if lp>(SL(n)) calculating the distance between the spectrally normalized data W(i,j) of said speech frame number j of said input pattern and the spectrally normalized data Sn(i,kp) of said reference template frame number kp of each reference template in each matching path each time said speech frame number j is updated; calculating a dissimilarity relating to each of the matching paths for each of the reference templates by accumulating said distances each time said speech frame number j is updated; detecting a minimum dissimilarity each time said speech frame number j is updated and storing the number of the reference template corresponding to said minimum dissimilarity; and determining the number of said reference template relating to said minimum dissimilarity stored correspondingly to the speech frame number at the end point of the input speech as the recognized result of the input speech when said end point is detected.
Claim 11
Dependent Claim 58 words
A method according to claim 8, wherein said detecting a minimum dissimilarity and storing the number of the corresponding reference template updates and stores the number of the reference template corresponding to the minimum dissimilarity each time said speech frame number is updated; and the number of said matching paths for each of said reference templates is 3.
Claim 12
Dependent Claim 122 words
A method according to claim 9, further including the steps of: providing path selection information to specify one of said matching paths corresponding to said speech frame number and the number of each said reference template; generating one of said path selection information to select one of said dissimilarities corresponding to each said reference template each time said speech frame number is updated; and said detecting a minimum dissimilarity and storing the number of the corresponding reference template, detects a minimum dissimilarity out of the dissimilarities which correspond to said path selection information in each said reference template, and updates and stores the number of the reference template corresponding to said detected minimum dissimilarity each time said speech frame number is updated.
Claim 13
Dependent Claim 122 words
A method according to claim 9, further including the steps of: providing path selection information to specify one or two of said matching paths corresponding to said speech frame number and the number of each said reference template; generating one or two of said path selection information corresponding to each said reference template each time said speech frame number is updated; and said step of detecting a minimum dissimilarity and storing the number of the corresponding reference template, detects a minimum dissimilarity out of the dissimilarities which correspond to said path selection information in each said reference template, and updates and stores the number of the reference template corresponding to said detected minimum dissimilarity each time said speech frame number is updated.
Claim 14
Dependent Claim 165 words
A method according to claim 9, further including the steps of: providing path selection information to specify one or two of said matching paths corresponding to said speech frame number and the number of said reference template, only if said speech frame number is in a predetermined interval to be discriminated of a desired one of said reference templates, said interval being provided for each of said reference templates to indicate an area containing many pronounced lengths of words of the category of the reference templates in their distribution; generating selectively one or two of said path selection information, dependent on the reference template, each time said speech frame is updated; and said step of detecting a minimum dissimilarity and storing the number of the corresponding reference template, updates and stores the number of the reference template corresponding to a minimum dissimilarity out of the dissimilarities corresponding to said path selection information in each said reference template, each time said speech frame number is updated.
Claim 15
Dependent Claim 48 words
A method according to claim 8, wherein said detecting a minimum dissimilarity and storing the number of the corresponding reference template, starts to detect the minimum dissimilarity by detecting a substantially silent condition; and the number of said matching paths for each of said reference templates is 3.
Claim 16
Dependent Claim 71 words
An method according to claim 8, wherein said counting up of a speech frame number continues to update said speech frame number even in the silent condition after the start point of the input speech has been detected until the end point thereof is detected; and said detecting a minimum dissimilarity and storing the number of the corresponding reference template, stops the detection of the minimum dissimilarity under the silent condition.

References Cited (Backward Citations)

US4059725A Cited
US4038503A Cited
US4282403A Cited
US4256924A Cited
US4384273A Cited
US4481593A Cited
US4571697A Cited
US4624010A Cited
US4677672A Cited
US4624008A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1992-09-18 1993-03-20 1993-09-19 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1996-09-18 1997-03-20 1997-09-19 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2000-09-18 2001-03-20 2001-09-19 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag