← Back to Patent Explorer
US5689616A Expired / Lapsed US ⏱️ 0.0 years remaining

Automatic language identification/verification system

Assignee: Micron Technology Inc
•
Filing: 1996-06-28
•
Granted: 1997-11-18
•
Expires: 2016-06-28
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A language identification and verification system is described whereby language identification is determined by finding the closest match of a speech utterance to multiple speaker sets. The language identification and verification system is implemented through use of a speaker identification/verification system as a baseline to find a set of well matched speakers in each of a plurality of languages. A comparison of unknown speech to speech features from such well-matched speakers is then made and a language decision is arrived on based on a closest match between the unknown speech features and speech features for such well matched reference speakers in a particular language. To avoid a problem associated with prior-art language identification systems, wherein speech feature are based on short-term spectral features determined at a system frame rate--thereby seriously limiting the resolution and accuracy of such prior-art systems, the invention uses speech features derived from vocalic or syllabic nuclei, from which related phonetic speech features may then be extracted. Detection of such vocalic centers or syllabic nuclei is accomplished using a trained back-error propagation multi-level neural network.

Inventors

  • 👤 Kung-Pu Li

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 23:15
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/005; G10L25/00; G10L25/27; G10L25/30

Claims Analysis

Total Claims: 32
Claim 1
Independent Claim 197 words
A Language Verification System comprising: means for processing spoken text entered into the system whereby spoken text is converted into frames of speech, and wherein variations in input speech signals extrinsic to those introduced by a speaker's vocal tract are attenuated; means for detecting and extracting phonetic speech features that are syllabic nuclei, from said frames of speech; matching means for comparing said phonetic speech features with stored reference phonetic speech features and establishing a match score for said comparison proportional to degree of similarity between said phonetic speech features and said stored reference phonetic speech features; and, decision means for identifying said input speech as corresponding to one of a plurality of languages, whereby said language identification for said input speech is established on the basis of a comparison of said match score with at least one predetermined threshold score associated with at least one of said plurality of languages, said decision means encompasses a scoring methodology wherein multiple matched speakers within sand across a multiplicity of languages are identified as to a language spoken based on a score selected from the group consisting of a minimum score, an average score and a combination minimum-average score.
Claim 2
Dependent Claim 197 words
A Language Verification System comprising: means for processing spoken text entered into the system whereby spoken text is converted into frames of speech, and wherein variations in input speech signals extrinsic to those introduced by a speaker's vocal tract are attenuated; means for detecting and extracting phonetic speech features that are syllabic nuclei, from said frames of speech; matching means for comparing said phonetic speech features with stored reference phonetic speech features and establishing a match score for said comparison proportional to degree of similarity between said phonetic speech features and said stored reference phonetic speech features; and, decision means for identifying said input speech as corresponding to one of a plurality of languages, whereby said language identification for said input speech is established on the basis of a comparison of said match score with at least one predetermined threshold score associated with at least one of said plurality of languages, said decision means encompasses a scoring methodology wherein multiple matched speakers within sand across a multiplicity of languages are identified as to a language spoken based on a score selected from the group consisting of a minimum score, an average score and a combination minimum-average score.
Claim 3
Dependent Claim 28 words
The Language Verification system of claim 1, wherein said detection of syllabic nuclei occurs through processing said input speech by a trained back error propagation multi-layer neural network.
Claim 4
Dependent Claim 37 words
The Language Verification System of claim 1, wherein feature information respecting said speech input is realized by encoding a plurality of frames of said input speech from a sequence of said frames proximate to the syllabic nuclei.
Claim 5
Dependent Claim 32 words
The Language Verification System of claim 1, wherein said matching means is implemented as a determination of nearest-neighbor Euclidian distances between said phonetic speech features and said stored reference phonetic speech features.
Claim 6
Dependent Claim 23 words
The Language Verification System of claim 1, wherein said matching means is implemented in a multi-level artificial neural network using back error propagation.
Claim 7
Dependent Claim 46 words
The Language Verification System of claim 5, wherein said multi-level artificial neural network operates at a first level to discriminate each of a plurality of languages at a single syllable level and at a second level to further separate said plurality of languages by sequential patterns.
Claim 8
Dependent Claim 34 words
The Language Verification System of claim 5, wherein said back-error propagation neural network is implemented through a multiplicity of levels for a language discrimination, thereby causing said language verification system to be speaker independent.
Claim 9
Dependent Claim 41 words
The Language Verification System of claim 1, wherein said means for extracting phonetic speech features and said matching means, in combination, are implemented in a Hidden Markov Model wherein a separate model is defined for each of a plurality of languages.
Claim 10
Dependent Claim 27 words
The Language Verification System of claim 8, wherein said Hidden Markov Model is based on syllabic speech features and structure, and wherein said model is speaker independent.
Claim 11
Dependent Claim 226 words
In a Language Verification System comprising a means for processing spoken text into frames of speech, a means for detecting and extracting speech features from said frames of speech, matching means for comparing said speech features with stored references speech features and establishing a matched score for said comparison proportional to a degree similarity between said speech features and said stored reference speech features, and decision means for identifying input speech to said system as corresponding to one of a plurality of languages, the improvement therewith comprising: means operable with said means for detecting and extracting speech features that are syllabic nuclei, to identify phonetic speech; means operable with said matching means to establish a match score proportional to a degree of similarity between the phonetic speech features and stored reference phonetic speech features; and, means operable with said decision means whereby said language identification for said input speech is established on the basis of a comparison of said matched scores with at least one predetermined threshold score associated with one of said plurality of languages, said means operable with said decision means encompasses a scoring methodology wherein multiple matched speakers within and across a multiplicity of languages are identified as to a language spoken based on a score selected from the group consisting of a minimum score, an average score and a combination minimum-average score.
Claim 12
Dependent Claim 226 words
In a Language Verification System comprising a means for processing spoken text into frames of speech, a means for detecting and extracting speech features from said frames of speech, matching means for comparing said speech features with stored references speech features and establishing a matched score for said comparison proportional to a degree similarity between said speech features and said stored reference speech features, and decision means for identifying input speech to said system as corresponding to one of a plurality of languages, the improvement therewith comprising: means operable with said means for detecting and extracting speech features that are syllabic nuclei, to identify phonetic speech; means operable with said matching means to establish a match score proportional to a degree of similarity between the phonetic speech features and stored reference phonetic speech features; and, means operable with said decision means whereby said language identification for said input speech is established on the basis of a comparison of said matched scores with at least one predetermined threshold score associated with one of said plurality of languages, said means operable with said decision means encompasses a scoring methodology wherein multiple matched speakers within and across a multiplicity of languages are identified as to a language spoken based on a score selected from the group consisting of a minimum score, an average score and a combination minimum-average score.
Claim 13
Dependent Claim 28 words
The Language Verification System of claim 3, wherein said detection of syllabic nuclei occurs through processing said input speech by a trained back error propagation multi-level neural network.
Claim 14
Dependent Claim 37 words
The Language Verification System of claim 3, wherein feature information respecting said input speech is realized by encoding a plurality of frames of said input speech from a sequence of said frames proximate to said syllabic nuclei.
Claim 15
Dependent Claim 32 words
The Language Verification System of claim 10, wherein said matching means is implemented as a determination of nearest-neighbor Euclidian distances between said phonetic speech features and said stored reference phonetic speech features.
Claim 16
Dependent Claim 23 words
The Language Verification System of claim 10, wherein said matching means is implemented in a multi-level artificial neural network using back error propagation.
Claim 17
Dependent Claim 46 words
The Language Verification System of claim 14, wherein said multi-level artificial neural network operates at a first level to discriminate each of a plurality of languages at a single syllable level and at a second level to further separate said plurality of languages by sequential patterns.
Claim 18
Dependent Claim 34 words
The Language Verification System of claim 14, wherein said back-error propagation neural network is implemented through a multiplicity of levels for a language discrimination, thereby causing said language verification system to be speaker independent.
Claim 19
Dependent Claim 41 words
The Language Verification System of claim 10, wherein said means for extracting phonetic speech features and said matching means, in combination, are implemented in a Hidden Markov Model wherein a separate model is defined for each of a plurality of languages.
Claim 20
Dependent Claim 27 words
The Language Verification System of claim 17, wherein said Hidden Markov Model is based on syllabic speech features and structure, and wherein said model is speaker independent.
Claim 21
Dependent Claim 45 words
The Language Verification System of claim 10, wherein said decision means encompasses a scoring methodology wherein multiple matched speakers within and across a multiplicity of languages are identified as to a language spoken based on a minimum score, an average score or a combination thereof.
Claim 22
Independent Claim 191 words
A method for automatically identifying the language of a speaker as corresponding to one of a plurality of languages, including the steps of: processing spoken text, whereby said spoken text is converted into frames of speech and wherein variations in input speech signals extrinsic to those introduced by a speaker's vocal tract are attenuated; detecting and extracting phonetic features that are syllabic nuclei from said frames of input speech; comparing said phonetic speech features with stored reference phonetic speech features and establishing a match score for said comparison proportional to a degree of similarity between said phonetic speech features and said stored references phonetic speech features; and identifying said input speech as corresponding to one of a plurality of languages, whereby said language identification for said input speech is established on the basis of a comparison of said match score with at least one predetermined threshold score associated with at least one of said plurality of languages, wherein said match score and said at least one predetermined threshold score are both of a type selected from the group consisting of a minimum score, an average score and a combination minimum-average score.
Claim 23
Independent Claim 191 words
A method for automatically identifying the language of a speaker as corresponding to one of a plurality of languages, including the steps of: processing spoken text, whereby said spoken text is converted into frames of speech and wherein variations in input speech signals extrinsic to those introduced by a speaker's vocal tract are attenuated; detecting and extracting phonetic features that are syllabic nuclei from said frames of input speech; comparing said phonetic speech features with stored reference phonetic speech features and establishing a match score for said comparison proportional to a degree of similarity between said phonetic speech features and said stored references phonetic speech features; and identifying said input speech as corresponding to one of a plurality of languages, whereby said language identification for said input speech is established on the basis of a comparison of said match score with at least one predetermined threshold score associated with at least one of said plurality of languages, wherein said match score and said at least one predetermined threshold score are both of a type selected from the group consisting of a minimum score, an average score and a combination minimum-average score.
Claim 24
Dependent Claim 29 words
The automatic language identification method of claim 2, wherein the detection of syllabic nuclei occurs through processing said input speech by a trained back error propagation multi-level neural network.
Claim 25
Dependent Claim 38 words
The automatic language identification method of claim 2, wherein feature information respecting said input speech is realized by encoding a plurality of frames of said input speech from a sequence of said frames proximate to said syllabic nuclei.
Claim 26
Dependent Claim 33 words
The automatic language identification method of claim 20, wherein said comparing step is implemented as a determination of nearest-neighbor Euclidian distances between said phonetic speech features and said stored reference phonetic speech features.
Claim 27
Dependent Claim 24 words
The automatic language identification method of claim 20, wherein said comparing step is implemented in a multi-level artificial neural network using back error propagation.
Claim 28
Dependent Claim 47 words
The automatic language identification method of claim 24, wherein said multi-level artificial neural network operates at a first level to discriminate each of a plurality of languages at a single syllable level and at a second level to further separate said plurality of languages by sequential patterns.
Claim 29
Dependent Claim 36 words
The automatic language identification method of claim 24, wherein said syllabic-delayed back-error propagation neural network is implemented through a multiplicity of levels for a language discrimination, thereby causing said language verification system to be speaker independent.
Claim 30
Dependent Claim 42 words
The automatic language identification method of claim 20, wherein the step of extracting phonetic speech features and the comparing step, in combination, are implemented in a Hidden Markov Model wherein a separate model is defined for each of a plurality of languages.
Claim 31
Dependent Claim 28 words
The automatic language identification method of claim 27, wherein said Hidden Markov Model is based on syllabic speech features and structure, and wherein said model is speaker independent.
Claim 32
Dependent Claim 46 words
The automatic language identification method of claim 20, wherein said identifying step encompasses a scoring methodology wherein multiple matched speakers within and across a multiplicity of languages are identified as to a language spoken based on a minimum score, an average score or a combination thereof.

References Cited (Backward Citations)

US4181821A Cited
US4665548A Cited
US5189727A Cited
US5349645A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2000-11-17 2001-05-19 2001-11-18 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2004-11-17 2005-05-19 2005-11-18 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2008-11-17 2009-05-19 2009-11-18 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag