US5636325A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Speech synthesis and analysis of dialects
Assignee: Nuance Communications Inc
•
Filing: 1994-01-05
•
Granted: 1997-06-03
•
Expires: 2014-01-05
Abstract
Abstract A set of intonation intervals for a chosen dialect are applied to the intonational contour of a phomene string derived from a single set of stored linguistic units, e.g., phonemes. Sets of intonational intervals are stored to simulate or recognize different dialects or languages from a single set of stored phonemes. The interval rules preferably use a prosodic analysis of the phoneme string or other cues to apply a given interval to the phoneme string. A second set of interval data is provided for semantic information. The speech system is based on the observation that each dialect and language possess its own set of musical relationships or intonation intervals. These musical relationships are used by a human listener to identify the particular dialect or language. The speech system may be either a speech synthesis or speech analysis tool or may be a combined speech synthesis/analysis system.
Inventors
- 👤 Peter W. Farrett
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 05:14
CPC Classifications
G; G10; G10L; G10L13/00; G10L13/08; G10L13/10; G10L15/00; G10L15/005
Claims Analysis
Total Claims: 48
Claim 1
Independent Claim
141 words
A method of operating a speech synthesis system comprising the steps of: generating a string of linguistic units containing pitch data by selecting linguistic units from a first memory segment of the system which correspond to characters in a text string and concatenating the selected linguistic units together in a second memory segment of the system; selecting locations within the pitch data of the string of linguistic units; retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals selected from a set of melodic intervals as being indicative of the first selected dialect and stored in a dialect table in a third memory segment of the system; and applying the first set of dialect intervals to the pitch data at the selected locations so that synthesized speech of the first selected dialect produced.
Claim 2
Independent Claim
141 words
A method of operating a speech synthesis system comprising the steps of: generating a string of linguistic units containing pitch data by selecting linguistic units from a first memory segment of the system which correspond to characters in a text string and concatenating the selected linguistic units together in a second memory segment of the system; selecting locations within the pitch data of the string of linguistic units; retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals selected from a set of melodic intervals as being indicative of the first selected dialect and stored in a dialect table in a third memory segment of the system; and applying the first set of dialect intervals to the pitch data at the selected locations so that synthesized speech of the first selected dialect produced.
Claim 3
Dependent Claim
38 words
The method as recited in claim 1 wherein the applying step comprises changing at least one interval at a selected location in the pitch data to at least one dialect interval of the first set of dialect intervals.
Claim 4
Independent Claim
96 words
A method of operating a speech recognition system comprising the steps of: providing a digitized speech sample of human speech; selecting a set of melodic intervals in the digitized speech sample; retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals being melodic intervals which are indicative of the first selected dialect and stored in a dialect table; and comparing the set of melodic intervals to the first set of dialect intervals to determine whether the digitized speech sample is from human speech of the first selected dialect.
Claim 5
Independent Claim
96 words
A method of operating a speech recognition system comprising the steps of: providing a digitized speech sample of human speech; selecting a set of melodic intervals in the digitized speech sample; retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals being melodic intervals which are indicative of the first selected dialect and stored in a dialect table; and comparing the set of melodic intervals to the first set of dialect intervals to determine whether the digitized speech sample is from human speech of the first selected dialect.
Claim 6
Dependent Claim
41 words
The method as recited in claim 3 which further comprises the step of sending a message to the user interface of the system if there is a match between the set of melodic intervals and the first set of dialect intervals.
Claim 7
Dependent Claim
84 words
The method as recited in claim 3 which further comprises the steps of: retrieving a second set of dialect intervals for a second selected dialect; comparing the set of melodic intervals to the second set of dialect intervals to determine whether the digitized speech sample is from human speech of the second selected dialect; and, sending a message to a user interface of the system indicating that there is a match between the set of melodic intervals and the second set of dialect intervals.
Claim 8
Dependent Claim
36 words
The method as recited in claim 3 wherein the selecting step comprises identifying a melodic interval in the digitized speech sample which exceeds a predetermined threshold as a melodic interval in the set of melodic intervals.
Claim 9
Dependent Claim
63 words
The method as recited in claim 3 which further comprises the steps of: comparing the digitized speech sample with a code book which contains stored speech samples corresponding to phonemes to generate a string of phonemes corresponding to the digitized speech sample; and comparing the digitized speech sample to pitch data in the string of phonemes to select the set of melodic intervals.
Claim 10
Dependent Claim
36 words
The method as recited in claim 3 wherein the selecting step comprises the steps of: analyzing the digitized speech sample to generate prosodic data; and, selecting the set of melodic intervals according to the prosodic data.
Claim 11
Dependent Claim
21 words
The method as recited in claim 1 wherein the dialect table includes sets of dialect intervals for a plurality of dialects.
Claim 12
Dependent Claim
21 words
The method as recited in claim 1 wherein the dialect table includes a set of dialect intervals for a first language.
Claim 13
Dependent Claim
19 words
The method as recited in claim 9 wherein the sets of dialect intervals are based on the diatonic scale.
Claim 14
Dependent Claim
56 words
The method as recited in claim 1 which further comprises the steps of: generating prosody data for the string of linguistic units according to prosody rules of the system; and altering the pitch data within the string of linguistic units according to the prosody data; wherein the selected locations are chosen within the altered pitch data.
Claim 15
Dependent Claim
67 words
The method as recited in claim 1 which further comprises the steps of: selecting a set of keywords located in the text string; and locating a set of locations which correspond to the keywords in the string of linguistic units; wherein the selected locations are selected according to locations in the pitch data which correspond to the locations of the set of keywords in the text string.
Claim 16
Dependent Claim
84 words
The method as recited in claim 2 which further comprises the steps of: retrieving a second set of dialect intervals for a second selected dialect, the second set of dialect intervals selected from a set of melodic intervals as being indicative of the second selected dialect stored in the dialect table; and changing at least one melodic interval at a selected location in the pitch data to one of the second set of dialect intervals to produce synthesized speech of the second selected dialect.
Claim 17
Dependent Claim
50 words
The method as recited in claim 5 which further comprises the steps of: determining a probability of match for the first and second selected dialects; and, sending a message to a user interface indicating the probability that the string of linguistic units represents speech of the first or second dialect.
Claim 18
Dependent Claim
31 words
The method as recited in claim 1 wherein the first dialect is British English and the first set of dialect intervals comprises an octave, a major seventh and a minor seventh.
Claim 19
Dependent Claim
35 words
The method as recited in claim 1 wherein the first dialect is a Japanese and the first set of dialect intervals comprises a perfect fifth, a perfect fourth, a major second and a minor second.
Claim 20
Dependent Claim
31 words
The method as recited in claim 1 wherein the first dialect is Irish and the first set of dialect intervals comprises a major sixth, a minor sixth and a major third.
Claim 21
Dependent Claim
35 words
The method as recited in claim 1 wherein the first dialect is Midwestern English and the first set of dialect intervals comprises a perfect fifth, a major third, a perfect fourth and a minor third.
Claim 22
Dependent Claim
154 words
A computer program product on a computer readable medium for speech synthesis, the computer program product executable in a computer system comprising: program code means for generating a string of linguistic units containing pitch data by selecting linguistic units from a first memory segment of the system which correspond to characters in a text string and concatenating the selected linguistic units together in a second memory segment of the system; program code means for selecting locations within the pitch data of the string of linguistic units; program code means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals selected from a set of melodic intervals as being indicative of the first selected dialect stored in a dialect table in a third memory segment of the system; and program code means for applying the first set of dialect intervals to the set of melodic intervals.
Claim 23
Dependent Claim
154 words
A computer program product on a computer readable medium for speech synthesis, the computer program product executable in a computer system comprising: program code means for generating a string of linguistic units containing pitch data by selecting linguistic units from a first memory segment of the system which correspond to characters in a text string and concatenating the selected linguistic units together in a second memory segment of the system; program code means for selecting locations within the pitch data of the string of linguistic units; program code means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals selected from a set of melodic intervals as being indicative of the first selected dialect stored in a dialect table in a third memory segment of the system; and program code means for applying the first set of dialect intervals to the set of melodic intervals.
Claim 24
Dependent Claim
38 words
The product as recited in claim 20 wherein the applying means changes at least one melodic interval at a selected location in the pitch data to at least one, dialect interval of the first set of dialect intervals.
Claim 25
Dependent Claim
129 words
A computer program product in a computer readable medium for speech recognition, the computer program product executable in a computer system, comprising: program code means for providing a digitized speech sample of human speech; program code means for selecting a set of melodic intervals in the digitized speech sample; program code means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals being melodic intervals which are indicative of the first selected dialect and stored in a dialect table in a third memory segment of the system; and program code means for comparing the set of melodic intervals to the first set of dialect intervals to determine whether the digitized speech sample is from speech of the first selected dialect.
Claim 26
Dependent Claim
129 words
A computer program product in a computer readable medium for speech recognition, the computer program product executable in a computer system, comprising: program code means for providing a digitized speech sample of human speech; program code means for selecting a set of melodic intervals in the digitized speech sample; program code means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals being melodic intervals which are indicative of the first selected dialect and stored in a dialect table in a third memory segment of the system; and program code means for comparing the set of melodic intervals to the first set of dialect intervals to determine whether the digitized speech sample is from speech of the first selected dialect.
Claim 27
Dependent Claim
42 words
The product as recited in claim 22 which further comprises program code means for sending a message to a user interface of the system if there is a match between the set of melodic intervals and the first set of dialect intervals.
Claim 28
Dependent Claim
93 words
The product as recited in claim 22 which further comprises: program code means for retrieving a second set of dialect intervals for a second selected dialect; program code means for comparing the set of melodic intervals to the second set of dialect intervals to determine whether the digitized speech sample is from human speech of the second selected dialect; and, program code means for sending a message to a user interface of the system indicating that there is a match between the set of melodic intervals and the second set of dialect intervals.
Claim 29
Dependent Claim
68 words
The product as recited in claim 22 which further comprises: program code means for comparing the digitized speech sample with a code book which contains stored speech samples corresponding to phonemes to generate a string of phonemes corresponding to the digitized speech sample; and program code means for comparing the digitized speech sample to pitch data in the string of phonemes to select the set of melodic intervals.
Claim 30
Dependent Claim
39 words
The product as recited in claim 22 wherein the selecting means comprises: program code means for analyzing the digitized speech sample to generate prosodic data; and, program code means for selecting the melodic intervals according to the prosodic data.
Claim 31
Dependent Claim
63 words
The product as recited in claim 21 wherein the identifying means comprises: program code means for generating prosody data for the string of linguistic units according to prosody rules of the system; and program code means for altering the pitch data within the string of linguistic units according to the prosody data; wherein the selected locations are chosen within the altered pitch data.
Claim 32
Dependent Claim
166 words
A speech synthesis system comprising: a memory for storing set of instructions to perform speech processing and speech data; a processor coupled to the memory for executing the sets of instructions; means for generating a string of linguistic units containing pitch data by selecting dialect neutral linguistic units from a first memory segment of the system which correspond to characters in a text string and concatenating the selected linguistic units together in a second memory segment of the system; means for selecting locations within the pitch data of the string of linguistic units; means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals selected from a set of melodic intervals as being indicative of the first selected dialect and stored in a dialect table in a third memory; and means for applying the first set of dialect intervals to the pitch data at the selected locations so that synthesized speech of the first selected dialect produced.
Claim 33
Dependent Claim
166 words
A speech synthesis system comprising: a memory for storing set of instructions to perform speech processing and speech data; a processor coupled to the memory for executing the sets of instructions; means for generating a string of linguistic units containing pitch data by selecting dialect neutral linguistic units from a first memory segment of the system which correspond to characters in a text string and concatenating the selected linguistic units together in a second memory segment of the system; means for selecting locations within the pitch data of the string of linguistic units; means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals selected from a set of melodic intervals as being indicative of the first selected dialect and stored in a dialect table in a third memory; and means for applying the first set of dialect intervals to the pitch data at the selected locations so that synthesized speech of the first selected dialect produced.
Claim 34
Dependent Claim
38 words
The system as recited in claim 28 wherein the applying means changes at least one melodic interval at a selected location in the pitch data to at least one dialect interval of the first set of dialect intervals.
Claim 35
Dependent Claim
123 words
A speech recognition system comprising: a memory for storing set of instructions to perform speech processing and speech data; a processor coupled to the memory for executing the sets of instructions; means for providing a digitized speech sample of human speech; means for selecting a set of melodic intervals in the digitized speech sample; means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals being melodic intervals which are indicative of the first selected dialect and stored in a dialect table; and means for comparing the set of melodic intervals to the first set of dialect intervals to determine whether the digitized speech sample is from human speech of the first selected dialect.
Claim 36
Dependent Claim
123 words
A speech recognition system comprising: a memory for storing set of instructions to perform speech processing and speech data; a processor coupled to the memory for executing the sets of instructions; means for providing a digitized speech sample of human speech; means for selecting a set of melodic intervals in the digitized speech sample; means for retrieving a first set of dialect intervals for a first selected dialect, the first set of dialect intervals being melodic intervals which are indicative of the first selected dialect and stored in a dialect table; and means for comparing the set of melodic intervals to the first set of dialect intervals to determine whether the digitized speech sample is from human speech of the first selected dialect.
Claim 37
Dependent Claim
40 words
The system as recited in claim 30 which further comprises means for sending a message to a user interface of the system if there is a match between the set of melodic intervals and the first set of dialect intervals.
Claim 38
Dependent Claim
87 words
The system as recited in claim 30 which further comprises: means for retrieving a second set of dialect intervals for a second selected dialect; means for comparing the set of melodic intervals to the second set of dialect intervals to determine whether the digitized speech sample is from human speech of the second selected dialect; and, means for sending a message to a user interface of the system indicating that there is a match between the set of melodic intervals and the second set of dialect intervals.
Claim 39
Dependent Claim
35 words
The system as recited in claim 30 wherein the selecting means identifies a melodic interval in the digitized speech sample which exceeds a predetermined threshold as a melodic interval in the set of melodic intervals.
Claim 40
Dependent Claim
66 words
The system as recited in claim 30 wherein the selecting means comprises: means for comparing the digitized speech sample with a code book which contains stored speech samples corresponding to phonemes to generate a string of phonemes corresponding to the digitized speech sample; and means for comparing the digitized speech sample to pitch data in the string of phonemes to select the set of melodic intervals.
Claim 41
Dependent Claim
37 words
The system as recited in claim 30 wherein the identifying means comprises: means for analyzing the digitized speech sample to generate prosodic data; and, means for selecting the set of melodic intervals according to the prosodic data.
Claim 42
Dependent Claim
21 words
The system as recited in claim 28 wherein the dialect table includes sets of dialect intervals for a plurality of dialects.
Claim 43
Dependent Claim
21 words
The system as recited in claim 28 wherein the dialect table includes a set of dialect intervals for a first language.
Claim 44
Dependent Claim
59 words
The system as recited in claim 29 wherein the identifying means comprises: means for generating prosody data for the string of linguistic units according to prosody rules of the system; and means for altering the pitch data within the string of linguistic units according to the prosody data; wherein the selected locations are chosen within the altered pitch data.
Claim 45
Dependent Claim
31 words
The system as recited in claim 28 wherein the first dialect is British English and the first set of dialect intervals comprises an octave, a major seventh and a minor seventh.
Claim 46
Dependent Claim
34 words
The system as recited in claim 28 wherein the first dialect is Japanese and the first set of dialect intervals comprises a perfect fifth, a perfect fourth, a major second and a minor second.
Claim 47
Dependent Claim
31 words
The system as recited in claim 28 wherein the first dialect is Irish and the first set of dialect intervals comprises a major sixth, a minor sixth and a major third.
Claim 48
Dependent Claim
35 words
The system as recited in claim 28 wherein the first dialect is Midwestern English and the first set of dialect intervals comprises a perfect fifth, a major third, a perfect fourth and a minor third.
References Cited (Backward Citations)
US4613944A
Cited
US4455615A
Cited
US4624012A
Cited
US5113449A
Cited
US4802223A
Cited
US4692941A
Cited
US4908727A
Cited
US5133010A
Cited
US4833718A
Cited
US4852170A
Cited
US4896359A
Cited
US4980917A
Cited
US5029211A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-06-02 | 2000-12-02 | 2001-06-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-06-02 | 2004-12-02 | 2005-06-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-06-02 | 2008-12-02 | 2009-06-03 | $7700.00 | Window Closed / Lapsed |