US6081780A
Expired / Lapsed
US
⏱️ 0.0 years remaining
TTS and prosody based authoring system
Assignee: International Business Machines Corp
•
Filing: 1998-04-28
•
Granted: 2000-06-27
•
Expires: 2018-04-28
Abstract
Abstract An information signal content authoring system is provided. The authoring system includes a speech analyzer, responsive to a spoken utterance signal provided by a narrator. The spoken utterance signal is representative of information available to the narrator. The speech analyzer generates a speech signal representative of one or more prosodic parameters associated with the narrator. A text-to-speech converter, responsive to a text signal representative of the information available to the narrator, generates a phonetic representation signal from the text signal and synthesizes a speech signal from the text signal. The text-to-speech converter also generates one or more prosodic parameters from the text signal. A spectrum comparator, operatively coupled to the speech analyzer and the text-to-speech converter, compares the spectral parameters of the speech signal generated by the speech analyzer to the speech signal synthesized by the converter and generates a variance signal indicative of a spectral distance between the two speech signals. The variance signal is provided to the text-to-speech converter to adjust the prosodic parameters. An output portion, operatively coupled to the text-to-speech converter, outputs the phonetic representation signal and the prosodic parameters from the converter as a composite encoded signal representative of information content available to the narrator. The output portion further preferably includes an editor, response to editing commands issued by the narrator, for editing at least a portion of the composite encoded signal.
Inventors
- 👤 Leon Lumelsky
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 01:50
CPC Classifications
H; H04; H04M; H04M3/00; H04M3/42; H04M3/487; G; G10; G10L; G10L13/00; G10L13/08; G10L13/02; G10L13/04; G10L19/00; H04M2201/00; H04M2201/60; H04M7/00; H04M7/12
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
209 words
An information signal content authoring system, comprising: a speech analyzer, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analyzer generating a speech signal representative of at least one prosodic parameter associated with the narrator; a text-to-speech converter, responsive to a text signal representative of the information available to the narrator, the converter generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech converter also generating at least one prosodic parameter from the text signal; a spectrum comparator, operatively coupled to the speech analyzer and the text-to-speech converter, for comparing the at least one prosodic parameter of the speech signal generated by the speech analyzer to the speech signal synthesized by the converter and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech converter to adjust the at least one prosodic parameter; and an output portion, operatively coupled to the text-to-speech converter, for outputting the phonetic representation signal and the at least one prosodic parameter from the converter as a composite encoded signal representative of information content available to the narrator.
Claim 2
Dependent Claim
209 words
An information signal content authoring system, comprising: a speech analyzer, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analyzer generating a speech signal representative of at least one prosodic parameter associated with the narrator; a text-to-speech converter, responsive to a text signal representative of the information available to the narrator, the converter generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech converter also generating at least one prosodic parameter from the text signal; a spectrum comparator, operatively coupled to the speech analyzer and the text-to-speech converter, for comparing the at least one prosodic parameter of the speech signal generated by the speech analyzer to the speech signal synthesized by the converter and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech converter to adjust the at least one prosodic parameter; and an output portion, operatively coupled to the text-to-speech converter, for outputting the phonetic representation signal and the at least one prosodic parameter from the converter as a composite encoded signal representative of information content available to the narrator.
Claim 3
Dependent Claim
32 words
The system of claim 1, wherein the output portion further comprises editing means, response to editing commands issued by the narrator, for editing at least a portion of the composite encoded signal.
Claim 4
Dependent Claim
113 words
The system of claim 1, wherein the text-to-speech converter further comprises: a text-to-phonemes converter for converting the text signal to the phonetic representation signal; a phonemes-to-allophones converter, operatively coupled to the text-to-speech converter, for converting phonemes associated with the phonetic representation signal to allophones; storage means, operatively coupled to the phonemes-to-allophones converter, for storing previously recorded allophones characteristic of at least one narration voice and for selecting the previously recorded allophones which substantially match the allophones provided by the allophone converter; and speech synthesizing means, operatively coupled to the storage means, for generating the synthesized speech signal representative of the text signal in response to the previously recorded allophones from the storage means.
Claim 5
Dependent Claim
58 words
The system of claim 3, wherein the storage means of the text-to-speech conversion means further comprises a plurality of dictionaries of previously recorded allophones, each dictionary corresponding to a different narration voice, and means for switching between the dictionaries, at the request of the narrator, such that allophones from the selected dictionary are provided to the synthesizing means.
Claim 6
Dependent Claim
29 words
The system of claim 1, further comprising audio feedback means, operatively coupled to the text-to-speech converter, for providing the narrator with an audio feedback of the synthesized speech signal.
Claim 7
Dependent Claim
23 words
The system of claim 5, further comprising means for mixing a background audio signal with the synthesized speech signal feedback to the narrator.
Claim 8
Dependent Claim
223 words
An information signal content authoring system, comprising: speech analysis means, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analysis means generating a speech signal representative of at least one prosodic parameter associated with the narrator; text-to-speech conversion means, responsive to a text signal representative of the information available to the narrator, the conversion means generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech conversion means also generating at least one prosodic parameter from the text signal; comparing means, operatively coupled to the speech analysis means and the conversion means, for comparing the at least one prosodic parameter of the speech signal generated by the speech analysis means to the speech signal synthesized by the conversion means and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech conversion means to adjust the at least one prosodic parameter; and output means, operatively coupled to the speech analysis means, the conversion means and the comparing means, for outputting the phonetic representation signal and the at least one prosodic parameter from the conversion means as a composite encoded signal representative of information content available to the narrator.
Claim 9
Dependent Claim
223 words
An information signal content authoring system, comprising: speech analysis means, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analysis means generating a speech signal representative of at least one prosodic parameter associated with the narrator; text-to-speech conversion means, responsive to a text signal representative of the information available to the narrator, the conversion means generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech conversion means also generating at least one prosodic parameter from the text signal; comparing means, operatively coupled to the speech analysis means and the conversion means, for comparing the at least one prosodic parameter of the speech signal generated by the speech analysis means to the speech signal synthesized by the conversion means and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech conversion means to adjust the at least one prosodic parameter; and output means, operatively coupled to the speech analysis means, the conversion means and the comparing means, for outputting the phonetic representation signal and the at least one prosodic parameter from the conversion means as a composite encoded signal representative of information content available to the narrator.
Claim 10
Dependent Claim
32 words
The system of claim 7, wherein the output means further comprises editing means, response to editing commands issued by the narrator, for editing at least a portion of the composite encoded signal.
Claim 11
Dependent Claim
114 words
The system of claim 7, wherein the text-to-speech conversion means further comprises: a text-to-phonemes converter for converting the text signal to the phonetic representation signal; a phonemes-to-allophones converter, operatively coupled to the text-to-speech converter, for converting phonemes associated with the phonetic representation signal to allophones; storage means, operatively coupled to the phonemes-to-allophones converter, for storing previously recorded allophones characteristic of at least one narration voice and for selecting the previously recorded allophones which substantially match the allophones provided by the allophone converter; and speech synthesizing means, operatively coupled to the storage means, for generating the synthesized speech signal representative of the text signal in response to the previously recorded allophones from the storage means.
Claim 12
Dependent Claim
58 words
The system of claim 9, wherein the storage means of the text-to-speech conversion means further comprises a plurality of dictionaries of previously recorded allophones, each dictionary corresponding to a different narration voice, and means for switching between the dictionaries, at the request of the narrator, such that allophones from the selected dictionary are provided to the synthesizing means.
Claim 13
Dependent Claim
30 words
The system of claim 7, further comprising audio feedback means, operatively coupled to the text-to-speech conversion means, for providing the narrator with an audio feedback of the synthesized speech signal.
Claim 14
Dependent Claim
23 words
The system of claim 11, further comprising means for mixing a background audio signal with the synthesized speech signal feedback to the narrator.
References Cited (Backward Citations)
US4912768A
Cited
US5321514A
Cited
US4979216A
Cited
US5177685A
Cited
US5303393A
Cited
US5384893A
Cited
US5535430A
Cited
US5504482A
Cited
US5544222A
Cited
US5845250A
Cited
US5761640A
Cited
US5729694A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-06-27 | 2003-12-27 | 2004-06-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-06-27 | 2007-12-27 | 2008-06-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-06-27 | 2011-12-27 | 2012-06-27 | $7700.00 | Window Closed / Lapsed |