Patent US6081780A successfully refreshed from Google Patents.
← Back to Patent Explorer
US6081780A Expired / Lapsed US ⏱️ 0.0 years remaining

TTS and prosody based authoring system

Assignee: International Business Machines Corp
•
Filing: 1998-04-28
•
Granted: 2000-06-27
•
Expires: 2018-04-28
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An information signal content authoring system is provided. The authoring system includes a speech analyzer, responsive to a spoken utterance signal provided by a narrator. The spoken utterance signal is representative of information available to the narrator. The speech analyzer generates a speech signal representative of one or more prosodic parameters associated with the narrator. A text-to-speech converter, responsive to a text signal representative of the information available to the narrator, generates a phonetic representation signal from the text signal and synthesizes a speech signal from the text signal. The text-to-speech converter also generates one or more prosodic parameters from the text signal. A spectrum comparator, operatively coupled to the speech analyzer and the text-to-speech converter, compares the spectral parameters of the speech signal generated by the speech analyzer to the speech signal synthesized by the converter and generates a variance signal indicative of a spectral distance between the two speech signals. The variance signal is provided to the text-to-speech converter to adjust the prosodic parameters. An output portion, operatively coupled to the text-to-speech converter, outputs the phonetic representation signal and the prosodic parameters from the converter as a composite encoded signal representative of information content available to the narrator. The output portion further preferably includes an editor, response to editing commands issued by the narrator, for editing at least a portion of the composite encoded signal.

Inventors

  • 👤 Leon Lumelsky

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-02 20:49
CPC Classifications
H; H04; H04M; H04M3/00; H04M3/42; H04M3/487; G; G10; G10L; G10L13/00; G10L13/08; G10L13/02; G10L13/04; G10L19/00; H04M2201/00; H04M2201/60; H04M7/00; H04M7/12

Claims Analysis

Total Claims: 14
Claim 1
Independent Claim 209 words
An information signal content authoring system, comprising: a speech analyzer, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analyzer generating a speech signal representative of at least one prosodic parameter associated with the narrator; a text-to-speech converter, responsive to a text signal representative of the information available to the narrator, the converter generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech converter also generating at least one prosodic parameter from the text signal; a spectrum comparator, operatively coupled to the speech analyzer and the text-to-speech converter, for comparing the at least one prosodic parameter of the speech signal generated by the speech analyzer to the speech signal synthesized by the converter and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech converter to adjust the at least one prosodic parameter; and an output portion, operatively coupled to the text-to-speech converter, for outputting the phonetic representation signal and the at least one prosodic parameter from the converter as a composite encoded signal representative of information content available to the narrator.
Claim 2
Dependent Claim 209 words
An information signal content authoring system, comprising: a speech analyzer, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analyzer generating a speech signal representative of at least one prosodic parameter associated with the narrator; a text-to-speech converter, responsive to a text signal representative of the information available to the narrator, the converter generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech converter also generating at least one prosodic parameter from the text signal; a spectrum comparator, operatively coupled to the speech analyzer and the text-to-speech converter, for comparing the at least one prosodic parameter of the speech signal generated by the speech analyzer to the speech signal synthesized by the converter and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech converter to adjust the at least one prosodic parameter; and an output portion, operatively coupled to the text-to-speech converter, for outputting the phonetic representation signal and the at least one prosodic parameter from the converter as a composite encoded signal representative of information content available to the narrator.
Claim 3
Dependent Claim 32 words
The system of claim 1, wherein the output portion further comprises editing means, response to editing commands issued by the narrator, for editing at least a portion of the composite encoded signal.
Claim 4
Dependent Claim 113 words
The system of claim 1, wherein the text-to-speech converter further comprises: a text-to-phonemes converter for converting the text signal to the phonetic representation signal; a phonemes-to-allophones converter, operatively coupled to the text-to-speech converter, for converting phonemes associated with the phonetic representation signal to allophones; storage means, operatively coupled to the phonemes-to-allophones converter, for storing previously recorded allophones characteristic of at least one narration voice and for selecting the previously recorded allophones which substantially match the allophones provided by the allophone converter; and speech synthesizing means, operatively coupled to the storage means, for generating the synthesized speech signal representative of the text signal in response to the previously recorded allophones from the storage means.
Claim 5
Dependent Claim 58 words
The system of claim 3, wherein the storage means of the text-to-speech conversion means further comprises a plurality of dictionaries of previously recorded allophones, each dictionary corresponding to a different narration voice, and means for switching between the dictionaries, at the request of the narrator, such that allophones from the selected dictionary are provided to the synthesizing means.
Claim 6
Dependent Claim 29 words
The system of claim 1, further comprising audio feedback means, operatively coupled to the text-to-speech converter, for providing the narrator with an audio feedback of the synthesized speech signal.
Claim 7
Dependent Claim 23 words
The system of claim 5, further comprising means for mixing a background audio signal with the synthesized speech signal feedback to the narrator.
Claim 8
Dependent Claim 223 words
An information signal content authoring system, comprising: speech analysis means, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analysis means generating a speech signal representative of at least one prosodic parameter associated with the narrator; text-to-speech conversion means, responsive to a text signal representative of the information available to the narrator, the conversion means generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech conversion means also generating at least one prosodic parameter from the text signal; comparing means, operatively coupled to the speech analysis means and the conversion means, for comparing the at least one prosodic parameter of the speech signal generated by the speech analysis means to the speech signal synthesized by the conversion means and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech conversion means to adjust the at least one prosodic parameter; and output means, operatively coupled to the speech analysis means, the conversion means and the comparing means, for outputting the phonetic representation signal and the at least one prosodic parameter from the conversion means as a composite encoded signal representative of information content available to the narrator.
Claim 9
Dependent Claim 223 words
An information signal content authoring system, comprising: speech analysis means, responsive to a spoken utterance signal provided by a narrator, the spoken utterance signal being representative of information available to the narrator, the speech analysis means generating a speech signal representative of at least one prosodic parameter associated with the narrator; text-to-speech conversion means, responsive to a text signal representative of the information available to the narrator, the conversion means generating a phonetic representation signal from the text signal and synthesizing a speech signal from the text signal, the text-to-speech conversion means also generating at least one prosodic parameter from the text signal; comparing means, operatively coupled to the speech analysis means and the conversion means, for comparing the at least one prosodic parameter of the speech signal generated by the speech analysis means to the speech signal synthesized by the conversion means and generating a variance signal indicative of a spectral distance between the two speech signals, the variance signal being provided to the text-to-speech conversion means to adjust the at least one prosodic parameter; and output means, operatively coupled to the speech analysis means, the conversion means and the comparing means, for outputting the phonetic representation signal and the at least one prosodic parameter from the conversion means as a composite encoded signal representative of information content available to the narrator.
Claim 10
Dependent Claim 32 words
The system of claim 7, wherein the output means further comprises editing means, response to editing commands issued by the narrator, for editing at least a portion of the composite encoded signal.
Claim 11
Dependent Claim 114 words
The system of claim 7, wherein the text-to-speech conversion means further comprises: a text-to-phonemes converter for converting the text signal to the phonetic representation signal; a phonemes-to-allophones converter, operatively coupled to the text-to-speech converter, for converting phonemes associated with the phonetic representation signal to allophones; storage means, operatively coupled to the phonemes-to-allophones converter, for storing previously recorded allophones characteristic of at least one narration voice and for selecting the previously recorded allophones which substantially match the allophones provided by the allophone converter; and speech synthesizing means, operatively coupled to the storage means, for generating the synthesized speech signal representative of the text signal in response to the previously recorded allophones from the storage means.
Claim 12
Dependent Claim 58 words
The system of claim 9, wherein the storage means of the text-to-speech conversion means further comprises a plurality of dictionaries of previously recorded allophones, each dictionary corresponding to a different narration voice, and means for switching between the dictionaries, at the request of the narrator, such that allophones from the selected dictionary are provided to the synthesizing means.
Claim 13
Dependent Claim 30 words
The system of claim 7, further comprising audio feedback means, operatively coupled to the text-to-speech conversion means, for providing the narrator with an audio feedback of the synthesized speech signal.
Claim 14
Dependent Claim 23 words
The system of claim 11, further comprising means for mixing a background audio signal with the synthesized speech signal feedback to the narrator.

References Cited (Backward Citations)

US4912768A Cited
US5321514A Cited
US4979216A Cited
US5177685A Cited
US5303393A Cited
US5384893A Cited
US5535430A Cited
US5504482A Cited
US5544222A Cited
US5845250A Cited
US5761640A Cited
US5729694A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-06-27 2003-12-27 2004-06-27 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-06-27 2007-12-27 2008-06-27 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-06-27 2011-12-27 2012-06-27 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag