Patent US3689696A successfully refreshed from Google Patents.
← Back to Patent Explorer
US3689696A Expired / Lapsed US ⏱️ 0.0 years remaining

Speech synthesis from a spectrographic trace

Assignee: Individual
•
Filing: 1970-01-09
•
Granted: 1972-09-05
•
Expires: 1990-01-09
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A voice synthesis system using a sound spectrogram, showing the spectrum in the form of a plot of frequency against time with intensity being represented by the variable density of the plot. The spectrogram is scanned and analog signals are produced the amplitude of which is a function of the density of the spectrogram plot. Synchronously with the production of the analog signals oscillation signals are produced at the respective scanning frequencies and are amplitude modulated by the analog signal. The amplitude modulated oscillation signals are stored and summed and subsequently reproduced thereby synthesizing an acoustic signal.

Inventors

  • 👤 Kiyoshi Inoue

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-25 21:32
CPC Classifications
G; G10; G10L; G10L19/00; G10L19/02

Claims Analysis

Total Claims: 29
Claim 1
Independent Claim 164 words
A method of synthesizing an acoustical signal from a spectrograph trace in which component frequency portions of sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said method comprising the stEps of: scanning said trace successively for said incremental frequency portions over said period and deriving analog signals of amplitude as a function of the density of the plot of the respective frequencies; synchronously with the scanning of the trace generating oscillation signals at the respective scanning frequencies during said period and amplitude-modulating said oscillation signals by the analog signals of amplitude to produce amplitude-modulated oscillation signals; recording said amplitude-modulated oscillation signals upon a medium in a multiplicity of tracks; scanning said medium and generating automatically in response to the scanning of the medium a reproduction of the recorded signals to produce a synthesized acoustic signal corresponding to a summation of the amplitude-modulated signals.
Claim 2
Independent Claim 164 words
A method of synthesizing an acoustical signal from a spectrograph trace in which component frequency portions of sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said method comprising the stEps of: scanning said trace successively for said incremental frequency portions over said period and deriving analog signals of amplitude as a function of the density of the plot of the respective frequencies; synchronously with the scanning of the trace generating oscillation signals at the respective scanning frequencies during said period and amplitude-modulating said oscillation signals by the analog signals of amplitude to produce amplitude-modulated oscillation signals; recording said amplitude-modulated oscillation signals upon a medium in a multiplicity of tracks; scanning said medium and generating automatically in response to the scanning of the medium a reproduction of the recorded signals to produce a synthesized acoustic signal corresponding to a summation of the amplitude-modulated signals.
Claim 3
Dependent Claim 22 words
The method defined in claim 1 wherein said signals are additively combined by simultaneously reproducing signals from all of the recorded trace.
Claim 4
Dependent Claim 30 words
The method defined in claim 1 wherein the acoustical signal reproduced from the recording of said amplitude-modulated oscillation signals is substantially identical to the acoustical input forming said spectrographic trace.
Claim 5
Dependent Claim 31 words
The method defining in claim 3, further comprising the step of subtracting a part of the acoustical signal represented by said spectrographic trace prior to reproducing the recorded amplitude-modulated oscillation signals.
Claim 6
Dependent Claim 20 words
The method defined in claim 4 wherein said spectrographic trace is a voice spectrogram of the pronunciation of an individual.
Claim 7
Dependent Claim 89 words
The method defined in claim 1, further comprising the steps of preparing said spectrographic trace prior to the scanning thereof, by plotting component waves of an acoustical input along incremental frequency bands against time over said period while recording the intensity of the component waves as relative lightness and darkness of the respective plots at the corresponding frequency-time points; and modifying at least a portion of the plotted information prior to the scanning of the spectrographic and trace acoustically comparing the synthesized acoustic signal with the original acoustic input.
Claim 8
Dependent Claim 42 words
The method defined in claim 6 wherein a further spectrographic trace is produced from the spectrographic trace as first prepared by modifying information relating to at least some of the component frequencies, said further spectrographic trace being subjected to the scanning step.
Claim 9
Dependent Claim 22 words
The method defined in claim 6 wherein the component waves of the acoustic input are plotted successively in said incremental frequency bands.
Claim 10
Independent Claim 198 words
A method of synthesizing an acoustical signal from a spectrographic trace in which component frequency portions of sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said method comprising the steps of: scanning said trace successively for said incremental frequency portions over said period and deriving analog signals of amplitude as a function of the density of the plot of the respective frequencies; synchronously with the scanning of the trace generating oscillation signals at the respective scanning frequencies during said period and amplitude-modulating said oscillation signals by the analog signals of amplitude to produce amplitude-modulated oscillation signals; recording said amplitude-modulated oscillation signals upon a medium; and scanning said medium and generating automatically in response to the scanning of the medium a reproduction of the recorded signals to produce a synthesized acoustic signal corresponding to a summation of the amplitude-modulated signals, each amplitude-modulated oscillation signal but the first being combined with a previously recorded amplitude-modulated oscillation signal during a previous scan whereby the final recording represents a summation of all of said amplitude-modulated oscIllation signals on a single track.
Claim 11
Independent Claim 198 words
A method of synthesizing an acoustical signal from a spectrographic trace in which component frequency portions of sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said method comprising the steps of: scanning said trace successively for said incremental frequency portions over said period and deriving analog signals of amplitude as a function of the density of the plot of the respective frequencies; synchronously with the scanning of the trace generating oscillation signals at the respective scanning frequencies during said period and amplitude-modulating said oscillation signals by the analog signals of amplitude to produce amplitude-modulated oscillation signals; recording said amplitude-modulated oscillation signals upon a medium; and scanning said medium and generating automatically in response to the scanning of the medium a reproduction of the recorded signals to produce a synthesized acoustic signal corresponding to a summation of the amplitude-modulated signals, each amplitude-modulated oscillation signal but the first being combined with a previously recorded amplitude-modulated oscillation signal during a previous scan whereby the final recording represents a summation of all of said amplitude-modulated oscIllation signals on a single track.
Claim 12
Dependent Claim 25 words
The method defined in claim 9 wherein said trace is a visible spectrogram and said density is the relative darkness of parts of the trace.
Claim 13
Dependent Claim 16 words
The method defined in claim 9 wherein said spectrographic trace is formed from an acoustical input.
Claim 14
Dependent Claim 19 words
The method defined in claim 9 wherein said spectrographic trace is prepared artificially based upon analysis of related sound.
Claim 15
Independent Claim 227 words
A method of analyzing an acoustic input, comprising the steps of: a. detecting successive incremental frequency bands of the acoustic input and resonating a mechanical element at the band frequency with an oscillation amplitude representing the intensity of the corresponding frequency band; b. recording for each incremental frequency band detected in step (a), a visible plot with the amplitude of the corresponding frequency band at each instant of time during a time interval represented by a corresponding degree of darkness of the plot, thereby forming a spectrographic trace in which component frequency waves of the acoustic input are incrementally plotted against time over a given time period with the intensity of the component waves indicated by relative darkness of the plots at the corresponding frequency-time points; c. optically scanning said trace successively for said incremental frequencies and deriving an electrical output of an amplitude varying with time in accordance with the relative darkness of the plot of the corresponding frequency; d. generating an electrical oscillation of a frequency corresponding to each of the scanned frequencies in step (c) and amplitude modulating the electrical oscillation with the corresponding electrical output of step (c) to form amplitude-modulated oscillation signals; e. electrically combining the amplitude-modulated oscillation signals of step (d) for the incremental frequencies; and f. automatically converting the combined amplitude-modulated oscillation signals of step (e) into an acoustic output.
Claim 16
Independent Claim 227 words
A method of analyzing an acoustic input, comprising the steps of: a. detecting successive incremental frequency bands of the acoustic input and resonating a mechanical element at the band frequency with an oscillation amplitude representing the intensity of the corresponding frequency band; b. recording for each incremental frequency band detected in step (a), a visible plot with the amplitude of the corresponding frequency band at each instant of time during a time interval represented by a corresponding degree of darkness of the plot, thereby forming a spectrographic trace in which component frequency waves of the acoustic input are incrementally plotted against time over a given time period with the intensity of the component waves indicated by relative darkness of the plots at the corresponding frequency-time points; c. optically scanning said trace successively for said incremental frequencies and deriving an electrical output of an amplitude varying with time in accordance with the relative darkness of the plot of the corresponding frequency; d. generating an electrical oscillation of a frequency corresponding to each of the scanned frequencies in step (c) and amplitude modulating the electrical oscillation with the corresponding electrical output of step (c) to form amplitude-modulated oscillation signals; e. electrically combining the amplitude-modulated oscillation signals of step (d) for the incremental frequencies; and f. automatically converting the combined amplitude-modulated oscillation signals of step (e) into an acoustic output.
Claim 17
Dependent Claim 71 words
The method defined in claim 13 wherein said amplitude-modulated oscillation signals are combined in step (e) by recording the first amplitude-modulated oscillation signal upon one recording track, recording the next amplitude-modulated oscillation signal and the previously recorded amplitude-modulated oscillation signal upon another recording track while cancelling the previously made recording, and repeating the recordal and cancellation steps until one of said tracks carries a recording of the combined amplitude-modulated oscillation signals.
Claim 18
Dependent Claim 22 words
The method defined in claim 13 wherein said amplitude-modulated oscillation signals are combined by recording them individually upon a single recording medium.
Claim 19
Independent Claim 171 words
An apparatus for the synthesis of an acoustic output from a spectrographic trace in which component frequency portions of an original sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said apparatus comprising: scanning means for repetitively scanning said trace successively for said incremental frequencies and deriving for each of the scanned frequencies analog signals of an amplitude varying with the time in proportion to the density of the plots of the respective component frequencies; oscillator means operatively connected with said scanning means for producing respective oscillation signal corresponding to each of the scanning frequencies; amplitude-modulating means connected with said scanning means and with said oscillator means for producing an amplitude-modulated oscillation signal as a function of time for each of the scanned frequencies; means for combining at least some of said amplitude-modulated oscillation signals; and electroacoustic transducer means for producing an acoustical output corresponding to the combined amplitude-modulated oscillation signals.
Claim 20
Independent Claim 171 words
An apparatus for the synthesis of an acoustic output from a spectrographic trace in which component frequency portions of an original sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said apparatus comprising: scanning means for repetitively scanning said trace successively for said incremental frequencies and deriving for each of the scanned frequencies analog signals of an amplitude varying with the time in proportion to the density of the plots of the respective component frequencies; oscillator means operatively connected with said scanning means for producing respective oscillation signal corresponding to each of the scanning frequencies; amplitude-modulating means connected with said scanning means and with said oscillator means for producing an amplitude-modulated oscillation signal as a function of time for each of the scanned frequencies; means for combining at least some of said amplitude-modulated oscillation signals; and electroacoustic transducer means for producing an acoustical output corresponding to the combined amplitude-modulated oscillation signals.
Claim 21
Dependent Claim 67 words
The apparatUs defined in claim 16 wherein said trace is visible and the varying density of said plots is represented by different degrees of darkness, said scanning means including an optical scanner adapted to sweep said trace and provided with a source of illumination trained at said plots successively and optically sensitive pickup means receiving reflected light from said plots for detecting the degree of darkness thereof.
Claim 22
Dependent Claim 35 words
The apparatus defined in claim 16 wherein said means for combining said amplitude-modulated oscillation signals includes a single recording medium and means for recording said amplitude-modulated oscillation signals successively on separate tracks of said medium.
Claim 23
Dependent Claim 61 words
The apparatus defined in claim 16 wherein said scanning means includes a drum carrying said trace and rotatable about an axis parallel to the time axis of said trace and a scanning head displaceable parallel to a generatrix of said drum, said oscillator means comprising a variable-frequency oscillator having a frequency-selection member and means operatively connecting said head with said member.
Claim 24
Independent Claim 291 words
An apparatus for the synthesis of an acoustic output from a spectrographic trace in which component frequency portions of an original sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said apparatus comprising: scanning means for repetitively scanning said trace successively for said incremental frequencies and deriving for each of the scanned frequencies analog signals of an amplitude varying with the time in proportion to the density of the plots of the respective component frequencies; oscillator means operatively connected with said scanning means for producing respective oscillation signal corresponding to each of the scanning frequencies; amplitude-modulating means connected with said scanning means and with said oscillator means for producing an amplitude-modulated oscillation signal as a function of time for each of the scanned frequencies; means for combining at least some of said amplitude-modulated oscillation signals; and electroacoustic transducer means for producing an acoustical output corresponding to the combined amplitude-modulated oscillation signals, said means for combining said amplitude-modulated oscillation signals including a pair of synchronously driven recording tracks, recording means associated with each of said tracks, playback means associated with each of said tracks, cancellation means associated with each of said tracks, and switch means operable to connect the recording means of one of said tracks to said amplitude-modulating means and the playback means of the other of said tracks to said recording means of said one of said tracks to record the amplitude-modulated oscillation signal of the frequency currently scanned by said scanning means upon said one of said tracks concurrently with a previously recorded amplitude-modulated oscillation signal from said other track, while cancelling the recorded signal on said other track.
Claim 25
Independent Claim 291 words
An apparatus for the synthesis of an acoustic output from a spectrographic trace in which component frequency portions of an original sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said apparatus comprising: scanning means for repetitively scanning said trace successively for said incremental frequencies and deriving for each of the scanned frequencies analog signals of an amplitude varying with the time in proportion to the density of the plots of the respective component frequencies; oscillator means operatively connected with said scanning means for producing respective oscillation signal corresponding to each of the scanning frequencies; amplitude-modulating means connected with said scanning means and with said oscillator means for producing an amplitude-modulated oscillation signal as a function of time for each of the scanned frequencies; means for combining at least some of said amplitude-modulated oscillation signals; and electroacoustic transducer means for producing an acoustical output corresponding to the combined amplitude-modulated oscillation signals, said means for combining said amplitude-modulated oscillation signals including a pair of synchronously driven recording tracks, recording means associated with each of said tracks, playback means associated with each of said tracks, cancellation means associated with each of said tracks, and switch means operable to connect the recording means of one of said tracks to said amplitude-modulating means and the playback means of the other of said tracks to said recording means of said one of said tracks to record the amplitude-modulated oscillation signal of the frequency currently scanned by said scanning means upon said one of said tracks concurrently with a previously recorded amplitude-modulated oscillation signal from said other track, while cancelling the recorded signal on said other track.
Claim 26
Independent Claim 216 words
An apparatus for the synthesis of an acoustic output from a spectrographic trace in which component frequency portions of an original sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said apparatus comprising: scanning means for repetitively scanning said trace successively for said incremental frequencies and deriving for each of the scanned frequencies analog signals of an amplitude varying with the time in proportion to the density of the plots of the respective component frequencies; oscillator means operatively connected with said scanning means for producing respective oscillation signals corresponding to each of the scanning frequencies; amplitude-modulating mEans connected with said scanning means and with said oscillator means for producing an amplitude-modulated oscillation signal as a function of time for each of the scanned frequencies; means for combining at least some of said amplitude-modulated oscillation signals; electroacoustic transducer means for producing an acoustical output corresponding to the combined amplitude-modulated oscillation signals; sound-analyzing means for producing said trace and including vibratory means having a resonance-shifting member, means responsive to an acoustical input for energizing said vibratory means; and means responsive to the amplitude of vibration of said vibratory means at successive resonant frequencies thereof for forming said trace.
Claim 27
Independent Claim 216 words
An apparatus for the synthesis of an acoustic output from a spectrographic trace in which component frequency portions of an original sound are incrementally plotted against time over a predetermined time period with the intensity of the components being represented by varying density of the plots at corresponding frequency-time points, said apparatus comprising: scanning means for repetitively scanning said trace successively for said incremental frequencies and deriving for each of the scanned frequencies analog signals of an amplitude varying with the time in proportion to the density of the plots of the respective component frequencies; oscillator means operatively connected with said scanning means for producing respective oscillation signals corresponding to each of the scanning frequencies; amplitude-modulating mEans connected with said scanning means and with said oscillator means for producing an amplitude-modulated oscillation signal as a function of time for each of the scanned frequencies; means for combining at least some of said amplitude-modulated oscillation signals; electroacoustic transducer means for producing an acoustical output corresponding to the combined amplitude-modulated oscillation signals; sound-analyzing means for producing said trace and including vibratory means having a resonance-shifting member, means responsive to an acoustical input for energizing said vibratory means; and means responsive to the amplitude of vibration of said vibratory means at successive resonant frequencies thereof for forming said trace.
Claim 28
Dependent Claim 30 words
The apparatus defined in claim 21 wherein said sound analyzing means includes a recording head adapted to sweep a recording medium for producing an electrical discharge forming visible marks thereon.
Claim 29
Dependent Claim 54 words
The apparatus defined in claim 21 wherein said vibratory means includes a tuning fork, said member being shiftable between the arms of said fork, said input means constituting a first electromagnetic transducer co-operating with one of said arms and said output means constituting a second electromagnetic transducer co-operating with the other of said arms.

References Cited (Backward Citations)

US2403985A Cited
US2475742A Cited
US2671375A Cited
US3114980A Cited
US2996667A Cited
US3280257A Cited
US3355551A Cited
US3532821A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1975-09-05 1976-03-06 1976-09-05 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1979-09-05 1980-03-06 1980-09-05 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 1983-09-05 1984-03-06 1984-09-05 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag