Method and device for detecting and separating voices in a complex musical composition

Claim 2

A sound signal analyzer for automatic detection and separation of a single voice in a complex musical composition comprising (a) waveform signal conversion means responsive to an electrical waveform signal having a frequency corresponding to the frequency of an audible sound wave for the complex musical composition for converting the electrical waveform signal to a complex frequency spectrum representation for the complex musical composition; (b) frequency spectrum representation comparison means responsive to the complex frequency spectrum representation derived by said conversion means for comparing the complex frequency spectrum representation to predetermined steady-state, single-voice frequency spectrum representations corresponding to notes capable of being produced by a single instrument included in the complex musical composition; (c) single-voice frequency spectrum representation detection means responsive to said frequency spectrum representation comparison means for detecting the presence of a predetermined steady-state, single-voice frequency spectrum representation corresponding to a note capable of being produced by the single instrument; and (d) frequency spectrum representation separation means responsive to the predetermined steady-state, single-voice frequency spectrum representation detected by the single-voice frequency spectrum representation detection means for separating the detected steady-state, single-voice frequency spectrum representation and respective complex frequency spectrum representations in growth and decay periods of the note corresponding to the detected frequency spectrum representation, said steady-state, growth and decay frequency spectrum representations, in combination, defining a measured waveform envelope representation.

Claim 3

A sound signal analyzer as in claim 1 further including (e) waveform envelope representation comparison means responsive to the measured waveform envelope representation for comparing the measured waveform envelope representation to predetermined single-voice waveform envelope representations corresponding to notes capable of being produced by the single instrument; (f) waveform envelope representation detection means responsive to said waveform envelope representation comparison means for detecting the presence of a predetermined single-voice waveform envelope representation corresponding to the note depicted by the steady-state, single-voice frequency spectrum representation included in the measured waveform envelope representation; and (g) waveform envelope representation separation means responsive to the waveform envelope representation detected by the waveform envelope representation detection means for separating the detected single-voice waveform envelope representation.

Claim 4

A sound signal analyzer as in claim 2 further including data output means to output the detected single-voice waveform envelope representation as music data.

Claim 5

A sound signal analyzer as in claim 3 wherein said music data comprises audible musical sound.

Claim 6

A sound signal analyzer as in claim 3 wherein said music data comprises music notation.

Claim 7

A sound signal analyzer as in claim 3 wherein said data output means comprises, in combination, means to record the detected single-voice waveform envelope representation in a readable form and means to convert the recorded waveform envelope representation to an electrical waveform signal.

Claim 8

A sound signal analyzer as in claim 2 comprising at least two frequency spectrum representation comparison means, at least two single-voice frequency spectrum representation detection means, at least two frequency spectrum representation separation means, at least two waveform envelope representation detection means, and at least two waveform envelope representation separation means, corresponding to at least two distinct instruments in the complex musical composition.

Claim 9

A sound signal analyzer as in claim 7 further including at least two data output to output the respective detected single-voice waveform envelope representations as music data corresponding to at least two distinct instruments in the complex musical composition.

Claim 10

A sound signal analyzer as in claim 8 further including at least two filtering means disposed between respective waveform envelope representation separation means and successive frequency spectrum representation comparison means.

Claim 11

A sound signal analyzer as in claim 10 further including clock means for sequentially cuing the complex frequency spectrum representations derived by the waveform signal conversion means and filtered by said filtering means.

Claim 12

A sound signal analyzer as in claim 1 comprising at least two frequency spectrum representation comparison means, at least two single-voice frequency spectrum representation detection means, and at least two frequency spectrum representation separation means, corresponding to at least two distinct instruments in the complex musical composition.

Claim 13

A voice detection and separation system for detecting and separating a single voice in a complex musical composition comprising (i) sound wave conversion means responsive to audible sound waves of the complex musical composition for converting the sound waves into an electrical waveform signal; (ii) amplifier means for amplifying the electrical waveform signal derived by said sound wave conversion means; and (iii) a sound signal analyzer comprising: (a) waveform signal conversion means responsive to the amplified electrical waveform signal for converting the electrical waveform signal to a complex frequency spectrum representation for the complex musical composition, (b) frequency spectrum representation comparison means responsive to the complex frequency spectrum representation derived by said waveform signal conversion means for comparing the complex frequency spectrum representation to predetermined steady-state, single-voice frequency spectrum representations corresponding to notes capable of being produced by a single instrument included in the complex musical composition, (c) single-voice frequency spectrum representation detection means responsive to said frequency spectrum representation comparison means for detecting the presence of a predetermined steady-state, single-voice frequency spectrum representation corresponding to a note capable of being produced by the single instrument, and (d) frequency spectrum representation separation means responsive to the predetermined steady-state, single-voice frequency spectrum representation detected by the single-voice frequency spectrum representation detection means for separating the detected steady-state, single-voice frequency spectrum representation and respective complex frequency spectrum representations in growth and decay periods of the note corresponding to the detected frequency spectrum representation, said steady-state, growth and decay frequency spectrum representations, in combination, defining a measured waveform envelope representation.

Claim 14

A voice detection and separation system for detecting and separating a single voice in a complex musical composition comprising (i) sound wave conversion means responsive to audible sound waves of the complex musical composition for converting the sound waves into an electrical waveform signal; (ii) amplifier means for amplifying the electrical waveform signal derived by said sound wave conversion means; and (iii) a sound signal analyzer comprising: (a) waveform signal conversion means responsive to the amplified electrical waveform signal for converting the electrical waveform signal to a complex frequency spectrum representation for the complex musical composition, (b) frequency spectrum representation comparison means responsive to the complex frequency spectrum representation derived by said waveform signal conversion means for comparing the complex frequency spectrum representation to predetermined steady-state, single-voice frequency spectrum representations corresponding to notes capable of being produced by a single instrument included in the complex musical composition, (c) single-voice frequency spectrum representation detection means responsive to said frequency spectrum representation comparison means for detecting the presence of a predetermined steady-state, single-voice frequency spectrum representation corresponding to a note capable of being produced by the single instrument, and (d) frequency spectrum representation separation means responsive to the predetermined steady-state, single-voice frequency spectrum representation detected by the single-voice frequency spectrum representation detection means for separating the detected steady-state, single-voice frequency spectrum representation and respective complex frequency spectrum representations in growth and decay periods of the note corresponding to the detected frequency spectrum representation, said steady-state, growth and decay frequency spectrum representations, in combination, defining a measured waveform envelope representation.

Claim 15

A voice detection and separation system as in claim 12 wherein said audible sound waves are produced by a live performance of a plurality of musical instruments.

Claim 16

A voice detection and separation system as in claim 12 wherein said audible sound waves are produced by a stored performance of a plurality of musical instruments.

Claim 17

A voice detection and separation system as in claim 12 wherein said waveform signal conversion means comprises means to automatically separate fundamental and overtone frequency components of the complex musical composition and simultaneously measure the frequency and amplitude of the respective fundamental and overtone frequency components.

Claim 18

A voice detection and separation system as in claim 15 wherein said frequency spectrum representation comparison means, said single-voice frequency spectrum detection means and said frequency spectrum representation separation means comprise, in combination, a frequency spectrum comparator made operable by an algorithm providing directives to respectively compare the frequency and amplitude of said respective fundamental and overtone frequency components of the complex musical composition to fundamental and overtone frequency components of a single voice, detect the presence of said single-voice frequency components in said complex frequency components, and separate said single-voice frequency components from said complex frequency components.

Claim 19

A voice detection and separation system as in claim 15 wherein said frequency spectrum comparator includes an accumulating memory for temporary storage of frequency spectrum representations in growth and decay periods of the note corresponding to the detected frequency spectrum representation derived by said single-voice frequency spectrum representation detection means.

Claim 20

A voice detection and separation system for detecting and separating a voice in a complex musical composition comprising (i) sound wave conversion means responsive to audible sound wave of the complex musical composition for converting the sound waves into an electrical waveform signal; (ii) amplifier means for amplifying the electrical waveform signal derived by said sound wave conversion means; and (iii) a sound signal analyzer comprising: (a) waveform signal conversion means responsive to the amplified electrical waveform signal frequency corresponding to the frequency of an audible sound wave for the complex musical for converting the electrical waveform signal to a complex frequency spectrum representation for the complex musical composition, (b) frequency spectrum representation comparison means responsive to the complex frequency spectrum representation derived by said conversion means for comparing the complex frequency spectrum representation to predetermined steady-state, single-voice frequency spectrum representations corresponding to notes capable of being produced by a single instrument included in the complex musical composition, (c) single-voice frequency spectrum representation detection means responsive to said frequency spectrum representation comparison means for detecting the presence of a predetermined steady-state, single-voice frequency spectrum representation corresponding to a note capable of being produced by the single instrument, (d) frequency spectrum representation separation means responsive to the predetermined steady-state, single-voice frequency spectrum representation detected by the single-voice frequency spectrum representation detection means for separating the detected steady-state, single-voice frequency spectrum representation and respective complex frequency spectrum representations in growth and decay periods of the note corresponding to the detected frequency spectrum representation, said steady-state, growth and decay frequency spectrum representations, in combination, defining a measured waveform envelope representation, (e) waveform envelope representation comparison means responsive to the measured waveform envelope representation for comparing the measured waveform envelope representation to predetermined single-voice waveform envelope representations corresponding to notes capable of being produced by the single instrument, (f) waveform envelope representation detection means responsive to said waveform envelope representation comparison means for detecting the presence of a predetermined single-voice waveform envelope representation corresponding to the note depicted by the steady-state, single-voice frequency spectrum representation included in the measured waveform envelope representation, and (g) waveform envelope representation separation means responsive to the waveform envelope representation detected by the waveform envelope representation detection means for separating the detected single-voice waveform envelope representation.

Claim 21

A voice detection and separation system for detecting and separating a voice in a complex musical composition comprising (i) sound wave conversion means responsive to audible sound wave of the complex musical composition for converting the sound waves into an electrical waveform signal; (ii) amplifier means for amplifying the electrical waveform signal derived by said sound wave conversion means; and (iii) a sound signal analyzer comprising: (a) waveform signal conversion means responsive to the amplified electrical waveform signal frequency corresponding to the frequency of an audible sound wave for the complex musical for converting the electrical waveform signal to a complex frequency spectrum representation for the complex musical composition, (b) frequency spectrum representation comparison means responsive to the complex frequency spectrum representation derived by said conversion means for comparing the complex frequency spectrum representation to predetermined steady-state, single-voice frequency spectrum representations corresponding to notes capable of being produced by a single instrument included in the complex musical composition, (c) single-voice frequency spectrum representation detection means responsive to said frequency spectrum representation comparison means for detecting the presence of a predetermined steady-state, single-voice frequency spectrum representation corresponding to a note capable of being produced by the single instrument, (d) frequency spectrum representation separation means responsive to the predetermined steady-state, single-voice frequency spectrum representation detected by the single-voice frequency spectrum representation detection means for separating the detected steady-state, single-voice frequency spectrum representation and respective complex frequency spectrum representations in growth and decay periods of the note corresponding to the detected frequency spectrum representation, said steady-state, growth and decay frequency spectrum representations, in combination, defining a measured waveform envelope representation, (e) waveform envelope representation comparison means responsive to the measured waveform envelope representation for comparing the measured waveform envelope representation to predetermined single-voice waveform envelope representations corresponding to notes capable of being produced by the single instrument, (f) waveform envelope representation detection means responsive to said waveform envelope representation comparison means for detecting the presence of a predetermined single-voice waveform envelope representation corresponding to the note depicted by the steady-state, single-voice frequency spectrum representation included in the measured waveform envelope representation, and (g) waveform envelope representation separation means responsive to the waveform envelope representation detected by the waveform envelope representation detection means for separating the detected single-voice waveform envelope representation.

Claim 22

A voice detection and separation system as in claim 18 wherein said audible sound waves are produced by a live performance of at least two musical instruments.

Claim 23

A voice detection and separation system as in claim 18 wherein said audible sound waves are produced by a stored performance of at least two musical instruments.

Claim 24

A voice detection and separation system as in claim 18 wherein said audible sound waves are produced by a live performance of at least one musical instrument in combination with a stored performance of at least one musical instrument.

Claim 25

A voice detection and separation system as in claim 18 wherein said waveform signal conversion means comprises means to automatically separate fundamental and overtone frequency components of the complex musical composition and simultaneously measure the frequency and amplitude of the respective fundamental and overtone frequency components.

Claim 26

A voice detection and separation system as in claim 22 wherein said frequency spectrum representation comparison means, said single-voice frequency spectrum detection means and said frequency spectrum representation separation means comprise, in combination, a frequency spectrum comparator made operable by an algorithm providing directives to respectively compare the frequency and amplitude of said respective fundamental and overtone frequency components of the complex musical composition to fundamental and overtone frequency components of a single voice, detect the presence of said single-voice frequency components in said complex frequency components, and separate said single-voice frequency components from said complex frequency components.

Claim 27

A voice detection and separation system as in claim 23 wherein said waveform envelope representation comparison means, said waveform envelope representation detection means and said waveform envelope representation separation means, in combination, comprise a waveform envelope comparator made operable by an algorithm providing directives to respectively compare said separated single-voice frequency components to stored transient properties of a single voice, detect the presence of said stored transient properties in said single-voice frequency components, and separate the transient properties and the frequency components of said detected single voice.

Claim 28

A voice detection and separation system as in claim 23, said sound signal analyzer further including (h) a key comparator communicating with said frequency spectrum comparator via a gate controller, said key comparator comprising key memory means for storing musical keys and associated notes, said gate controller comprising means to effect the operation of said frequency spectrum comparator in accordance to the operation of an algorithm in said key comparator providing directives to determine the key of the complex musical composition.

Claim 29

A voice detection and separation system as in claim 25 further including means to selectively program said key memory means.

Claim 30

A voice detection and separation system as in claim 25 wherein said key comparator includes means to sample the detected frequency spectrum representation in said frequency spectrum comparator and means to compare said sampled frequency spectrum representation to musical keys and associated notes stored in said key memory means.

Claim 31

A voice detection and separation system as in claim 25 wherein said gate controller includes means to shift the stored frequency spectrum representations in said frequency spectrum comparator.

Claim 32

A voice detection and separation system as in claim 25 wherein said separated single-voice frequency spectrum representation is supplied to an auxiliary device.

Claim 33

A voice detection and separation system as in claim 29 wherein said auxiliary device comprises a note transposer for transposing in real time the separated single-voice frequency spectrum representation to a note in said key memory means.

Claim 34

A voice detection and separation system as in claim 25 further including means to supply the stored musical keys and associated notes to a display device.

Claim 35

A voice detection and separation system as in claim 25 further including means to formulate subsets of said musical keys and associated notes by counting the number of times a specific note within a musical key is sounded within a particular period of time.

Claim 36

A voice detection and separation system as in claim 22 wherein said frequency spectrum comparator includes an accumulating memory for temporary storage of frequency spectrum representations in growth and decay periods of the note corresponding to the detected frequency spectrum representation derived by said single-voice frequency spectrum representation detection means.

Claim 37

A voice detecting and separation system for detecting and separating a single voice in a complex musical composition comprising (i) signal generating means for generating a composition electrical waveform signal corresponding to audible sound waves of the complex musical composition, (ii) voice detecting and separating means connected to said signal generating means for detecting a voice electrical waveform signal corresponding to a tonal structure of an individual voice in the complex musical composition and for separating the detected voice electrical waveform signal from the composition electrical waveform signal, said voice detecting and separating means detecting the voice electrical waveform signal by comparing the composition electrical waveform signal to predetermined instantaneous and transient properties of tonal structure representations for the individual voice.

Claim 38

A voice detecting and separation system for detecting and separating a single voice in a complex musical composition comprising (i) signal generating means for generating a composition electrical waveform signal corresponding to audible sound waves of the complex musical composition, (ii) voice detecting and separating means connected to said signal generating means for detecting a voice electrical waveform signal corresponding to a tonal structure of an individual voice in the complex musical composition and for separating the detected voice electrical waveform signal from the composition electrical waveform signal, said voice detecting and separating means detecting the voice electrical waveform signal by comparing the composition electrical waveform signal to predetermined instantaneous and transient properties of tonal structure representations for the individual voice.

Claim 39

A voice detection and separation system as in claim 34 wherein said voice detecting and separating means further detects the voice electrical waveform signal by comparing said voice electrical waveform signal properties of tonal structure representations for the individual voice determinable as a function of the key of the complex musical composition.

Claim 40

A voice detection and separation system as in claim 34 further including recording means connected to said voice detecting and separating means for recording the detected voice electrical waveform signal.

Claim 41

A voice detection and separation system as in claim 36 further including music data output means connected to said recording means for outputting the detected voice electrical waveform signal as music data.

Claim 42

A voice detection and separation system as in claim 37 wherein said music data comprises audible sounds.

Claim 43

A voice detection and separation system as in claim 37 wherein said music data comprises music notation.

Claim 44

A voice detection and separation system as in claim 34 wherein said voice detecting and separating means comprises a waveform signal converter connected to said signal generating means for converting the electrical waveform signal corresponding to a tonal structure of the complex musical composition into a frequency spectrum representation for the tonal structure of the complex musical composition; a frequency spectrum comparator connected to said waveform signal converter for detecting and separating a frequency spectrum representation for an individual voice in the complex musical composition by comparing the frequency spectrum representation for the tonal structure of the complex musical composition with a plurality of predetermined instantaneous frequency spectrum representations for the individual voice; and a waveform envelope comparator connected to said frequency spectrum comparator for detecting and separating a waveform envelope representation for the frequency spectrum representation for the individual voice in the complex musical composition by comparing the waveform envelope representation for the individual voice with a plurality of predetermined waveform envelope representations for the individual voice.

Claim 45

A voice detection and separation system as in claim 40 wherein said plurality of predetermined instantaneous frequency spectrum representations comprise a plurality of instantaneous frequency spectrum representations corresponding to notes capable of being produced by the individual voice.

Claim 46

A voice detection and separation system as in claim 41 wherein said plurality of predetermined waveform envelope representations comprise a plurality of waveform envelope representations corresponding to the notes capable of being produced by the individual voice.

Claim 47

A voice detection and separation system as in claim 34 wherein a plurality of voice detecting and separating means are connected to said signal generating means corresponding to the plurality of voices in the complex musical composition.

Claim 48

A sound signal analyzer for detecting and separating individual voices in a composition electrical waveform signal corresponding to a tonal structure of a complex musical composition, said sound signal analyzer comprising a waveform signal converter connected to the electrical waveform signal for the tonal structure of the complex musical composition comprising means to convert the electrical waveform signal into a frequency spectrum representation for the complex musical composition; at least one frequency spectrum comparator connected to the waveform signal converter comprising means to detect and separate a frequency spectrum representation for an individual voice in the complex musical composition; and at least one waveform envelope comparator corresponding in number to the frequency spectrum comparators and respectively connected to the frequency spectrum comparators comprising means to detect and separate a waveform envelope representation for the frequency spectrum representation for the individual voice detected and separated by the respective frequency spectrum comparators.

Claim 49

A sound signal analyzer for detecting and separating individual voices in a composition electrical waveform signal corresponding to a tonal structure of a complex musical composition, said sound signal analyzer comprising a waveform signal converter connected to the electrical waveform signal for the tonal structure of the complex musical composition comprising means to convert the electrical waveform signal into a frequency spectrum representation for the complex musical composition; at least one frequency spectrum comparator connected to the waveform signal converter comprising means to detect and separate a frequency spectrum representation for an individual voice in the complex musical composition; and at least one waveform envelope comparator corresponding in number to the frequency spectrum comparators and respectively connected to the frequency spectrum comparators comprising means to detect and separate a waveform envelope representation for the frequency spectrum representation for the individual voice detected and separated by the respective frequency spectrum comparators.

Claim 50

A sound signal analyzer as in claim 44 further including a clock means for sequentially queuing the frequency spectrum representations for the complex musical composition to the respective frequency spectrum comparators.

Claim 51

A sound signal analyzer as in claim 45 further including at least one filter means connected between a waveform envelope comparator and the waveform signal converter for extracting the frequency spectrum representation for the individual voice detected and separated by a frequency spectrum comparator from the frequency spectrum representation for the complex musical composition.

Claim 54

A method as in claim 47 further including the step of recording the separated frequency spectrum representation and the transient properties of the waveform envelope for the individual voice as music data.

Claim 55

A method as in claim 48 further including the step of sequentially queuing the frequency spectrum representation for the complex musical composition prior to comparing the frequency spectrum representation to subsequent plurality of predetermined instantaneous frequency spectrum representation for an individual voice.

Claim 56

A method as in claim 49 further including the step of extracting the separated frequency spectrum representation for an individual voice from the frequency spectrum representation for the complex musical composition prior to comparing the frequency spectrum representation to subsequent plurality of predetermined instantaneous frequency spectrum representations for an individual voice.

Claim 59

A method as in claim 51 further comprising (f) comparing the detected frequency spectrum representation and associated complex frequency spectrum representations to predetermined waveform envelopes corresponding to notes capable of being produced by the single instrument; and (g) detecting the presence in the detected frequency spectrum representation and associated complex frequency spectrum representations of a predetermined waveform envelope corresponding to the detected note.