Generation of a note-based code

Claim 1

A method for generating accompaniment to a musical presentation, the method comprising steps of providing a note-based code representing musical information corresponding to the musical presentation; generating a code sequence corresponding to new melody lines by using said note-based code as an input for a composing method; and providing accompaniment on the basis of the code sequence corresponding to new melody lines; said step of providing the note-based code representing the musical information comprising further steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code.

Claim 2

A method for generating accompaniment to a musical presentation, the method comprising steps of providing a note-based code representing musical information corresponding to the musical presentation; generating a code sequence corresponding to new melody lines by using said note-based code as an input for a composing method; and providing accompaniment on the basis of the code sequence corresponding to new melody lines; said step of providing the note-based code representing the musical information comprising further steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code.

Claim 5

A method for generating a note-based code representing musical information, comprising steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code, wherein step b) further comprises the steps of i) segmenting the audio signal into frames in time for obtaining a sequence of frames; ii) estimating the fundamental frequency of a frame for obtaining a present fundamental frequency; iii) quantizing the present fundamental frequency preferably into a semitone scale, such as a MIDI pitch scale, for producing a quantized present fundamental frequency; iv) storing the quantized present fundamental frequency; v) comparing the quantized present fundamental frequency to the stored fundamental frequency of the previous frame if it is available and otherwise comparing the quantized present fundamental frequency to zero; vi) applying on the basis of the comparison in step v) a note-on event with a pitch corresponding to the quantized present fundamental frequency if any transition from a zero to a non-zero value in the fundamental frequency occurs, a note-off event if any transition from a non-zero to a zero value in the fundamental frequency occurs, a note-off event and a note-on event after the note-off event with a pitch corresponding to the quantized present fundamental frequency if any transition from a non-zero to another non-zero value in the fundamental frequency occurs, and no note event if no change in the fundamental frequency occurs; and vii) repeating steps i) to vi) frame by frame at the same time as the audio signal is received for obtaining the note-based code.

Claim 6

A method for generating a note-based code representing musical information, comprising steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code, wherein step b) further comprises the steps of i) segmenting the audio signal into frames in time for obtaining a sequence of frames; ii) estimating the fundamental frequency of a frame for obtaining a present fundamental frequency; iii) quantizing the present fundamental frequency preferably into a semitone scale, such as a MIDI pitch scale, for producing a quantized present fundamental frequency; iv) storing the quantized present fundamental frequency; v) comparing the quantized present fundamental frequency to the stored fundamental frequency of the previous frame if it is available and otherwise comparing the quantized present fundamental frequency to zero; vi) applying on the basis of the comparison in step v) a note-on event with a pitch corresponding to the quantized present fundamental frequency if any transition from a zero to a non-zero value in the fundamental frequency occurs, a note-off event if any transition from a non-zero to a zero value in the fundamental frequency occurs, a note-off event and a note-on event after the note-off event with a pitch corresponding to the quantized present fundamental frequency if any transition from a non-zero to another non-zero value in the fundamental frequency occurs, and no note event if no change in the fundamental frequency occurs; and vii) repeating steps i) to vi) frame by frame at the same time as the audio signal is received for obtaining the note-based code.

Claim 7

A method for generating a note-based code representing musical information, comprising steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code, wherein step b) further comprises the steps of i) segmenting the audio signal into frames in time for obtaining a sequence of frames; ii) detecting the fundamental frequency of each frame for producing a sequence of the fundamental frequencies; iii) quantizing each value of the sequence of the fundamental frequencies preferably into a semitone scale, such as MIDI pitch scale, for producing a sequence of quantized fundamental frequencies; iv) detecting segments of consecutive equal values in the sequence of quantized fundamental frequencies; and v) assigning each of these segments of consecutive equal values to correspond to a note event comprising a note-on note-off event pair with a corresponding pitch for obtaining the note-based code.

Claim 8

A method for generating a note-based code representing musical information, comprising steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code, wherein step b) further comprises the steps of i) segmenting the audio signal into frames in time for obtaining a sequence of frames; ii) detecting the fundamental frequency of each frame for producing a sequence of the fundamental frequencies; iii) quantizing each value of the sequence of the fundamental frequencies preferably into a semitone scale, such as MIDI pitch scale, for producing a sequence of quantized fundamental frequencies; iv) detecting segments of consecutive equal values in the sequence of quantized fundamental frequencies; and v) assigning each of these segments of consecutive equal values to correspond to a note event comprising a note-on note-off event pair with a corresponding pitch for obtaining the note-based code.

Claim 9

A method for generating a note-based code representing musical information, comprising steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code, wherein step b) further comprises the steps of i) segmenting the audio signal into frames in time for obtaining a sequence of frames; ii) measuring the signal level of a frame; iii) comparing said signal level to a predetermined signal level threshold; iv) if said signal level threshold is exceeded in step iii), executing a voicing decision for judging whether the frame is voiced or unvoiced; v) if the frame is judged voiced in step iv), estimating and quantizing the fundamental frequency of the frame for obtaining a quantized present fundamental frequency; vi) deciding on the basis of the quantized present fundamental frequency whether a note is found; vii) if a note if found in step vi), comparing the quantized present fundamental frequency to the fundamental frequency of the previous frame and applying a note-off event and a note-on event after the note-off event if said fundamental frequencies are different; viii) if said signal level threshold is not exceeded in step iii), or if the frame is judged unvoiced in step iv), or if no note is found in step vi), detecting whether a note-on event is currently valid and applying a note-off event if a note-on event is currently valid; and repeating steps i) to viii) frame by frame at the same time as the audio signal is received for obtaining the note-based code.

Claim 10

A method for generating a note-based code representing musical information, comprising steps of a) receiving the musical information in the form of an audio signal; and b) applying an audio-to-notes conversion to the audio signal for generating the note-based code representing the musical information, the audio-to-notes conversion comprising the steps of estimating fundamental frequencies of the audio signal for obtaining a sequence of fundamental frequencies; and detecting note events on the basis of the sequence of fundamental frequencies for obtaining the note-based code, wherein step b) further comprises the steps of i) segmenting the audio signal into frames in time for obtaining a sequence of frames; ii) measuring the signal level of a frame; iii) comparing said signal level to a predetermined signal level threshold; iv) if said signal level threshold is exceeded in step iii), executing a voicing decision for judging whether the frame is voiced or unvoiced; v) if the frame is judged voiced in step iv), estimating and quantizing the fundamental frequency of the frame for obtaining a quantized present fundamental frequency; vi) deciding on the basis of the quantized present fundamental frequency whether a note is found; vii) if a note if found in step vi), comparing the quantized present fundamental frequency to the fundamental frequency of the previous frame and applying a note-off event and a note-on event after the note-off event if said fundamental frequencies are different; viii) if said signal level threshold is not exceeded in step iii), or if the frame is judged unvoiced in step iv), or if no note is found in step vi), detecting whether a note-on event is currently valid and applying a note-off event if a note-on event is currently valid; and repeating steps i) to viii) frame by frame at the same time as the audio signal is received for obtaining the note-based code.