Patent US7323629B2 successfully refreshed from Google Patents.
US7323629B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Real time music recognition and display system
Assignee: Iowa State University Research Foundation Inc
•
Filing: 2003-07-16
•
Granted: 2008-01-29
•
Expires: 2023-07-16
Abstract
Abstract Systems and methods for performing simple and quick real time single music note recognition algorithm based on fuzzy pattern matching are disclosed. In one aspect, the systems and methods use a 256-point FFT and fuzzy pattern identification and recognition method. The systems and methods can recognize a note as short as 0.125 seconds in a frequency range from 16 Hz to 4000 Hz, with 11.025 KHz sampling rate and 8-bit per sampling signal. The systems and methods may be used as part of a music tutor system that receives a played note, identifies the played note, and compares the played note with a reference note. An indication may be given as to whether the played note matched the reference note.
Inventors
- 👤 Arun Somani
- 👤 Wu Tao
- 👤 Raed Adhami
- 👤 Liang Zhao
- 👤 Anil Sahai
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 12:26
CPC Classifications
G; G10; G10H; G10H3/00; G10H3/12; G10H3/125; G10H1/00; G10H1/0008; G10H2240/00; G10H2240/161; G10H2240/165; G10H2250/00; G10H2250/131; G10H2250/215; G10H2250/235
Claims Analysis
Total Claims: 67
Claim 1
Independent Claim
82 words
A computerized method for recognizing music, the method comprising: receiving an input data representing a played note; performing time alignment on the input data; extracting features from the input data; weighting at least a subset of the features; and comparing according to the weighting the extracted features to a dataset of saved note features to determine a matching note; wherein a match occurs when at least a subset of the extracted features match a note in the dataset of save note features.
Claim 2
Dependent Claim
82 words
A computerized method for recognizing music, the method comprising: receiving an input data representing a played note; performing time alignment on the input data; extracting features from the input data; weighting at least a subset of the features; and comparing according to the weighting the extracted features to a dataset of saved note features to determine a matching note; wherein a match occurs when at least a subset of the extracted features match a note in the dataset of save note features.
Claim 3
Dependent Claim
26 words
The method of claim 1 , wherein the input data is analog data and further comprising performing an analog to digital conversion of the input data.
Claim 4
Dependent Claim
18 words
The method of claim 1 , wherein performing time alignment include performing a FFT on the input data.
Claim 5
Dependent Claim
14 words
The method of claim 3 , wherein the FFT comprises a 512 point FFT.
Claim 6
Dependent Claim
36 words
The method of claim 1 , wherein the played note matches the saved note if at least four of note features for the played note match a set of six note features for the saved note.
Claim 7
Dependent Claim
16 words
The method of claim 5 , wherein the set of note features includes a fundamental frequency.
Claim 8
Dependent Claim
14 words
The method of claim 5 , wherein the set of note features includes note-duration.
Claim 9
Dependent Claim
18 words
The method of claim 5 , wherein the set of note features includes at least one harmonic frequency.
Claim 10
Dependent Claim
18 words
The method of claim 8 , wherein the set of note features includes at least 5 harmonic frequencies.
Claim 11
Dependent Claim
24 words
The method of claim 5 , wherein the set of note features includes at least one peak location and at least one peak value.
Claim 12
Dependent Claim
24 words
The method of claim 10 , wherein the comparing includes weighting the at least one peak location and the at least one peak value.
Claim 13
Dependent Claim
26 words
The method of claim 1 , wherein performing time alignment includes determining a start point and an end point of a note in the input data.
Claim 14
Dependent Claim
22 words
The method of claim 12 , wherein a sum of the square of the amplitude is used to determine the start point.
Claim 15
Dependent Claim
20 words
The method of claim 12 , wherein the sum of the absolute amplitude is used to determine the staff point.
Claim 16
Dependent Claim
98 words
A computerized method for providing a music tutor, the method comprising: training a system to recognize a set of notes played by a musical instrument from one or more reference notes played by the same musical instrument; retrieving a set of musical data comprising one or more reference notes; displaying at least a portion of the set of musical data, said portion including a current note from the one or more reference notes; receiving a played note; comparing the played note to the current note; and displaying an indication of whether the played note matches the current note.
Claim 17
Dependent Claim
98 words
A computerized method for providing a music tutor, the method comprising: training a system to recognize a set of notes played by a musical instrument from one or more reference notes played by the same musical instrument; retrieving a set of musical data comprising one or more reference notes; displaying at least a portion of the set of musical data, said portion including a current note from the one or more reference notes; receiving a played note; comparing the played note to the current note; and displaying an indication of whether the played note matches the current note.
Claim 18
Dependent Claim
29 words
The computerized method of claim 15 , wherein displaying an indication changes the color of the reference note in accordance with whether the played note matched the reference note.
Claim 19
Dependent Claim
15 words
The computerized method of claim 15 , further comprising composing the set of reference notes.
Claim 20
Dependent Claim
17 words
The computerized method of claim 15 , wherein the reference notes are included on a flash card.
Claim 21
Dependent Claim
17 words
The computerized method of claim 15 , wherein the reference notes are included on a musical segment.
Claim 22
Dependent Claim
37 words
The computerized method of claim 15 wherein displaying an indication of whether the played note matches the current note includes highlighting correctly played notes in a first highlight and highlighting incorrectly played notes in a second highlight.
Claim 23
Dependent Claim
23 words
The computerized method of claim 20 , wherein the first highlight is a first color and the second highlight is a second color.
Claim 24
Dependent Claim
23 words
The computerized method of claim 20 , wherein the first highlight is a first cross-hatching and the second highlight is a second cross-hatching.
Claim 25
Dependent Claim
146 words
A computerized system comprising: a processor and a memory coupled to the processor; an analog to digital (A/D) converter coupled to the processor; a sound input device coupled to the A/D converter; a database; and a display; wherein the analog to digital converter is operable to receive sound input from the sound input device and wherein the processor is operable to: receive a set of data from the A/D converter, said data representing at least one note, extract note features from the set of data, applying a weighting to at least a subset of the note features, and identify the note based on matching the data representing at least one note to the set of database data, said identification occurring in near real-time, wherein a match occurs when at least a subset of the extracted features match a note in the dataset of saved note features.
Claim 26
Dependent Claim
146 words
A computerized system comprising: a processor and a memory coupled to the processor; an analog to digital (A/D) converter coupled to the processor; a sound input device coupled to the A/D converter; a database; and a display; wherein the analog to digital converter is operable to receive sound input from the sound input device and wherein the processor is operable to: receive a set of data from the A/D converter, said data representing at least one note, extract note features from the set of data, applying a weighting to at least a subset of the note features, and identify the note based on matching the data representing at least one note to the set of database data, said identification occurring in near real-time, wherein a match occurs when at least a subset of the extracted features match a note in the dataset of saved note features.
Claim 27
Dependent Claim
16 words
The system of claim 23 , wherein the A/D converter is included in a sound card.
Claim 28
Dependent Claim
14 words
The system of claim 23 , wherein the sound input device is a microphone.
Claim 29
Dependent Claim
16 words
The system of claim 23 , wherein the sound input device is a MIDI compatible device.
Claim 30
Dependent Claim
15 words
The system of claim 23 , wherein the display is an LCD (Liquid Crystal Display).
Claim 31
Dependent Claim
25 words
The system of claim 23 , wherein the processor is further operable to output a musical segment comprising at least one note to the display.
Claim 32
Dependent Claim
24 words
The system of claim 23 , wherein the processor, the memory, the A/D converter and the display are incorporated on a single board computer.
Claim 33
Dependent Claim
23 words
The system of claim 23 , wherein the processor, the memory, the A/D converter and the display are incorporated in a personal computer.
Claim 34
Dependent Claim
89 words
A computer-readable medium having computer-executable instructions for performing a method for recognizing music, the method comprising: receiving an input data representing a played note; performing time alignment on the input data; extracting features from the input data; weighting at least a subset of the features; and comparing according to the weighting the extracted features to a dataset of saved note features to determine a matching note; wherein a match occurs when at least a subset of the extracted features match a note in the dataset of saved note features.
Claim 35
Dependent Claim
89 words
A computer-readable medium having computer-executable instructions for performing a method for recognizing music, the method comprising: receiving an input data representing a played note; performing time alignment on the input data; extracting features from the input data; weighting at least a subset of the features; and comparing according to the weighting the extracted features to a dataset of saved note features to determine a matching note; wherein a match occurs when at least a subset of the extracted features match a note in the dataset of saved note features.
Claim 36
Dependent Claim
30 words
The computer-readable medium of claim 31 , wherein the input data is analog data and wherein the method further comprises performing an analog to digital conversion of the input data.
Claim 37
Dependent Claim
19 words
The computer-readable medium of claim 31 , wherein performing time alignment include performing a FFT on the input data.
Claim 38
Dependent Claim
15 words
The computer-readable medium of claim 33 , wherein the FFT comprises a 512 point FFT.
Claim 39
Dependent Claim
37 words
The computer-readable medium of claim 31 , wherein the played note matches the saved note if at least four of note features for the played note match a set of six note features for the saved note.
Claim 40
Dependent Claim
17 words
The computer-readable medium of claim 35 , wherein the set of note features includes a fundamental frequency.
Claim 41
Dependent Claim
15 words
The computer-readable medium of claim 35 , wherein the set of note features includes note-duration.
Claim 42
Dependent Claim
19 words
The computer-readable medium of claim 35 , wherein the set of note features includes at least one harmonic frequency.
Claim 43
Dependent Claim
19 words
The computer-readable medium of claim 38 , wherein the set of note features includes at least 5 harmonic frequencies.
Claim 44
Dependent Claim
25 words
The computer-readable medium of claim 35 , wherein the set of note features includes at least one peak location and at least one peak value.
Claim 45
Dependent Claim
25 words
The computer-readable medium of claim 40 , wherein the comparing includes weighting the at least one peak location and the at least one peak value.
Claim 46
Dependent Claim
27 words
The computer-readable medium of claim 31 , wherein performing time alignment includes determining a start point and an end point of a note in the input data.
Claim 47
Dependent Claim
23 words
The computer-readable medium of claim 42 , wherein a sum of the square of the amplitude is used to determine the start point.
Claim 48
Dependent Claim
21 words
The computer-readable medium of claim 42 , wherein the sum of the absolute amplitude is used to determine the start point.
Claim 49
Dependent Claim
106 words
A computer-readable medium having computer-executable instructions for performing a method for providing a music tutor, the method comprising: training a system to recognize a set of notes played by a musical instrument to create one or more reference notes played by the same musical instrument; retrieving a set of musical data comprising one or more reference notes; displaying at least a portion of the set of musical data, said portion including a current note from the one or more reference notes; receiving a played note; comparing the played note to the current note; and displaying an indication of whether the played note matches the current note.
Claim 50
Dependent Claim
106 words
A computer-readable medium having computer-executable instructions for performing a method for providing a music tutor, the method comprising: training a system to recognize a set of notes played by a musical instrument to create one or more reference notes played by the same musical instrument; retrieving a set of musical data comprising one or more reference notes; displaying at least a portion of the set of musical data, said portion including a current note from the one or more reference notes; receiving a played note; comparing the played note to the current note; and displaying an indication of whether the played note matches the current note.
Claim 51
Dependent Claim
29 words
The computer-readable medium of claim 45 , wherein displaying an indication changes the color of the reference note in accordance with whether the played note matched the reference note.
Claim 52
Dependent Claim
15 words
The computer-readable medium of claim 45 , further comprising composing the set of reference notes.
Claim 53
Dependent Claim
17 words
The computer-readable medium of claim 45 , wherein the reference notes are included on a flash card.
Claim 54
Dependent Claim
17 words
The computer-readable medium of claim 45 , wherein the reference notes are included on a musical segment.
Claim 55
Dependent Claim
37 words
The computer-readable medium of claim 45 wherein displaying an indication of whether the played note matches the current note includes highlighting correctly played notes in a first highlight and highlighting incorrectly played notes in a second highlight.
Claim 56
Dependent Claim
23 words
The computer-readable medium of claim 50 , wherein the first highlight is a first color and the second highlight is a second color.
Claim 57
Dependent Claim
23 words
The computer-readable medium of claim 50 , wherein the first highlight is a first cross-hatching and the second highlight is a second cross-hatching.
Claim 58
Dependent Claim
135 words
A computerized system comprising: a database having a set of data representing at least one database note; a sound input interface; a pattern matching module coupled to the database and the sound input interface and operable to compare a set of data representing at least one played note with the set of data representing the at least one musical note and to identify the played note, the identification comprising applying a weighting to at least a subset of a set of note features in the set of data and performing a comparison of the weighted set of note features of the at least one played note to the set of data representing the at least one musical note; a compose segment module operable to receive the identified played note and to output the played note.
Claim 59
Dependent Claim
135 words
A computerized system comprising: a database having a set of data representing at least one database note; a sound input interface; a pattern matching module coupled to the database and the sound input interface and operable to compare a set of data representing at least one played note with the set of data representing the at least one musical note and to identify the played note, the identification comprising applying a weighting to at least a subset of a set of note features in the set of data and performing a comparison of the weighted set of note features of the at least one played note to the set of data representing the at least one musical note; a compose segment module operable to receive the identified played note and to output the played note.
Claim 60
Dependent Claim
19 words
The computerized system of claim 53 , wherein the compose segment module outputs the played note to a display.
Claim 61
Dependent Claim
23 words
The computerized system of claim 53 , wherein the compose segment modules is operable to output the played note to a music file.
Claim 62
Dependent Claim
15 words
The computerized system of claim 55 wherein the music file is a flash card file.
Claim 63
Dependent Claim
28 words
The computerized system of claim 53 , further comprising a playback module operable to read a music file and to display a set notes in the music file.
Claim 64
Dependent Claim
18 words
The computerized system of claim 57 , wherein the set of notes are displayed as a flash card.
Claim 65
Dependent Claim
42 words
The computerized system of claim 57 , wherein the playback module receives data representing at least one played note from the pattern matching module and compares the at least one played note to the set of notes in the flash card file.
Claim 66
Dependent Claim
22 words
The computerized system of claim 59 , wherein the playback module identifies whether the at least one played note was played correctly.
Claim 67
Dependent Claim
20 words
The computerized system of claim 59 , wherein the playback module maintains statistics on a number of correctly played notes.
References Cited (Backward Citations)
US4633748A
Cited
US20030024375A1
Cited
US20040069128A1
Cited
US6725108B1
Cited
US6737572B1
Cited
US6156964A
Cited
US6417435B2
Cited
US20010029830A1
Cited
US6380474B2
Cited
US6541691B2
Cited
US20020005109A1
Cited
US6967275B2
Cited
US20040194610A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2011-01-28 | 2011-07-30 | 2012-01-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2015-01-28 | 2015-07-30 | 2016-01-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2019-01-28 | 2019-07-30 | 2020-01-29 | $7700.00 | Window Closed / Lapsed |