US5918223A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and article of manufacture for content-based analysis, storage, retrieval, and segmentation of audio information
Assignee: MUSCLE FISH LLC
•
Filing: 1997-07-21
•
Granted: 1999-06-29
•
Expires: 2017-07-21
Abstract
Abstract A system that performs analysis and comparison of audio data files based upon the content of the data files is presented. The analysis of the audio data produces a set of numeric values (a feature vector) that can be used to classify and rank the similarity between individual audio files typically stored in a multimedia database or on the World Wide Web. The analysis also facilitates the description of user-defined classes of audio files, based on an analysis of a set of audio files that are members of a user-defined class. The system can find sounds within a longer sound, allowing an audio recording to be automatically segmented into a series of shorter audio segments.
Inventors
- 👤 Thomas L. Blum
- 👤 Douglas F. Keislar
- 👤 James A. Wheaton
- 👤 Erling H. Wold
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 04:01
CPC Classifications
G; G06; G06F; G06F16/00; G06F16/60; G06F16/63; G06F16/632; G06F16/634; G06F16/40; G06F16/68; G06F16/683; G06F2218/00; G06F2218/08; G06F2218/12; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99941; Y10S707/99944; Y10S707/99945
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
153 words
A method for analyzing sound files for one or more of storing, comparing, and retrieving audio data, comprising the steps of: (a) measuring a plurality of acoustical features of a sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof; (b) computing measurements chosen from the group consisting of mean, standard deviation, autocorrelation and first derivative thereof, of the acoustical features of the audio files, forming a vector of the feature and measurements data, and storing the computed measurements and vector in a feature file with a linkage to the sound file; and (c) grouping the feature files based on at least one of (i) similar measurements for the feature files, and (ii) distance between the vector for a sound file and a vector for a reference, to facilitate rapid classification, storage, and/or retrieval of sound files based on a predefined search criteria.
Claim 2
Independent Claim
153 words
A method for analyzing sound files for one or more of storing, comparing, and retrieving audio data, comprising the steps of: (a) measuring a plurality of acoustical features of a sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof; (b) computing measurements chosen from the group consisting of mean, standard deviation, autocorrelation and first derivative thereof, of the acoustical features of the audio files, forming a vector of the feature and measurements data, and storing the computed measurements and vector in a feature file with a linkage to the sound file; and (c) grouping the feature files based on at least one of (i) similar measurements for the feature files, and (ii) distance between the vector for a sound file and a vector for a reference, to facilitate rapid classification, storage, and/or retrieval of sound files based on a predefined search criteria.
Claim 3
Dependent Claim
23 words
The method as recited in claim 1, wherein the predefined search criteria is based on the feature file of a particular audio file.
Claim 4
Dependent Claim
19 words
The method as recited in claim 1, wherein the predefined search criteria are similar to a user created sound.
Claim 5
Dependent Claim
22 words
The method as recited in claim 1, wherein the predefined search criteria are characteristics of a predefined set of example audio files.
Claim 6
Dependent Claim
19 words
The method as recited in claim 1, wherein the acoustical feature is a set of Mel-frequency cepstral coefficients (MFCCs).
Claim 7
Dependent Claim
23 words
The method as recited in claim 1, wherein the statistical measurement is the average value of the first derivative of each acoustical feature.
Claim 8
Dependent Claim
23 words
The method as recited in claim 1, wherein the statistical measurement is the standard deviation of the first derivative of each acoustical feature.
Claim 9
Dependent Claim
157 words
A computer program embodied on a computer-readable medium for analyzing audio files, comprising: (a) a code segment for measuring a plurality of acoustical features of a sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof; (b) a code segment for computing measurements chosen from the group consisting of mean, standard deviation, autocorrelation and first derivative thereof, of the acoustical features of the audio files, forming a vector of the feature and measurements data, and storing the computed measurements and vector in a feature file with a linkage to the audio file; and (c) a code segment for grouping the feature files based on at least one of (i) similar measurements for the feature files, and (ii) distance between the vector for a sound file and a vector for a reference, to facilitate rapid classification, storage, and/or retrieval of sound files based on a predefined search criteria.
Claim 10
Dependent Claim
157 words
A computer program embodied on a computer-readable medium for analyzing audio files, comprising: (a) a code segment for measuring a plurality of acoustical features of a sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof; (b) a code segment for computing measurements chosen from the group consisting of mean, standard deviation, autocorrelation and first derivative thereof, of the acoustical features of the audio files, forming a vector of the feature and measurements data, and storing the computed measurements and vector in a feature file with a linkage to the audio file; and (c) a code segment for grouping the feature files based on at least one of (i) similar measurements for the feature files, and (ii) distance between the vector for a sound file and a vector for a reference, to facilitate rapid classification, storage, and/or retrieval of sound files based on a predefined search criteria.
Claim 11
Dependent Claim
33 words
The computer program embodied on a computer-readable medium for analyzing sound files as recited in claim 8, wherein the predefined search criteria is based on the feature file of a particular audio file.
Claim 12
Dependent Claim
29 words
The computer program embodied on a computer-readable medium for analyzing sound files as recited in claim 8, wherein the predefined search criteria is similarity to a user-created created sound.
Claim 13
Dependent Claim
32 words
The computer program embodied on a computer-readable medium for analyzing sound files as recited in claim 8, wherein the predefined search criteria are characteristics of a predefined set of example audio files.
Claim 14
Dependent Claim
144 words
A content based comparison method for segmenting sound files, comprising the steps of: (a) measuring a plurality of acoustical features of an sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof; (b) computing measurements chosen from the group consisting of mean, standard deviation, autocorrelation and first derivative thereof, of the acoustical features of the audio files, forming a vector of the feature and measurements data, and storing the computed measurements and vector in a feature file with a linkage to the audio file; and (c) segmenting the feature files based on at least one (i) similar measurements for the feature files, and (ii) distance between the vector for a sound file and a vector for a reference, to facilitate rapid classification, storage, and/or retrieval of sound files based on a predefined search criteria.
Claim 15
Dependent Claim
144 words
A content based comparison method for segmenting sound files, comprising the steps of: (a) measuring a plurality of acoustical features of an sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof; (b) computing measurements chosen from the group consisting of mean, standard deviation, autocorrelation and first derivative thereof, of the acoustical features of the audio files, forming a vector of the feature and measurements data, and storing the computed measurements and vector in a feature file with a linkage to the audio file; and (c) segmenting the feature files based on at least one (i) similar measurements for the feature files, and (ii) distance between the vector for a sound file and a vector for a reference, to facilitate rapid classification, storage, and/or retrieval of sound files based on a predefined search criteria.
Claim 16
Dependent Claim
39 words
The method as recited in claim 12, wherein the content-based comparison compares a user-supplied sound to successive regions of the sound that is to be segmented to measure the similarity between the measurements of the two sounds' acoustical features.
Claim 17
Dependent Claim
36 words
The method as recited in claim 12, wherein the content-based comparison compares a user-supplied sound to successive regions of the sound that is to be segmented, measuring the frame-by-frame similarity between the two sounds' acoustical features.
Claim 18
Dependent Claim
30 words
The method as recited in claim 12, wherein the content-based comparison compares adjacent regions of the sound that is to be segmented, measuring the similarity between the regions' statistical measurements.
Claim 19
Dependent Claim
50 words
A computer program embodied on a computer-readable medium for segmenting sound files by using content-based statistical comparison of a plurality of acoustical features of a sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof to determine the segment boundaries.
Claim 20
Dependent Claim
50 words
A computer program embodied on a computer-readable medium for segmenting sound files by using content-based statistical comparison of a plurality of acoustical features of a sound file chosen from the group consisting of at least one of loudness, pitch, brightness, bandwidth, and MFCC coefficients thereof to determine the segment boundaries.
Claim 21
Dependent Claim
22 words
A computer program according to claim 16 in which the sound files include a segment of digital audio on a storage device.
Claim 22
Dependent Claim
49 words
The computer program embodied on a computer-readable medium for segmenting sound files as recited in claim 16, wherein the content-based comparison compares a user-supplied sound to successive regions of the sound that is to be segmented, measuring the similarity between the statistical measurements of the two sounds' acoustical features.
Claim 23
Dependent Claim
46 words
The computer program embodied on a computer-readable medium for segmenting sound files as recited in claim 16, wherein the content-based comparison compares a user-supplied sound to successive regions of the sound that is to be segmented, measuring the frame-by-frame similarity between the two sounds' acoustical features.
Claim 24
Dependent Claim
40 words
The computer program embodied on a computer-readable medium for segmenting audio files as recited in claim 16, wherein the content-based comparison compares adjacent regions of the sound that is to be segmented, measuring the similarity between the regions' statistical measurements.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-06-28 | 2002-12-28 | 2003-06-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-06-28 | 2006-12-28 | 2007-06-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-06-28 | 2010-12-28 | 2011-06-29 | $7700.00 | Window Closed / Lapsed |