Patent US5048390A successfully refreshed from Google Patents.
US5048390A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Tone visualizing apparatus
Assignee: Yamaha Corp
•
Filing: 1988-09-01
•
Granted: 1991-09-17
•
Expires: 2008-09-01
Abstract
Abstract A tone visualizing apparatus for visualizing an inputted audio signal to thereby display an image corresponding to this audio signal includes at least a detector, image display (such as a CRT display unit) and display controller. The detector detects characteristics of the audio signal such as envelope, chord, spectrum signal components, number of zero-cross points and energy of the audio signal. The image display displays an image based on given image information which can be generated from a video tape recorder (VTR), a video disk unit or an image memory constituted by a semiconductor memory. The display controller controls the image display so that a display parameter of the image will be controlled based on the detected characteristics of the audio signal. For example, the display parameter can be set as size, brightness or colors of the image. Thus, the image is controlled so that the impression of the image will be matched with that of the audio tone.
Inventors
- 👤 Takeshi Adachi
- 👤 Yasushi Kurakake
- 👤 Hideo Suzuki
- 👤 Kotaro Mizuno
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-03 18:28
CPC Classifications
G; G10; G10H; G10H1/00; G10H1/36; G10H1/38; G10H1/383; G10H1/0008; G10H2210/00; G10H2210/031; G10H2210/091; G10H2210/555; G10H2210/565; G10H2210/571; G10H2210/616
Claims Analysis
Total Claims: 58
Claim 1
Independent Claim
65 words
A tone visualizing apparatus, comprising: (a) detecting means for detecting a musical tone parameter of an inputted audio signal; (b) image display means for displaying an image of an object based on predetermined image information; and (c) display control means for controlling a sense of distance of said object displayed by said image display means in response to a variation of said musical tone parameter.
Claim 2
Dependent Claim
65 words
A tone visualizing apparatus, comprising: (a) detecting means for detecting a musical tone parameter of an inputted audio signal; (b) image display means for displaying an image of an object based on predetermined image information; and (c) display control means for controlling a sense of distance of said object displayed by said image display means in response to a variation of said musical tone parameter.
Claim 3
Dependent Claim
33 words
A tone visualizing apparatus according to claim 1 wherein said display control means controls the sense of distance of said object by varying the mutual relation between said object and a background image.
Claim 4
Dependent Claim
34 words
A tone visualizing apparatus according to claim 1 wherein said display control means controls the sense of distance of said object by varying a position relation of said object displayed within a background image
Claim 5
Dependent Claim
30 words
A tone visualizing apparatus according to claim 1 wherein said image display means is a three-dimensional image display unit capable of adjusting the sense of distance of said object three-dimensionally.
Claim 6
Dependent Claim
21 words
A tone visualizing apparatus according to claim 1 wherein said musical tone parameter is an envelope of said inputted audio signal.
Claim 7
Dependent Claim
22 words
A tone visualizing apparatus according to claim 1 wherein said musical tone parameter is one of tone volume, tone color, and frequency.
Claim 8
Dependent Claim
72 words
A tone visualizing apparatus, comprising: (a) an image memory for storing image information in advance; (b) envelope detecting means for detecting an envelope of an inputted audio signal; (c) display means for displaying an image of an object based on said image information; and (d) display control means for controlling said display means so that said object is changed in size in response to a detected envelope of said inputted audio signal.
Claim 9
Dependent Claim
72 words
A tone visualizing apparatus, comprising: (a) an image memory for storing image information in advance; (b) envelope detecting means for detecting an envelope of an inputted audio signal; (c) display means for displaying an image of an object based on said image information; and (d) display control means for controlling said display means so that said object is changed in size in response to a detected envelope of said inputted audio signal.
Claim 10
Dependent Claim
50 words
A tone visualizing apparatus according to claim 7, further comprising: an analog-to-digital converter for converting an envelope signal representative of the detected envelope of said inputted audio signal into a digitized envelope signal which is transmitted to said display control means at each one of a number of predetermined timings.
Claim 11
Dependent Claim
62 words
A tone visualizing apparatus, comprising: (a) chord detecting means for detecting a chord based on one of a musical tone signal and musical tone performance information; (b) image display means for displaying an image based on predetermined image information; and (c) display control means for varying contents of said image information in response to a chord detected by said chord detecting means.
Claim 12
Dependent Claim
62 words
A tone visualizing apparatus, comprising: (a) chord detecting means for detecting a chord based on one of a musical tone signal and musical tone performance information; (b) image display means for displaying an image based on predetermined image information; and (c) display control means for varying contents of said image information in response to a chord detected by said chord detecting means.
Claim 13
Dependent Claim
28 words
A tone visualizing apparatus according to claim 9 wherein said chord detecting means detects a chord based on a combination of depressed keys of an electronic musical instrument.
Claim 14
Dependent Claim
38 words
A tone visualizing apparatus according to claim 9 wherein said display control means varies characters of feelings (i.e., happy, angry, sad and comfortable feelings) of the image in response to the chord detected by said chord detecting means.
Claim 15
Dependent Claim
45 words
A tone visualizing apparatus according to claim 9 wherein said image display means displays an image including a human face so that said display control means varies an expression of the displayed human face in response to the chord detected by said chord detecting means.
Claim 16
Dependent Claim
59 words
A tone visualizing apparatus according to claim 12 wherein said image display means display means displays the image including the human face, the displayed human face being controlled to be brightened up when the chord detected by said chord detecting means is a major chord and being controlled to be darkened when the detected chord is a minor chord.
Claim 17
Dependent Claim
106 words
A tone visualizing apparatus, comprising: (a) chord detecting means for detecting a chord based on one of a musical tone signal and musical tone performance information; (b) chord storing means for sequentially storing a predetermined amount of chord information outputted from said chord detecting means; (c) image display means for displaying an image based on predetermined image information; (d) chord progress detecting means for detecting a chord progress pattern based on each chord information stored in said chord storing means; and (e) display control means for varying contents of the image information in response to the chord progress pattern detected by said chord progress detecting means.
Claim 18
Dependent Claim
106 words
A tone visualizing apparatus, comprising: (a) chord detecting means for detecting a chord based on one of a musical tone signal and musical tone performance information; (b) chord storing means for sequentially storing a predetermined amount of chord information outputted from said chord detecting means; (c) image display means for displaying an image based on predetermined image information; (d) chord progress detecting means for detecting a chord progress pattern based on each chord information stored in said chord storing means; and (e) display control means for varying contents of the image information in response to the chord progress pattern detected by said chord progress detecting means.
Claim 19
Dependent Claim
41 words
A tone visualizing apparatus according to claim 14 wherein said display control means varies characters of feelings (i.e., happy, angry, sad and comfortable feelings) of the image in response to the chord progress pattern detected by said chord progress detecting means.
Claim 20
Dependent Claim
48 words
A tone visualizing apparatus according to claim 14 wherein said image display means displays an image including a human face so that said display control means varies an expression of a displayed human face in response to the chord progress pattern detected by said chord progress detecting means.
Claim 21
Dependent Claim
51 words
A tone visualizing apparatus according to claim 15 wherein said chord progress detecting means obtains parameter values of feelings by executing pattern matching between the detected chord information and predetermined data base so that said display control means varies characters of feelings of the image in response to the parameter values.
Claim 22
Dependent Claim
21 words
A tone visualizing apparatus according to claim 17 wherein each parameter value of each feeling is evaluated based on human response.
Claim 23
Dependent Claim
131 words
A tone visualizing apparatus, comprising: (a) spectrum extracting means for extracting a fundamental wave component having frequency f B and at least one higher harmonic component having frequency f n other than said fundamental wave component from spectrum signals included in an inputted audio signal; (b) comparing means for calculating out n (where n denotes an integral number) times of said frequency f B (i.e., n×f B ) which is the closest value of said frequency f n , said comparing means comparing the value n×f B with said frequency f n to thereby obtain a frequency difference P n therefore; (d) display control means for varying one of content and display state of the image displayed by said image display means in responses to said frequency difference P n .
Claim 24
Dependent Claim
131 words
A tone visualizing apparatus, comprising: (a) spectrum extracting means for extracting a fundamental wave component having frequency f B and at least one higher harmonic component having frequency f n other than said fundamental wave component from spectrum signals included in an inputted audio signal; (b) comparing means for calculating out n (where n denotes an integral number) times of said frequency f B (i.e., n×f B ) which is the closest value of said frequency f n , said comparing means comparing the value n×f B with said frequency f n to thereby obtain a frequency difference P n therefore; (d) display control means for varying one of content and display state of the image displayed by said image display means in responses to said frequency difference P n .
Claim 25
Dependent Claim
29 words
A tone visualizing apparatus according to claim 19 wherein said display control means varies color balance of the display image in response to said frequency difference P n .
Claim 26
Dependent Claim
29 words
A tone visualizing apparatus according to claim 19 wherein said display control means varies color intensity of the display image in response to said frequency difference P n .
Claim 27
Dependent Claim
38 words
A tone visualizing apparatus according to claim 19 wherein said display control means varies at least one of a frequency characteristic and a phase characteristic of the display image in response to said frequency difference P n .
Claim 28
Dependent Claim
16 words
A tone visualizing apparatus according to claim 19 wherein said n is the predetermined integral value.
Claim 29
Dependent Claim
38 words
A tone visualizing apparatus according to claim 19 wherein said frequency f n is divided by said frequency f B to thereby obtain a value y the closest integral number of which is set as said value n.
Claim 30
Dependent Claim
72 words
A tone visualizing apparatus comprising: (a) zero-cross detecting means for detecting and counting zero-cross points of an inputted musical tone signal; (b) image display means for displaying an image based on predetermined image information; and (c) display control means for varying said image information to thereby vary color parameters of the image displayed by said image display means in response to number of said zero-cross points detected by said zero-cross detecting means.
Claim 31
Dependent Claim
72 words
A tone visualizing apparatus comprising: (a) zero-cross detecting means for detecting and counting zero-cross points of an inputted musical tone signal; (b) image display means for displaying an image based on predetermined image information; and (c) display control means for varying said image information to thereby vary color parameters of the image displayed by said image display means in response to number of said zero-cross points detected by said zero-cross detecting means.
Claim 32
Dependent Claim
74 words
A tone visualizing apparatus according to claim 25 wherein said display control means controls said image display means so that the display image will become an image colored by cool colors when the number of said zero-cross points is relatively small, while said display control means controls said image display means so that the display image will become an image colored by warm colors when the number of said zero-cross points is relatively large.
Claim 33
Dependent Claim
39 words
A tone visualizing apparatus according to claim 25 wherein said display control means controls said image display means so that saturation of the display image will become higher in response to increase of the number of said zero-cross points.
Claim 34
Dependent Claim
161 words
A tone visualizing apparatus according to claim 25 wherein four numbers X 1 , X 2 , X 3 and X 4 (where X 1 <X 2 <X 3 <X 4 ) are predetermined with respect to number N of said zero-cross points, said display control means controls said image display means so that the display image will become a monotone color image main1y colored by gray color in case of 0<N<X 1 , the display image being controlled to become an image main1y colored by cool colors in case of X 1 <N<X 2 , the display image being controlled to become an image main1y colored by intermediate colors in case of X 2 <N<X 3 , the display image being controlled to become an image main1y colored by warm colors in case of X 3 <N<X 4 , and the display image being controlled to become an image main1y colored by white color in case of X 4 <N.
Claim 35
Dependent Claim
115 words
A tone visualizing apparatus comprising: (a) tone source means for generating a musical tone signal; (b) zero-cross detecting means for detecting and counting a number of zero-cross points of said musical tone signal to thereby output a digital signal whose data represent the number of zero-cross points; (c) digital-to-analog converting means for converting said digital signal into an analog signal; (d) image information generating means for generating image information; (e) image display means for displaying an image gased on said image information outputted from said image information generating means; and (f) saturation control means for controlling saturation of said image in response to the level of said analog signal outputted from said digital-to-analog converting means.
Claim 36
Dependent Claim
115 words
A tone visualizing apparatus comprising: (a) tone source means for generating a musical tone signal; (b) zero-cross detecting means for detecting and counting a number of zero-cross points of said musical tone signal to thereby output a digital signal whose data represent the number of zero-cross points; (c) digital-to-analog converting means for converting said digital signal into an analog signal; (d) image information generating means for generating image information; (e) image display means for displaying an image gased on said image information outputted from said image information generating means; and (f) saturation control means for controlling saturation of said image in response to the level of said analog signal outputted from said digital-to-analog converting means.
Claim 37
Dependent Claim
68 words
A tone visualizing apparatus according to claim 29 wherein said saturation control means controls said image display means so that the saturation of the display image will be raised when the number of zero-cross points is relatively large, while said saturation control means controls said image display means so that the saturation of the display image will be lowered when the number of zero-cross points is relatively small.
Claim 38
Dependent Claim
106 words
A tone visualizing apparatus, comprising: (a) first energy detecting means for detecting a first output energy quantity of a first musical tone generating source; (b) second energy detecting means for detecting a second output energy quantity of a second musical tone generating source; (c) ratio detecting means for detecting a ratio between said first and second output energy quantities to thereby generate an output value thereof corresponding to the detected ratio; (d) image display means for displaying an image based on predetermined image information; and (e) display control means for varying contents ;of said image information based on the output value of said ratio detecting means.
Claim 39
Dependent Claim
106 words
A tone visualizing apparatus, comprising: (a) first energy detecting means for detecting a first output energy quantity of a first musical tone generating source; (b) second energy detecting means for detecting a second output energy quantity of a second musical tone generating source; (c) ratio detecting means for detecting a ratio between said first and second output energy quantities to thereby generate an output value thereof corresponding to the detected ratio; (d) image display means for displaying an image based on predetermined image information; and (e) display control means for varying contents ;of said image information based on the output value of said ratio detecting means.
Claim 40
Dependent Claim
32 words
A tone visualizing apparatus according to claim 31 wherein said first musical tone generating source is a non-electronic musical instrument and said second musical tone generating source is an electronic musical instrument.
Claim 41
Dependent Claim
40 words
A tone visualizing apparatus according to claim 31 or 32 wherein said image display means mosaics said image and said display control means varies the size of each mosaic in response to the output value of said ratio detecting means.
Claim 42
Dependent Claim
37 words
A tone visualizing apparatus according to claim 31 or 32 wherein said display control means varies contents of said image displayed by said image display means in response to the output value of said ratio detecting means.
Claim 43
Dependent Claim
36 words
A tone visualizing apparatus according to claim 32 wherein said first musical tone generating source includes a microphone for collecting a musical tone generated by said non-electronic musical instrument to thereby output a musical tone signal.
Claim 44
Dependent Claim
107 words
A tone visualizing apparatus comprising: (a) first energy detecting means for detecting a first output energy quantity of a first musical tone generating source; (b) second energy detecting means for detecting a second output energy quantity of a second musical tone generating source; (c) an image memory which stores image information; (d) an image display which displays an image based on image information read from said memory; and (e) display control means for calculating an energy ratio between said first and second output energy quantities to thereby read different image information from said image memory based on said energy ratio so that the image can be controlled.
Claim 45
Dependent Claim
107 words
A tone visualizing apparatus comprising: (a) first energy detecting means for detecting a first output energy quantity of a first musical tone generating source; (b) second energy detecting means for detecting a second output energy quantity of a second musical tone generating source; (c) an image memory which stores image information; (d) an image display which displays an image based on image information read from said memory; and (e) display control means for calculating an energy ratio between said first and second output energy quantities to thereby read different image information from said image memory based on said energy ratio so that the image can be controlled.
Claim 46
Dependent Claim
48 words
A tone visualizing apparatus according to claim 36 wherein said first musical tone generating source includes a microphone for collecting a musical tone generated by a non-electronic musical instrument to thereby output a musical tone signal, while said second musical tone generating source is an electronic musical instrument.
Claim 47
Dependent Claim
106 words
A tone visualizing apparatus according to claim 36 wherein said first energy detecting means comprises: (a) a filter for filtering out a musical tone signal having a predetermined frequency band from the musical tone signal outputted from said first musical tone generating source; (b) detecting means for detecting said musical tone signal outputted from said filter to thereby output a signal whose level is proportional to the energy quantity of said musical tone signal; and (c) an analog-to-digital converter for converting the output signal of said detecting means into a digital signal representative of said first output energy quantity of said first musical tone generating source.
Claim 48
Dependent Claim
31 words
A tone visualizing apparatus according to claim 38 wherein said detecting means is an Amplitude Modulation (AM) detector for effecting AM detection on said musical tone signal outputted from said filter.
Claim 49
Dependent Claim
139 words
A tone visualizing apparatus according to claim 36 wherein said second energy detecting means pre-stores tables each provided for each tone color, said each table including a first table for key scale and a second table for envelope, said first table storing output level in correspondence with each tone pitch and said second table storing data representative of variation of an output signal which varies in accordance with time passed from a key-on time, said second energy detecting means accessing said first and second tables so that the output level of said first table and output value of said second table will be obtained when the tone color and tone pitch are designated, whereby said second output energy quantity can be obtained by multiplying the output level of said first table by the output value of said second table.
Claim 50
Dependent Claim
111 words
A tone visualizing apparatus according to claim 40 wherein said second energy detecting means comprises: (a) first memory means for storing said first table by each tone color; (b) second memory means for storing said second table by each tone color; (c) a counter for counting timings after the key-on time to thereby output a count value representative of the time passed from the key-on time, said count value being used for accessing said second table stored in said second memory means; and (d) a multiplier for multiplying the output level of said first table by the output value of said second table to thereby obtain said second output energy quantity.
Claim 51
Dependent Claim
25 words
A tone visualizing apparatus according to claim 41 wherein each of said first and second memory means is constituted by a read on1y memory (ROM).
Claim 52
Dependent Claim
63 words
A tone visualizing apparatus comprising: (a) spectrum extracting means for extracting spectrum signal components from an inputted tone signal; (b) image display means for displaying an image based on predetermined image information; and (c) display control means for controlling a number of display colors of said image displayed by said image display means in response to a number of said spectrum signal components.
Claim 53
Dependent Claim
63 words
A tone visualizing apparatus comprising: (a) spectrum extracting means for extracting spectrum signal components from an inputted tone signal; (b) image display means for displaying an image based on predetermined image information; and (c) display control means for controlling a number of display colors of said image displayed by said image display means in response to a number of said spectrum signal components.
Claim 54
Dependent Claim
116 words
A tone visualizing apparatus according to claim 43 wherein said spectrum extracting means comprises: (a) FFT circuit for effecting the Fast Fourier Transform (FFT) on the inputted tone signal; (b) level judging means for judging the level of each spectrum signal component to thereby extract spectrum signal components each having a level which is higher than a predetermined level from all spectrum signal components outputted from said FFT circuit; and (c) a counter for counting a number of said spectrum signal components extracted by said level judging means, whereby said display control means controls the number of display colors of said image in response to the number of said spectrum signal components counted by said counter.
Claim 55
Dependent Claim
52 words
A tone visualizing apparatus according to claim 44 wherein said display control means controls said image display means so that the number of display colors will be increased in response to an increase of the number of said spectrum signal components each having the level which is higher than said predetermined level.
Claim 56
Dependent Claim
94 words
A tone visualizing system which visualizes musical tones, comprising: (a) a detector which detects at least one tone parameter of an inputted audio signal; (b) a memory which stores image information representative of at least said one tone parameter of said audio signal, said one tone parameter representing energy of said musical tone; (c) a display which displays an image based on said image information read from said memory; and (d) a controller which controls which image information is read from said memory in accordance with a detected tone parameter of said audio signal.
Claim 57
Dependent Claim
94 words
A tone visualizing system which visualizes musical tones, comprising: (a) a detector which detects at least one tone parameter of an inputted audio signal; (b) a memory which stores image information representative of at least said one tone parameter of said audio signal, said one tone parameter representing energy of said musical tone; (c) a display which displays an image based on said image information read from said memory; and (d) a controller which controls which image information is read from said memory in accordance with a detected tone parameter of said audio signal.
Claim 58
Dependent Claim
23 words
A tone visualizing system according to claim 46, wherein said memory is one of a video disc, a video tape, and a semiconductor.
References Cited (Backward Citations)
US3969972A
Cited
US4104625A
Cited
US4378466A
Cited
US4434697A
Cited
US4768086A
Cited
US4648113A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1994-09-16 | 1995-03-18 | 1995-09-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1998-09-16 | 1999-03-18 | 1999-09-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2002-09-16 | 2003-03-18 | 2003-09-17 | $7700.00 | Window Closed / Lapsed |