US5212733A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Sound mixing device
Assignee: Voyager Sound Inc
•
Filing: 1990-02-28
•
Granted: 1993-05-18
•
Expires: 2010-02-28
Abstract
Abstract A system for interactively controlling multiple parameters affecting an audio output, the system employing a controller with a visual display (e.g., a cathode ray tube) for displaying an icon that is a visual representation of an input sound signal in a multidimensional space and an input device (e.g., a mouse) used to control the location of the icon on the display. The controller generates a multiple parameter control signal that is based upon the location of the icon and is used by a sound signal processing circuit to control multiple parameters affecting an audio output. The icons are images of the sources of sound input signals. The sound signal processing circuit has M times N controllable amplifiers arranged in an M by N matrix in which each of the M inputs is distributed to N controllable amplifiers and the outputs of M controllable amplifiers are combined to provide each of the N outputs. Each controllable amplifier has a unique combination of an input signal and an output signal and receives a unique, continuously variable gain control signal.
Inventors
- 👤 Douglas J. Devitt
- 👤 Kristoph D. Krug
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 21:19
CPC Classifications
H; H04; H04H; H04H60/00; H04H60/02; H04H60/04; G; G10; G10H; G10H1/00; G10H1/0008; G10H7/00; G10H7/002; G11; G11B; G11B27/00; G11B27/02; G11B27/022; G11B27/028; G11B27/031; G11B27/034; G11B27/10; G11B27/34; H04S; H04S3/00; H04S7/00; H04S7/40; G10H2210/00; G10H2210/155; G10H2210/265; G10H2210/295; G10H2220/00; G10H2220/091; G10H2220/101; G10H2220/106; G10H2220/111; Y; Y10; Y10S; Y10S715/00; Y10S715/978
Claims Analysis
Total Claims: 58
Claim 1
Independent Claim
265 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said multidimensional space represents a multiple channel output mix environment, said multiple parameters include gains associated with each said output, and said sound signal processing circuit provides a plurality of output signals, wherein said visual representation is displayed with respect to a listener origin, and the location of said representation is characterized on said display in polar coordinates including a radius component and an angular displacement component.
Claim 2
Independent Claim
265 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said multidimensional space represents a multiple channel output mix environment, said multiple parameters include gains associated with each said output, and said sound signal processing circuit provides a plurality of output signals, wherein said visual representation is displayed with respect to a listener origin, and the location of said representation is characterized on said display in polar coordinates including a radius component and an angular displacement component.
Claim 3
Dependent Claim
21 words
The apparatus of claim 1 wherein said controller is an interactive controller, and said input device is an interactive input device.
Claim 4
Dependent Claim
31 words
The apparatus of claim 1 wherein said display displays a plurality of visual representations of respective input signals, and said sound signal processing circuit has a plurality of sound signal inputs.
Claim 5
Dependent Claim
119 words
The apparatus of claim 3 wherein said multidimensional space represents a multiple channel output mix environment with N output channels, said multiple parameters include a gain associated with each unique combination of an input sound signal and an output sound signal, and said sound signal processing circuit provides N output signals and includes M times N controllable amplifiers, where M is the number of input signals, the outputs of said amplifiers that are associated with the same output channel being added to each other to provide said N output signals, each said controllable amplifier being connected to receive a said input sound signal and a unique gain control signal, said multiple parameter control signal including said gain control signals.
Claim 6
Dependent Claim
63 words
The apparatus of claim 4 wherein each said controllable amplifier includes a digital-to-analog converter and a voltage controlled amplifier, said gain signal includes a multibit digital word that is provided to said digital-to-analog converter, said digital-to-analog converter provides a control voltage to said voltage controlled amplifier, and said voltage controlled amplifier controls said amplitude of said output signal based upon said control voltage.
Claim 7
Dependent Claim
26 words
The apparatus of claim 5 wherein said digital-to-analog converters provide slew limiting of said control voltage to eliminate control voltage artifacts in the sound output signal.
Claim 8
Dependent Claim
32 words
The apparatus of claim 4 wherein said controller provides address and control information to said sound signal processing circuit, and said address and control information controls gain updating of particular controllable amplifiers.
Claim 9
Dependent Claim
34 words
The apparatus of claim 1 wherein said multiple parameters include one or more reverb parameters, and said sound signal processing circuit includes a reverb unit that is controlled by said multiple parameter control signal.
Claim 10
Dependent Claim
33 words
The apparatus of claim 1 wherein said multiple parameters include one or more equalization parameters, and said sound signal processing circuit includes an equalizer that is controlled by said multiple parameter control signal.
Claim 11
Dependent Claim
33 words
The apparatus of claim 1 wherein said multiple parameters include one or more filtering parameters, and said sound signal processing circuit includes a filter that is controlled by said multiple parameter control signal.
Claim 12
Dependent Claim
34 words
The apparatus of claim 1 wherein said multiple parameters include one or more compression parameters, and said sound signal processing circuit includes a dynamics processor that is controlled by said multiple parameter control signal.
Claim 13
Dependent Claim
32 words
The apparatus of claim 1 wherein said multidimensional space represents a scene of an audiovisual work, and locations in said space associated with locations in said scene have associated audio parameter sets.
Claim 14
Dependent Claim
39 words
The apparatus of claim 12 wherein said audio parameter sets include values for compression, equalization, reverb or delay associated with locations and physical objects in said scene, and said sound processing circuit includes compression, equalization, reverb or delay circuitry.
Claim 15
Dependent Claim
28 words
The apparatus of claim 13 wherein said multiple parameters include multidimensional gain values associated with a location of a source of a sound input signal in said scene.
Claim 16
Dependent Claim
30 words
The apparatus of claim 1 further comprising a MIDI control line that is connected between said controller and said sound signal processing circuit and transmits said multiple parameter control signal.
Claim 17
Dependent Claim
47 words
The apparatus of claim 1 wherein said visual representation is displayed on a display which simulates three dimensions with respect to a listener origin, and the location of said representation is characterized on said display in polar coordinates including a radius component and two angular displacement components.
Claim 18
Dependent Claim
37 words
The apparatus of claim 1 wherein said radius component corresponds to a gain for a mix of said input signal, and said angular displacement component corresponds to relative amounts of said input signal in said output signals.
Claim 19
Dependent Claim
16 words
The apparatus of claim 17 wherein units of gain associated with said radius component are rescalable.
Claim 20
Dependent Claim
21 words
The apparatus of claim 3 wherein said visual representations are icons that are images of sources of the input sound signals.
Claim 21
Dependent Claim
20 words
The apparatus of claim 19 wherein said sources are musical instruments, and said icons are images of said musical instruments.
Claim 22
Dependent Claim
71 words
The apparatus of claim 1 wherein said multidimensional space represents a stereo mix environment, said multiple parameters include left and right gain, and said sound signal processing circuit provides a left sound output signal and a right sound output signal, wherein said multiple parameters include left front, center front, right front, and rear gain, and said sound signal processing circuit provides left front, center front, right front, and rear output signals.
Claim 23
Dependent Claim
60 words
The apparatus of claim 1 wherein said sound signal processing circuit includes a controllable amplifier for each said output signal, each said controllable amplifier being connected to receive said input sound signal and a gain control signal to provide a respective amplified sound input signal as said sound output signal, said multiple parameter control signal including said gain control signal.
Claim 24
Dependent Claim
63 words
The apparatus of claim 22 wherein each said controllable amplifier includes a digital-to-analog converter and a voltage controlled amplifier, said gain signal includes a multibit digital word that is provided to said digital-to-analog converter, said digital-to-analog converter provides a control voltage to said voltage controlled amplifier, and said voltage controlled amplifier controls said amplitude of said output signal based upon said control voltage.
Claim 25
Dependent Claim
26 words
The apparatus of claim 23 wherein said digital-to-analog converters provide slew limiting of said control voltage to eliminate control voltage artifacts in the sound output signal.
Claim 26
Dependent Claim
32 words
The apparatus of claim 22 wherein said controller provides address and control information to said sound signal processing circuit, and said address and control information controls gain updating of particular controllable amplifiers.
Claim 27
Dependent Claim
42 words
The apparatus of claim 1 wherein said display has one or more mappable regions defined in said multidimensional space such that movement of a representation to a said region will cause automatic generation of a control signal affecting one or more parameters.
Claim 28
Dependent Claim
20 words
The apparatus of claim 26 wherein each said mappable region has an associated control signal including an audio parameter set.
Claim 29
Dependent Claim
33 words
The apparatus of claim 1 wherein said display has a fadeout region, and movement of a representation within the fadeout region in a predetermined direction results in accelerated fadeout of the output signal.
Claim 30
Dependent Claim
31 words
The apparatus of claim 1 wherein said display has amplitude indicators related to radial position relative to listener origin and angular position indicators related to angular position relative to listener origin.
Claim 31
Dependent Claim
38 words
The apparatus of claim 1 wherein said display includes a mix portion in which said visual representations are displayed and an information portion that displays values of left and right gain and angular position for said visual representation.
Claim 32
Dependent Claim
40 words
The apparatus of claim 1 wherein said controller includes means for storing state information as to the positions of said visual representations on said display, and means for recalling said state information to control the positions of said visual representations.
Claim 33
Dependent Claim
21 words
The apparatus of claim 31 wherein said state information is static state information indicating the instantaneous positions of said visual representations.
Claim 34
Dependent Claim
29 words
The apparatus of claim 31 wherein said state information is time dependent state information indicating the changes with time of the positions of said visual representations on said display.
Claim 35
Dependent Claim
13 words
The apparatus of claim 31 further comprising means to edit stored state information.
Claim 36
Dependent Claim
33 words
The apparatus of claim 33 wherein said interactive controller includes means for creating time dependent state information from static state information by determining gradual transitions between specified states in said static state information.
Claim 37
Independent Claim
226 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said display has a fadeout region, and movement of a representation within the fadeout region in a predetermined direction results in accelerated fadeout of the output signal.
Claim 38
Independent Claim
226 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said display has a fadeout region, and movement of a representation within the fadeout region in a predetermined direction results in accelerated fadeout of the output signal.
Claim 39
Dependent Claim
38 words
The apparatus of claim 36 wherein said multidimensional space represents a multiple channel output mix environment, said multiple parameters include gains associated with each said output, and said sound signal processing circuit provides a plurality of output signals.
Claim 40
Dependent Claim
40 words
The apparatus of claim 37 wherein said multidimensional space represents a stereo mix environment, said multiple parameters include left and right gain, and said sound signal processing circuit provides a left sound output signal and a right sound output signal.
Claim 41
Dependent Claim
36 words
The apparatus of claim 38 wherein said multiple parameters include left front, center front, right front, and rear gain, and said sound signal processing system provides left front, center front, right front, and rear output signals.
Claim 42
Dependent Claim
38 words
The apparatus of claim 37 wherein said display has a hard left region with which a muted left gain control signal is associated and a hard right region with which a muted right gain control signal is associated.
Claim 43
Dependent Claim
16 words
The apparatus of claim 37 wherein said visual representation includes text indicating said sound input signal.
Claim 44
Dependent Claim
21 words
The apparatus of claim 36 wherein said controller is an interactive controller, and said input device is an interactive input device.
Claim 45
Dependent Claim
36 words
The apparatus of claim 36 wherein there are plural output channels, said multiple parameters include gains associated with respective outputs, and said display has a region which causes a muted gain signal for a said channel.
Claim 46
Dependent Claim
29 words
The apparatus of claim 36 further comprising a MIDI control line that is connected between said controller and said sound processing circuit and transmits said multiple parameter control signal.
Claim 47
Dependent Claim
42 words
The apparatus of claim 36 wherein said display has one or more mappable regions defined in said multidimensional space such that movement of a representation to a said region will cause automatic generation of a control signal affecting one or more parameters.
Claim 48
Dependent Claim
20 words
The apparatus of claim 45 wherein each said mappable region has an associated control signal including an audio parameter set.
Claim 49
Independent Claim
404 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said display displays a plurality of visual representations of respective input signals, and said sound signal processing circuit has a plurality of sound signal inputs, wherein said multidimensional space represents a multiple channel output mix environment with N output channels, said multiple parameters include a gain associated with each unique combination of an input sound signal and ann output sound signal, and said sound signal processing circuit provides N output signals and includes M times N controllable amplifiers, where M is the number of input signals, the outputs of said amplifiers that are associated with the same output channel being added to each other to provide said N output signals, each said controllable amplifier being connected to receive a said input sound signal and a unique gain control signal, said multiple parameter control signal including said gain control signal, wherein said controller provides address and control information to said sound signal processing circuit, and said address and control information controls gain updating of particular controllable amplifiers, wherein said sound signal processing circuit includes a decoder circuit, said decoder circuit receives said address and control information and provides enable signals to said controllable amplifiers, and said enable signals enable the gain updating of particular controllable amplifiers.
Claim 50
Independent Claim
404 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said display displays a plurality of visual representations of respective input signals, and said sound signal processing circuit has a plurality of sound signal inputs, wherein said multidimensional space represents a multiple channel output mix environment with N output channels, said multiple parameters include a gain associated with each unique combination of an input sound signal and ann output sound signal, and said sound signal processing circuit provides N output signals and includes M times N controllable amplifiers, where M is the number of input signals, the outputs of said amplifiers that are associated with the same output channel being added to each other to provide said N output signals, each said controllable amplifier being connected to receive a said input sound signal and a unique gain control signal, said multiple parameter control signal including said gain control signal, wherein said controller provides address and control information to said sound signal processing circuit, and said address and control information controls gain updating of particular controllable amplifiers, wherein said sound signal processing circuit includes a decoder circuit, said decoder circuit receives said address and control information and provides enable signals to said controllable amplifiers, and said enable signals enable the gain updating of particular controllable amplifiers.
Claim 51
Independent Claim
352 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said multidimensional space represents a multiple channel output mix environment, said multiple parameters include gains associated with each said output, and said sound signal processing circuit provides a plurality of output signals, wherein said sound signal processing circuit includes a controllable amplifier to each said output signal, each said controllable amplifier being connected to receive said input sound signal and a gain control signal to provide a respective amplified sound input signal as said sound output signal, said multiple parameter control signal including said gain control signal, wherein said controller provides address and control information to said sound signal processing circuit, and said address and control information controls gain updating of particular controllable amplifiers, wherein said sound signal processing circuit includes a decoder circuit, said decoder circuit receives said address and control information and provides enable signals to said controllable amplifiers, and said enable signals enable the gain updating of particular controllable amplifiers.
Claim 52
Independent Claim
352 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said multidimensional space represents a multiple channel output mix environment, said multiple parameters include gains associated with each said output, and said sound signal processing circuit provides a plurality of output signals, wherein said sound signal processing circuit includes a controllable amplifier to each said output signal, each said controllable amplifier being connected to receive said input sound signal and a gain control signal to provide a respective amplified sound input signal as said sound output signal, said multiple parameter control signal including said gain control signal, wherein said controller provides address and control information to said sound signal processing circuit, and said address and control information controls gain updating of particular controllable amplifiers, wherein said sound signal processing circuit includes a decoder circuit, said decoder circuit receives said address and control information and provides enable signals to said controllable amplifiers, and said enable signals enable the gain updating of particular controllable amplifiers.
Claim 53
Independent Claim
244 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said display displays a plurality of visual representations of respective input signals, and said sound signal processing circuit has a plurality of sound signal inputs, wherein said visual representations have changes in appearance that are associated with changes in value of a said multiple parameter.
Claim 54
Independent Claim
244 words
An apparatus for controlling multiple parameters effecting an audio mix output, said apparatus comprising a controller including a visual display for displaying a visual representation of an input sound signal in a multidimensional space and generating a multiple parameter control signal controlling multiple parameters effecting said audio mix output, each dimension of said multidimensional space separately controlling a mixing parameter or mixing parameters, said control signal being based upon the state of said representation in said multidimensional space, at least two said dimensions being the location of said representation on said visual display, a change in location of said representation on said display causing a change in two or more said mixing parameters, an input device connected to said controller to control the state of said representation in said multidimensional space so as to affect said audio mix output, and a sound signal processing circuit having a sound signal input for receiving a sound input signal, a sound signal output for providing a sound output signal, and a control signal input for receiving said multiple parameter control signal, said circuit modifying said sound input signal based upon said multiple parameter control signal to provide said sound output signal, wherein said display displays a plurality of visual representations of respective input signals, and said sound signal processing circuit has a plurality of sound signal inputs, wherein said visual representations have changes in appearance that are associated with changes in value of a said multiple parameter.
Claim 55
Dependent Claim
15 words
The apparatus of claim 49 wherein said change in appearance is a change in color.
Claim 56
Dependent Claim
15 words
The apparatus of claim 49 wherein said change in appearance is a change in brightness.
Claim 57
Dependent Claim
15 words
The apparatus of claim 49 wherein said change in appearance is a change in size.
Claim 58
Dependent Claim
15 words
The apparatus of claim 49 wherein said change in appearance is a change in shape.
References Cited (Backward Citations)
US3757046A
Cited
US3982071A
Cited
US4399328A
Cited
US4683589A
Cited
US4731848A
Cited
US4864625A
Cited
US4817149A
Cited
US4792974A
Cited
US4933768A
Cited
US5027689A
Cited
US4885792A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1996-05-17 | 1996-11-16 | 1997-05-18 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2000-05-17 | 2000-11-16 | 2001-05-18 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2004-05-17 | 2004-11-16 | 2005-05-18 | $7700.00 | Window Closed / Lapsed |