US5220360A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus and method for topographical analysis of the retina
Assignee: Ophthalmic Imaging Systems Inc
•
Filing: 1990-10-24
•
Granted: 1993-06-15
•
Expires: 2010-10-24
Abstract
Abstract A novel optical subsystem is connected to an analyzing computer. The optical subsystem projects a grid of parallel lines onto a patient's retina, and a video camera in the optical subsystem captures a first retinal image and transmits it to the computer, where the image is digitized for analysis. A second image of the same eye is also captured, with the grid of parallel lines oriented perpendicular to the grid of the first image. The computer stores image data for the patient for a plurality of visits. The computer analyzes the images by forming a skeletonized topographical map of the retinal area of interest. First, a novel one-dimensional line detection algorithm is used to process the images. The line detection algorithm dilates, erodes and restores, Fourier transforms, bandpass filters, thresholds, skeletonizes, line traverses and interpolates the data for each of the two images. The resulting information is normalized to compensate for the effects of the patient's ocular optics. A topographic line map is constructed using the lines detected in the two images and the map is divided into sections for analysis. Using selected landmarks, the computer then registers the map with the topographic maps constructed from images acquired on previous patient visits. Volumetric changes in the topography of the retina as compared to the prior topographies for the patient are calculated, and, with other quantities of interest, are displayed in an easily-interpreted report.
Inventors
- 👤 Steven R. Verdooner
- 👤 Patricia C. Meade
- 👤 Dennis J. Makes
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-27 17:08
CPC Classifications
A; A61; A61B; A61B3/00; A61B3/10; A61B3/12
Claims Analysis
Total Claims: 55
Claim 1
Independent Claim
236 words
An apparatus for topographically mapping an internal ocular surface, comprising: projection means for projecting a plurality of parallel lines onto the internal ocular surface in a specified line orientation and with a specified direction of projection; camera means for capturing an image of the internal ocular surface having parallel lines projected thereon, the image being captured at an angle from the direction of projection; digitizing means connected to the camera means for generating digital picture element data representative of the image of the internal ocular surface; computer means connected to the digitizing means for identifying the picture element locations of images of the parallel lines in the image and for generating a topographical map of said internal ocular surface based on imaged curvatures of the projected parallel lines; mass storage means associated with the computer means for long-term storage of data, the data stored representing at least one of two data types, the two data types being data representing said topographical map, and said digital picture element data; and comparison means associated with the computer means for retrieving at least one of the types of previously stored data relating to said internal ocular surface and then comparing a first topographical map generated from said previously stored data to a second topographical map generated from more recently obtained data relating to the same internal ocular surface, to identify differences in topography between said first and second maps.
Claim 2
Independent Claim
236 words
An apparatus for topographically mapping an internal ocular surface, comprising: projection means for projecting a plurality of parallel lines onto the internal ocular surface in a specified line orientation and with a specified direction of projection; camera means for capturing an image of the internal ocular surface having parallel lines projected thereon, the image being captured at an angle from the direction of projection; digitizing means connected to the camera means for generating digital picture element data representative of the image of the internal ocular surface; computer means connected to the digitizing means for identifying the picture element locations of images of the parallel lines in the image and for generating a topographical map of said internal ocular surface based on imaged curvatures of the projected parallel lines; mass storage means associated with the computer means for long-term storage of data, the data stored representing at least one of two data types, the two data types being data representing said topographical map, and said digital picture element data; and comparison means associated with the computer means for retrieving at least one of the types of previously stored data relating to said internal ocular surface and then comparing a first topographical map generated from said previously stored data to a second topographical map generated from more recently obtained data relating to the same internal ocular surface, to identify differences in topography between said first and second maps.
Claim 3
Dependent Claim
19 words
The apparatus of claim 1 wherein the projection means and the camera means are contained in a single housing.
Claim 4
Dependent Claim
60 words
The apparatus of claim 1 wherein the camera means is a video camera mounted to have a central axis of view of the internal ocular surface, and at least a portion of the projection means is movable relative to said axis of view for selectively projecting the parallel lines from at least two directions relative to said axis of view.
Claim 5
Dependent Claim
44 words
The apparatus of claim 3 wherein the computer means uses data gathered from at least two images to form a topographical map, each of the said two images being taken with the parallel lines projected onto the internal ocular surface from a different direction.
Claim 6
Dependent Claim
26 words
The apparatus of claim 4 wherein the parallel lines in one of the two images are projected perpendicularly to the parallel lines of the other image.
Claim 7
Dependent Claim
28 words
The apparatus of claim 3 wherein the projection means includes a light source, a line grid, and a mirror, mounted for selective rotation about the axis of view.
Claim 8
Dependent Claim
25 words
The apparatus of claim 1 wherein the mass storage means is an optical drive capable of storing data relating to a large number of patients.
Claim 9
Dependent Claim
30 words
The apparatus of claim 1 wherein the comparison means divides the topographical maps being compared into defined regions and calculates differences between the topographical maps according to the defined regions.
Claim 10
Dependent Claim
30 words
The apparatus of claim 1 further including display means connected to the computer means for producing a report, said report providing information on topographical differences identified by the comparison means.
Claim 11
Dependent Claim
38 words
The apparatus of claim 9 wherein the report further includes information on patient intraocular pressures recorded in each case at about the times of capture of the image data used by the comparison means to identify topographical differences.
Claim 12
Dependent Claim
39 words
The apparatus of claim 9 wherein the report further includes information on patient visual fields recorded in each case at about the times of the capture of the image data used by the comparison means to identify topographical differences.
Claim 13
Dependent Claim
28 words
The apparatus of claim 1 wherein the computer means uses at least one one-dimensional processing algorithm to identify the picture element locations of images of the parallel lines.
Claim 14
Dependent Claim
26 words
The apparatus of claim 12 wherein at least one one-dimensional processing algorithm is executed transversely to the orientation in the image of the projected parallel lines.
Claim 15
Dependent Claim
15 words
The apparatus of claim 12 wherein one one-dimensional processing algorithm is a Fourier transform algorithm.
Claim 16
Dependent Claim
13 words
The apparatus of claim 12 wherein one one-dimensional processing algorithm bandpass filter algorithm.
Claim 17
Dependent Claim
15 words
The apparatus of claim 12 wherein one one-dimensional processing algorithm is a line skeletonizing algorithm.
Claim 18
Dependent Claim
42 words
The apparatus of claim 12 wherein the computer uses a multiple step algorithm made up of individual algorithms to identify the picture element locations of images of the parallel lines, with said individual algorithms including Fourier transform, bandpass filter, and skeletonizing algorithms.
Claim 19
Dependent Claim
22 words
The apparatus of claim 17 wherein the individual algorithms further include a dilation algorithm, a thresholding algorithm and erode and restore algorithms.
Claim 20
Dependent Claim
50 words
The apparatus of claim 12 wherein the computer uses a multiple step algorithm made up of individual algorithms to identify the picture element locations of images of the parallel lines, with said individual algorithms including a line traversal algorithm for performing a pixel-by-pixel constrained search to connect associated line segments.
Claim 21
Dependent Claim
17 words
The apparatus of claim 1 wherein the comparison means provides as an output a quantitative topographical comparison.
Claim 22
Dependent Claim
31 words
The apparatus of claim 20 wherein part of the output quantitative comparison is an indication of the amount of relative increase or decrease in the volume of an optic nerve head.
Claim 23
Dependent Claim
26 words
The apparatus of claim 1 further including infrared filter means associated with the camera means for reducing the amount of infrared energy reaching the camera means.
Claim 24
Dependent Claim
25 words
The apparatus of claim 1 wherein the projection means comprises an infrared illumination device for projecting lines of infrared energy on the internal ocular surface.
Claim 25
Dependent Claim
48 words
The apparatus of claim 1 wherein the projection means selectively projects the lines during a first type of time period when an image is being captured by the apparatus and does not project lines during a second type of time period when an image is not being captured.
Claim 26
Dependent Claim
34 words
The apparatus of claim 1 adapted to further perform in addition to the functions defined at least one of the functions of black-and-white fundus photography, color fundus photography, fluorescein angiography, and indo-cyanine green angiography.
Claim 27
Independent Claim
205 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to be brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the eye, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means, wherein the projection means projects a plurality of parallel radiative energy lines onto the internal ocular surface.
Claim 28
Independent Claim
205 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to be brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the eye, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means, wherein the projection means projects a plurality of parallel radiative energy lines onto the internal ocular surface.
Claim 29
Dependent Claim
38 words
The device of claim 26 wherein the radiation source means and the reflecting means are rotatable relative to the view axis to permit projection of lines onto the ocular surface from different directions relative to the view axis.
Claim 30
Dependent Claim
22 words
The device of claim 27, wherein the housing means is a substantially cylindrical housing enclosing the projection means and the camera means.
Claim 31
Independent Claim
242 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to be brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the eye, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means; wherein the radiation source means and the reflecting means are located in a line substantially perpendicular to the view axis and wherein the radiation source means and the reflecting means are rotatable relative to the view axis to permit projection of lines onto the ocular surface from different directions relative to the view axis.
Claim 32
Independent Claim
242 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to be brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the eye, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means; wherein the radiation source means and the reflecting means are located in a line substantially perpendicular to the view axis and wherein the radiation source means and the reflecting means are rotatable relative to the view axis to permit projection of lines onto the ocular surface from different directions relative to the view axis.
Claim 33
Independent Claim
208 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to b brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the y, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means, wherein the projection means comprises an infrared illumination device for projecting lines of infrared energy on the internal ocular surface.
Claim 34
Independent Claim
208 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to b brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the y, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means, wherein the projection means comprises an infrared illumination device for projecting lines of infrared energy on the internal ocular surface.
Claim 35
Independent Claim
232 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to be brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the eye, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation lines and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means; wherein the projection means selectively projects the lines during a first type of time period when an image is being captured by the apparatus and does not project lines during a second type of time period when an image is not being captured.
Claim 36
Independent Claim
232 words
A device for collecting image data describing an internal ocular surface, comprising: unitary housing means for locating image data collection equipment, including a forward surface adapted to be brought into proximity with a frontal surface of a patient's eye, the forward surface shaped to prevent contact of the forward surface with the frontal surface of the eye, and the forward surface having associated with it aperture means for passing light from either side of the forward surface to the other; camera means associated with the housing means for collecting image data, the camera means located to the rear of the forward surface and having a field of view including a view axis between the camera means and the eye, with the view axis passing through the aperture means; projection means associated with the housing means for projecting radiation energy onto the internal ocular surface, the projection means including a radiation source means for producing radiation lines and a reflecting means for reflecting radiation, the reflecting means located on a separate projection axis proximate to the view axis between the camera means and the forward surface of the housing means; wherein the projection means selectively projects the lines during a first type of time period when an image is being captured by the apparatus and does not project lines during a second type of time period when an image is not being captured.
Claim 37
Dependent Claim
34 words
The apparatus of claim 1 adapted to further perform in addition to the functions defined at least one of the functions of black-and-white fundus photography, color fundus photography, fluorescein angiography, and indo-cyanine green angiography.
Claim 38
Independent Claim
314 words
A method for automatically identifying changes in internal ocular topography, comprising the steps of: obtaining a first set of digital data representing an image of an area of interest using an apparatus, said apparatus projecting parallel lines on the area of interest through an ocular cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; obtaining a second set of digital data representing an image of the area at a later time using an apparatus, said apparatus projecting parallel lines on the area of interest through the cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; producing a first set of line data in a computer identifying locations of images of the parallel lines, by executing at least one one-dimensional data filtering algorithm on the first set of data; producing a second set of line data in the computer identifying locations of images of the parallel lines, by executing at least on one-dimensional data filtering algorithm on the second set of data; normalizing the first set of line data as required to compensate for ocular imaging effects; normalizing the second set of line data as required to compensate for ocular imaging effects; generating a topographical map in the computer for the first set of data based on imaged curvatures of the projected parallel lines; generating a topographical map in the computer for the second set of data based on imaged curvatures of the projected lines; electronically comparing the topographical maps for the first and second sets of data to quantitatively identify changes in volume of the area of interest between the time of obtaining the first set of digital data and the time of obtaining the second set of digital data.
Claim 39
Independent Claim
314 words
A method for automatically identifying changes in internal ocular topography, comprising the steps of: obtaining a first set of digital data representing an image of an area of interest using an apparatus, said apparatus projecting parallel lines on the area of interest through an ocular cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; obtaining a second set of digital data representing an image of the area at a later time using an apparatus, said apparatus projecting parallel lines on the area of interest through the cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; producing a first set of line data in a computer identifying locations of images of the parallel lines, by executing at least one one-dimensional data filtering algorithm on the first set of data; producing a second set of line data in the computer identifying locations of images of the parallel lines, by executing at least on one-dimensional data filtering algorithm on the second set of data; normalizing the first set of line data as required to compensate for ocular imaging effects; normalizing the second set of line data as required to compensate for ocular imaging effects; generating a topographical map in the computer for the first set of data based on imaged curvatures of the projected parallel lines; generating a topographical map in the computer for the second set of data based on imaged curvatures of the projected lines; electronically comparing the topographical maps for the first and second sets of data to quantitatively identify changes in volume of the area of interest between the time of obtaining the first set of digital data and the time of obtaining the second set of digital data.
Claim 40
Dependent Claim
20 words
The method of claim 33 wherein the steps of producing line data each include application of a Fourier transform algorithm.
Claim 41
Dependent Claim
32 words
The method of claim 33 wherein in the steps of producing line data, at least one one-dimensional processing algorithm is executed transversely to the orientation in the image of the projected lines.
Claim 42
Dependent Claim
21 words
The method of claim 33 wherein the steps of producing line data each include application of a bandpass data filtering algorithm.
Claim 43
Dependent Claim
20 words
The method of claim 33 wherein the steps of producing line data each include application of a line skeletonizing algorithm.
Claim 44
Dependent Claim
49 words
The method of claim 33 wherein the steps of producing line data each include application of a multiple step algorithm made up of individual algorithms for identifying the picture element locations of images of the parallel lines, with said individual algorithms including Fourier transform, bandpass filter, and skeletonizing algorithms.
Claim 45
Dependent Claim
22 words
The method of claim 38 wherein the individual algorithms further include a dilation algorithm, a thresholding algorithm and erode and restore algorithms.
Claim 46
Dependent Claim
57 words
The method of claim 33 wherein the steps of producing line data each include application of a multiple step algorithm made up of individual algorithms for identifying the picture element locations of images of the parallel lines, with said individual algorithms including a line traversal algorithm for performing a pixel-by-pixel constrained search to connect associated line segments.
Claim 47
Independent Claim
381 words
A method for automatically identifying changes in internal ocular topography, comprising the steps of: obtaining a first set of digital data representing an image of an area of interest using an apparatus, said apparatus projecting parallel lines on the area of interest through an ocular cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; obtaining a second set of digital data representing an image of the area at a later time, using an apparatus, said apparatus projecting parallel lines on the area of interest through the cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; producing a first set of line data in a computer identifying locations of images of the parallel lines, by executing at least on one-dimensional data filtering algorithm on the first set of data; producing a second set of line data in the computer identifying locations of images of the parallel lines, by executing at least one one-dimensional data filtering algorithm on the second set of data; normalizing the first set of line data as required to compensate for ocular imaging effects; normalizing the second set of line data as required to compensate for ocular imaging effects; generating a topographical map in the computer for the first set of data based on imaged curvatures of the projected parallel lines; generating a topographical map in the computer for the second set of data based on imaged ed curvatures of the projected parallel lines; identifying at least two registration points, one each in the first and second topographical maps, the registration points representing the same physical location in the area of interest; calculating an offset between registration points in the first and second topographical maps; electronically comparing the topographical maps for the first and second sets of data to quantitatively identify changes in volume of the area of interest between the tim of obtaining the first set of digital data and the time of obtaining the second set of digital data, taking into account the calculated offset so that points in the first topographical map are compared to corresponding points in the second topographical map.
Claim 48
Independent Claim
381 words
A method for automatically identifying changes in internal ocular topography, comprising the steps of: obtaining a first set of digital data representing an image of an area of interest using an apparatus, said apparatus projecting parallel lines on the area of interest through an ocular cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; obtaining a second set of digital data representing an image of the area at a later time, using an apparatus, said apparatus projecting parallel lines on the area of interest through the cornea and detecting the reflected image of the lines from the area of interest, the angle of detection being different than the angle of line projection; producing a first set of line data in a computer identifying locations of images of the parallel lines, by executing at least on one-dimensional data filtering algorithm on the first set of data; producing a second set of line data in the computer identifying locations of images of the parallel lines, by executing at least one one-dimensional data filtering algorithm on the second set of data; normalizing the first set of line data as required to compensate for ocular imaging effects; normalizing the second set of line data as required to compensate for ocular imaging effects; generating a topographical map in the computer for the first set of data based on imaged curvatures of the projected parallel lines; generating a topographical map in the computer for the second set of data based on imaged ed curvatures of the projected parallel lines; identifying at least two registration points, one each in the first and second topographical maps, the registration points representing the same physical location in the area of interest; calculating an offset between registration points in the first and second topographical maps; electronically comparing the topographical maps for the first and second sets of data to quantitatively identify changes in volume of the area of interest between the tim of obtaining the first set of digital data and the time of obtaining the second set of digital data, taking into account the calculated offset so that points in the first topographical map are compared to corresponding points in the second topographical map.
Claim 49
Dependent Claim
20 words
The method of claim 41 wherein the steps of producing line data each include application of a Fourier transform algorithm.
Claim 50
Dependent Claim
32 words
The method of claim 41 wherein in the steps of producing line data, at least one one-dimensional processing algorithm is executed transversely to the orientation in the image of the projected lines.
Claim 51
Dependent Claim
21 words
The method of claim 41 wherein the steps of producing line data each include application of a bandpass data filtering algorithm.
Claim 52
Dependent Claim
20 words
The method of claim 41 wherein the steps of producing line data each include application of a line skeletonizing algorithm.
Claim 53
Dependent Claim
49 words
The method of claim 41 wherein the steps of producing line data each include application of a multiple step algorithm made up of individual algorithms for identifying the picture element locations of images of the parallel lines, with said individual algorithms including Fourier transform, bandpass filter, and skeletonizing algorithms.
Claim 54
Dependent Claim
22 words
The method of claim 46 wherein the individual algorithms further include a dilation algorithm, a thresholding algorithm and erode and restore algorithms.
Claim 55
Dependent Claim
57 words
The method of claim 41 wherein the steps of producing line data each include application of a multiple step algorithm made up of individual algorithms for identifying the picture element locations of images of the parallel lines, with said individual algorithms including a line traversal algorithm for performing a pixel-by-pixel constrained search to connect associated line segments.
References Cited (Backward Citations)
US4423931A
Cited
US4715703A
Cited
US4579430A
Cited
US4728196A
Cited
US4685140A
Cited
US4668094A
Cited
DE3602995A1
Cited
US4732466A
Cited
US4867554A
Cited
US4900144A
Cited
US4863260A
Cited
US4993826A
Cited
US4998819A
Cited
US4933756A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1996-06-14 | 1996-12-14 | 1997-06-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2000-06-14 | 2000-12-14 | 2001-06-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2004-06-14 | 2004-12-14 | 2005-06-15 | $7700.00 | Window Closed / Lapsed |