US6084989A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method for automatically determining the position of landmarks in digitized images derived from a satellite-based imaging system
Assignee: Lockheed Martin Corp
•
Filing: 1996-11-15
•
Granted: 2000-07-04
•
Expires: 2016-11-15
Abstract
Abstract A system and method for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system using landmark geodetic coordinates on the Earth. The system and method use landmarks in symbolic form, such as perimeters of lakes and islands that are stored in a database. A digitized image generated by the satellite-based imaging system is processed to extract a patch of the image containing a landmark. The image patch is then upsampled (magnified). The landmark boundary is processed using a mathematical model of the imaging system to generate absolute coordinates of the boundary pixels, which are upsampled and rasterized to produce a landmark mask. The landmark mask and the upsampled image patch are then processed by one or more matching algorithms to generate line and pixel offset error values indicative of the offset between the predicted position of the landmark and the actual position of the landmark in the image. A match figure of merit is also generated that is indicative of the reliability and accuracy of the computed offset. Optionally, the upsampled image patch is processed using an image enhancement algorithm that increases the contrast and robustness of the images by converting pixel gray scale values into likelihood ratios.
Inventors
- 👤 Walter G. Eppler
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-26 07:54
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/30; G06T7/33; G06T2207/00; G06T2207/10; G06T2207/10032
Claims Analysis
Total Claims: 24
Claim 1
Independent Claim
231 words
A method of determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by a passive imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said method comprising the steps of: defining and storing a plurality of landmarks in a landmark database that are each defined as having a perimeter comprising a plurality of boundary vertices; generating a digitized image of a softcopy map derived from a database that is viewed on a display; selecting a landmark in the softcopy map for processing; reading out the plurality of boundary vertices of the landmark stored in the landmark database that corresponds to the selected landmark in the softcopy map; processing the plurality of boundary vertices of the stored landmark using a mathematical model of the passive imaging system to generate absolute coordinates of boundary pixels of the stored landmark; upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask; processing the digitized image derived from the passive imaging system to extract an image patch containing the selected landmark; upsampling the image patch so that it has the same magnification as the upsampled landmark mask; and processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images.
Claim 2
Independent Claim
231 words
A method of determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by a passive imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said method comprising the steps of: defining and storing a plurality of landmarks in a landmark database that are each defined as having a perimeter comprising a plurality of boundary vertices; generating a digitized image of a softcopy map derived from a database that is viewed on a display; selecting a landmark in the softcopy map for processing; reading out the plurality of boundary vertices of the landmark stored in the landmark database that corresponds to the selected landmark in the softcopy map; processing the plurality of boundary vertices of the stored landmark using a mathematical model of the passive imaging system to generate absolute coordinates of boundary pixels of the stored landmark; upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask; processing the digitized image derived from the passive imaging system to extract an image patch containing the selected landmark; upsampling the image patch so that it has the same magnification as the upsampled landmark mask; and processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images.
Claim 3
Dependent Claim
28 words
The method of claim 1 further comprising the step of: processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.
Claim 4
Dependent Claim
44 words
The method of claim 1 wherein the step of processing the upsampled image patch and the upsampled landmark mask by an imaging matching algorithm further comprising generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.
Claim 5
Dependent Claim
44 words
The method of claim 1 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.
Claim 6
Dependent Claim
24 words
The method of claim 1 which further comprises the step of: processing the offset errors to adjust the pointing direction of the imaging system.
Claim 7
Dependent Claim
79 words
The method of claim 1 wherein the step of processing the offset errors further comprises the steps of: processing the offset errors using an orbit and attitude tracking system that generates coefficients used for spacecraft orbit and attitude prediction; processing the coefficients onboard the spacecraft using an orbit and attitude computation system to generate predicted orbit and attitude compensation data; and generating pointing coordinates using an image motion compensation system to adjust the pointing direction of the imaging system.
Claim 8
Independent Claim
253 words
A system for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by a passive imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said system comprising: a landmark database that stores a plurality of landmarks that are each defined as having a perimeter comprising a plurality of boundary vertices; a display for viewing the digitized image generated from softcopy map databases; imaging extraction means for processing the digitized image derived from the passive imaging system to extract an image patch therefrom that contains a selected landmark; and a landmark position system comprising a computer for reading the plurality of boundary vertices of the landmark in the landmark database that corresponds to the selected landmark in the digitized image derived from the passive imaging system, for processing the plurality of boundary vertices of the stored landmark using the mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark, for upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask, for processing the digitized image derived from the passive imaging system to extract an image patch containing the selected landmark, for upsampling the image patch so that it has the same magnification as the upsampled landmark mask, and for processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images.
Claim 9
Independent Claim
253 words
A system for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by a passive imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said system comprising: a landmark database that stores a plurality of landmarks that are each defined as having a perimeter comprising a plurality of boundary vertices; a display for viewing the digitized image generated from softcopy map databases; imaging extraction means for processing the digitized image derived from the passive imaging system to extract an image patch therefrom that contains a selected landmark; and a landmark position system comprising a computer for reading the plurality of boundary vertices of the landmark in the landmark database that corresponds to the selected landmark in the digitized image derived from the passive imaging system, for processing the plurality of boundary vertices of the stored landmark using the mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark, for upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask, for processing the digitized image derived from the passive imaging system to extract an image patch containing the selected landmark, for upsampling the image patch so that it has the same magnification as the upsampled landmark mask, and for processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images.
Claim 10
Dependent Claim
30 words
The system of claim 7 wherein the computer further comprises means for processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.
Claim 11
Dependent Claim
33 words
The system of claim 7 wherein the computer further comprises means for generating a figure of merit is also generated that is indicative of the reliability and accuracy of the computed offset values.
Claim 12
Dependent Claim
44 words
The system of claim 7 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.
Claim 13
Dependent Claim
22 words
The system of claim 7 further comprising means for processing the offset errors to adjust the pointing direction of the imaging system.
Claim 14
Dependent Claim
80 words
The system of claim 11 wherein the means for processing the offset errors comprises: an orbit and attitude tracking system for processing the offset errors to generate coefficients used for spacecraft orbit and attitude prediction; an orbit and attitude computation system disposed on the spacecraft for processing the coefficients to generate predicted orbit and attitude compensation data; and an image motion compensation system disposed on the spacecraft for generating pointing commands that adjust the pointing direction of the imaging system.
Claim 15
Independent Claim
244 words
A method of determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said method comprising the steps of: defining and storing a plurality of landmarks in a landmark database that are each defined as having a perimeter comprising a plurality of boundary vertices; generating a digitized image of a softcopy map derived from a database that is viewed on a display; selecting a landmark in the softcopy map for processing; reading out the plurality of boundary vertices of the landmark stored in the landmark database that corresponds to the selected landmark in the softcopy map; processing the plurality of boundary vertices of the stored landmark using a mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark; upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask; processing the digitized image to extract an image patch containing the selected landmark; upsampling the image patch so that it has the same magnification as the upsampled landmark mask; and processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images, which processing includes generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.
Claim 16
Independent Claim
244 words
A method of determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said method comprising the steps of: defining and storing a plurality of landmarks in a landmark database that are each defined as having a perimeter comprising a plurality of boundary vertices; generating a digitized image of a softcopy map derived from a database that is viewed on a display; selecting a landmark in the softcopy map for processing; reading out the plurality of boundary vertices of the landmark stored in the landmark database that corresponds to the selected landmark in the softcopy map; processing the plurality of boundary vertices of the stored landmark using a mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark; upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask; processing the digitized image to extract an image patch containing the selected landmark; upsampling the image patch so that it has the same magnification as the upsampled landmark mask; and processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images, which processing includes generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.
Claim 17
Dependent Claim
28 words
The method of claim 13 further comprising the step of: processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.
Claim 18
Dependent Claim
44 words
The method of claim 13 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.
Claim 19
Dependent Claim
24 words
The method of claim 13 which further comprises the step of: processing the offset errors to adjust the pointing direction of the imaging system.
Claim 20
Dependent Claim
79 words
The method of claim 13 wherein the step of processing the offset errors further comprises the steps of: processing the offset errors using an orbit and attitude tracking system that generates coefficients used for spacecraft orbit and attitude prediction; processing the coefficients onboard the spacecraft using an orbit and attitude computation system to generate predicted orbit and attitude compensation data; and generating pointing coordinates using an image motion compensation system to adjust the pointing direction of the imaging system.
Claim 21
Independent Claim
253 words
A system for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said system comprising: a landmark database that stores a plurality of landmarks that are each defined as having a perimeter comprising a plurality of boundary vertices; a display for viewing the digitized image generated from softcopy map databases; imaging extraction means for processing the digitized image to extract an image patch therefrom that contains a selected landmark; and a landmark position system comprising a computer for reading the plurality of boundary vertices of the landmark in the landmark database that corresponds to the selected landmark in the digitized image, for processing the plurality of boundary vertices of the stored landmark using the mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark, for upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask, for processing the digitized image to extract an image patch containing the selected landmark, for upsampling the image patch so that is has the same magnification as the upsampled landmark mask, and for processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images including generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.
Claim 22
Independent Claim
253 words
A system for determining offset errors between line and pixel coordinates of landmarks in a digitized image generated by an imaging system disposed on a spacecraft and line and pixel coordinates predicted by a mathematical model of the imaging system, said system comprising: a landmark database that stores a plurality of landmarks that are each defined as having a perimeter comprising a plurality of boundary vertices; a display for viewing the digitized image generated from softcopy map databases; imaging extraction means for processing the digitized image to extract an image patch therefrom that contains a selected landmark; and a landmark position system comprising a computer for reading the plurality of boundary vertices of the landmark in the landmark database that corresponds to the selected landmark in the digitized image, for processing the plurality of boundary vertices of the stored landmark using the mathematical model of the imaging system to generate absolute coordinates of boundary pixels of the stored landmark, for upsampling and rasterizing the absolute coordinates of boundary pixels of the stored landmark to generate a landmark mask, for processing the digitized image to extract an image patch containing the selected landmark, for upsampling the image patch so that is has the same magnification as the upsampled landmark mask, and for processing the upsampled image patch and the upsampled landmark mask by an image matching algorithm to determine offset errors between the respective images including generating a figure of merit that is indicative of the reliability and accuracy of the computed offset errors.
Claim 23
Dependent Claim
30 words
The system of claim 7 wherein the computer further comprises means for processing the upsampled image patch to radiometrically calibrate the image patch to reduce variations in its gray-scale values.
Claim 24
Dependent Claim
44 words
The system of claim 7 wherein the image matching algorithm is selected from a group consisting of a centroid image matching algorithm, an edge matching algorithm, a cluster reward algorithm, a minimum variance algorithm, a cross correlation algorithm, and a normalized cross correlation algorithm.
References Cited (Backward Citations)
US5179638A
Cited
US5093869A
Cited
US5275354A
Cited
US5625409A
Cited
US5612901A
Cited
US5596494A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-07-04 | 2004-01-03 | 2004-07-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-07-04 | 2008-01-03 | 2008-07-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-07-04 | 2012-01-03 | 2012-07-04 | $7700.00 | Window Closed / Lapsed |