Patent US4852732A successfully refreshed from Google Patents.
Patent US6061068A successfully refreshed from Google Patents.
US6061068A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for providing synthetic vision using reality updated virtual image
Assignee: Raytheon Co
•
Filing: 1998-06-30
•
Granted: 2000-05-09
•
Expires: 2018-06-30
Abstract
Abstract An airplane (11) includes a system (10) which provides synthetic vision using a reality updated virtual image. The system includes a processor (17) which receives real-time image information regarding a scene of interest from a sensor (12), the sensor being supported on the airplane by a gimbal (13). The processor receives information regarding the orientation of the sensor from the gimbal, and receives navigational information regarding the airplane from a navigation system (14). The processor maintains virtual image information (23) regarding the scene of interest. The processor updates the virtual image information using the real-time image information, in a manner which improves the quality of the representation in the virtual image information of the scene of interest. The processor prepares combined image information (24, 31), by selectively combining information from the real-time and virtual image information.
Inventors
- 👤 II Richard G. Hoffman
- 👤 Gregory S. Hawkins
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 16:35
CPC Classifications
G; G06; G06T; G06T15/00
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
137 words
A method, comprising the steps of: causing a sensor to generate sensor image information which includes information representative of subject matter of interest and information representative of other subject matter; maintaining virtual image information, including the step of separately maintaining first virtual information representative of the subject matter of interest and second virtual information representative of the other subject matter; updating the virtual image information using the sensor image information in a manner which improves the quality of the representation of the subject matter of interest in the first virtual information and the quality of the other subject matter in the second virtual information; and preparing combined image information by combining information from the sensor image information with information from the first virtual information, the combined image information including an image of the subject matter of interest.
Claim 2
Independent Claim
137 words
A method, comprising the steps of: causing a sensor to generate sensor image information which includes information representative of subject matter of interest and information representative of other subject matter; maintaining virtual image information, including the step of separately maintaining first virtual information representative of the subject matter of interest and second virtual information representative of the other subject matter; updating the virtual image information using the sensor image information in a manner which improves the quality of the representation of the subject matter of interest in the first virtual information and the quality of the other subject matter in the second virtual information; and preparing combined image information by combining information from the sensor image information with information from the first virtual information, the combined image information including an image of the subject matter of interest.
Claim 3
Dependent Claim
18 words
A method according to claim 1, including the step of providing a display of the combined image information.
Claim 4
Dependent Claim
36 words
A method according to claim 1, wherein the sensor image information includes a succession of images, and wherein said updating and preparing steps are carried out for each of the images in the sensor image information.
Claim 5
Dependent Claim
30 words
A method according to claim 1, wherein said preparing step is carried out by overlaying a portion of the sensor image information and a portion of the first virtual information.
Claim 6
Dependent Claim
39 words
A method according to claim 1, wherein said preparing step is carried out by selectively substituting pixels from one of the sensor image information and the first virtual information for corresponding pixels in an image from the other thereof.
Claim 7
Dependent Claim
60 words
A method according to claim 1, wherein said updating step includes the steps of detecting, in the sensor image information, moving subject matter which is moving relative to the subject matter of interest as viewed by the sensor, and which is located between the sensor and the subject matter of interest, the other subject matter including the moving subject matter.
Claim 8
Dependent Claim
33 words
A method according to claim 6, including the step of providing the sensor in an aircraft, the subject matter of interest being disposed on the earth and the moving subject matter including clouds.
Claim 9
Dependent Claim
51 words
A method according to claim 7, wherein said updating step includes the steps of maintaining in the second virtual information an estimated image of the cloud brightness and an estimated image of the cloud transmissivity, and maintaining in the first virtual information an estimated image of the subject matter of interest.
Claim 10
Dependent Claim
21 words
A method according to claim 8, wherein said updating step includes the step of maintaining a state estimate error covariance matrix.
Claim 11
Dependent Claim
22 words
A method according to claim 1, including the step of effecting relative movement between the sensor and the subject matter of interest.
Claim 12
Dependent Claim
51 words
A method according to claim 1, wherein the sensor image information and the virtual image information are respectively expressed in sensor and virtual coordinate systems, and including the step of effecting a transformation so that the sensor image information and the virtual image information are expressed in a common coordinate system.
Claim 13
Dependent Claim
97 words
A method according to claim 11, wherein said step of effecting a transformation is carried out by transforming the sensor image information from the sensor coordinate system to the virtual coordinate system; wherein said updating step is carried out using the transformed sensor image information; including the step of thereafter transforming information from the first virtual information from the virtual coordinate system to the sensor coordinate system in order to obtain transformed virtual information; and wherein said preparing step is carried out in the sensor coordinate system using the sensor image information and the transformed virtual information.
Claim 14
Dependent Claim
18 words
A method according to claim 1, wherein said updating step includes the step of using Kalman-type filtering techniques.
Claim 15
Independent Claim
147 words
An apparatus, comprising: a sensor which generates sensor image information that includes information representative of subject matter of interest and information representative of other subject matter; and a processor which is responsive to the sensor image information from said sensor, and which is operative to: maintain virtual image information, including first virtual information representative of the subject matter of interest and second virtual information representative of the other subject matter; update the virtual image information using the sensor image information in a manner which improves the quality of the representation of the subject matter of interest in the first virtual information and the quality of the other subject matter in the second virtual information; and prepare combined image information by combining information from the sensor image information with information from the first virtual information, the combined image information including an image of the subject matter of interest.
Claim 16
Independent Claim
147 words
An apparatus, comprising: a sensor which generates sensor image information that includes information representative of subject matter of interest and information representative of other subject matter; and a processor which is responsive to the sensor image information from said sensor, and which is operative to: maintain virtual image information, including first virtual information representative of the subject matter of interest and second virtual information representative of the other subject matter; update the virtual image information using the sensor image information in a manner which improves the quality of the representation of the subject matter of interest in the first virtual information and the quality of the other subject matter in the second virtual information; and prepare combined image information by combining information from the sensor image information with information from the first virtual information, the combined image information including an image of the subject matter of interest.
Claim 17
Dependent Claim
40 words
An apparatus according to claim 14, including an airplane having said sensor supported thereon, the subject matter of interest being disposed on the earth, and including a navigational system operative to provide navigational information regarding said airplane to said processor.
Claim 18
Dependent Claim
39 words
An apparatus according to claim 15, including a gimbal which movably supports said sensor on said airplane, and which is operative to provide information to said processor which identifies a current orientation of said sensor relative to said airplane.
Claim 19
Dependent Claim
27 words
An apparatus according to claim 14, including a display coupled to said processor, said display being operative to provide a visual display of the combined image information.
Claim 20
Dependent Claim
67 words
An apparatus according to claim 14, wherein said processor is operative to effect the update of the virtual image information by detecting, in the sensor image information, moving subject matter which is moving relative to the subject matter of interest as viewed by said sensor, and which is located between said sensor and the subject matter of interest, the other subject matter including the moving subject matter.
Claim 21
Independent Claim
130 words
A method, comprising the steps of: causing a sensor to generate sensor image information which includes information representative of subject matter of interest and information representative of other subject matter; maintaining virtual image information, including the step of separately maintaining first virtual information representative of the subject matter of interest and second virtual information representative of the other subject matter; updating the virtual image information using the sensor image information in a manner which improves the quality of the representation of the subject matter of interest in the first virtual information and the quality of the other subject matter in the second virtual information; and preparing output image information which includes information from the first virtual information, the output image information including an image of the subject matter of interest.
Claim 22
Independent Claim
130 words
A method, comprising the steps of: causing a sensor to generate sensor image information which includes information representative of subject matter of interest and information representative of other subject matter; maintaining virtual image information, including the step of separately maintaining first virtual information representative of the subject matter of interest and second virtual information representative of the other subject matter; updating the virtual image information using the sensor image information in a manner which improves the quality of the representation of the subject matter of interest in the first virtual information and the quality of the other subject matter in the second virtual information; and preparing output image information which includes information from the first virtual information, the output image information including an image of the subject matter of interest.
References Cited (Backward Citations)
US4608656A
Cited
US4464543A
Cited
US5001558A
Cited
EP0476959A2
Cited
DE4032927A1
Cited
WO1994008312A1
Cited
US5528735A
Cited
US5729016A
Cited
US5414439A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-05-09 | 2003-11-08 | 2004-05-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-05-09 | 2007-11-08 | 2008-05-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-05-09 | 2011-11-08 | 2012-05-09 | $7700.00 | Window Closed / Lapsed |