← Back to Patent Explorer
US4645459A Expired / Lapsed US ⏱️ 0.0 years remaining

Computer generated synthesized imagery

Assignee: Theseus Research Inc
•
Filing: 1982-07-30
•
Granted: 1987-02-24
•
Expires: 2002-07-30
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract The disclosure relates to a computer controlled imaging system involving a digital image processing and display system which has the ability to compose and construct a display scene from a library of images with sufficient processing speed to permit real-time or near real time analysis of the images by a human operator or a hardware/software equivalent thereof.

Inventors

  • 👤 Carl P. Graf
  • 👤 Kim M. Fairchild
  • 👤 Karl M. Fant
  • 👤 George W. Rusler
  • 👤 Michael O. Schroeder

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-23 02:31
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/23; H04N21/234; H04N21/2343; H04N21/234318; G; G06; G06T; G06T15/00; G06T15/04; G06T17/00; G06T17/10; G09; G09B; G09B9/00; G09B9/02; G09B9/08; G09B9/30; G09B9/301; H04N21/40; H04N21/47; H04N21/472; H04N21/47205

Claims Analysis

Total Claims: 48
Claim 1
Independent Claim 361 words
A computer controlled imaging system responsive to the position and orientation of a scene recognition means comprising: a data base having a defined area with a digital three coordinate system and a library having a plurality of rectangular two dimensional image frames of electromagnetic spectrum band representation of images; said defined area part of said data base having scene composition data which defines the location and size of each of said image frames relative to said coordinate system; simulation means for supplying position vectors and rotational observation data defining the location and the field of view of said scene recognition means relative to said defined area coordinate system; interface means for receiving said observation data; field of view processor means associated with said interface means and said data base, said field of view processor means including a second three coordinate system and means for determining which of said image frames are included in said field of view and their respective ranges relative to said observation data and said frame data to compute four corner coordinates in said second three coordinate system which correspond to the defined area coordinates of the corners of each said included image frames; controller means connected to said field of view processor and including means to receive data therefrom; said data including the identity of said image frames included in said field of view, said ranges of said included image frames and said coordinates of each of said included image frames; said controller means being further connected to said library part of said data base; processing channel means controlled by said controller means connected to said library part of said data base wherein said library part of said data base is connected between said controller means and said processing channel means, said channel means operating to map said included frames to the enclosed space defined by the corresponding ones of said corner coordinates; and scene construction means connected to said processing channels for assembling an output scene based on said ranges of said included frames on a digital basis such that the included frame nearest said scene recognition means includes more distant ones of said included frames.
Claim 2
Dependent Claim 361 words
A computer controlled imaging system responsive to the position and orientation of a scene recognition means comprising: a data base having a defined area with a digital three coordinate system and a library having a plurality of rectangular two dimensional image frames of electromagnetic spectrum band representation of images; said defined area part of said data base having scene composition data which defines the location and size of each of said image frames relative to said coordinate system; simulation means for supplying position vectors and rotational observation data defining the location and the field of view of said scene recognition means relative to said defined area coordinate system; interface means for receiving said observation data; field of view processor means associated with said interface means and said data base, said field of view processor means including a second three coordinate system and means for determining which of said image frames are included in said field of view and their respective ranges relative to said observation data and said frame data to compute four corner coordinates in said second three coordinate system which correspond to the defined area coordinates of the corners of each said included image frames; controller means connected to said field of view processor and including means to receive data therefrom; said data including the identity of said image frames included in said field of view, said ranges of said included image frames and said coordinates of each of said included image frames; said controller means being further connected to said library part of said data base; processing channel means controlled by said controller means connected to said library part of said data base wherein said library part of said data base is connected between said controller means and said processing channel means, said channel means operating to map said included frames to the enclosed space defined by the corresponding ones of said corner coordinates; and scene construction means connected to said processing channels for assembling an output scene based on said ranges of said included frames on a digital basis such that the included frame nearest said scene recognition means includes more distant ones of said included frames.
Claim 3
Dependent Claim 32 words
A computer-controlled imaging system according to claim 1 wherein said image frames are image representations selected from a group of electromagnetic wavelength bands consisting of IR, visual, millimeter wave or SAR domain.
Claim 4
Dependent Claim 17 words
The imaging system according to claim 1 further comprising a human-recognizable display device for displaying said scene.
Claim 5
Dependent Claim 16 words
The imaging system according to claim 3 wherein said display device is a video output device.
Claim 6
Dependent Claim 38 words
The imaging system according to any of claims 1, 2, 3, or 4 wherein said output scenes are produced in a continual sequential stream and correspond to any movement of said scene recognition means in said defined area.
Claim 7
Dependent Claim 30 words
The imaging system according to claim 5 wherein said sequential stream of output scenes are produced at a rate sufficient to appear as a continuous display to a human observer.
Claim 8
Dependent Claim 33 words
The imaging system according to claim 5 wherein said output scenes are produced in real-time response to the position and orientation, including changes therein, of said scene recognition means in said defined area.
Claim 9
Dependent Claim 33 words
The imaging system according to claim 6 wherein said output scenes are produced in real-time response to the position and orientation, including changes therein of said scene recognition means in said defined area.
Claim 10
Dependent Claim 45 words
The imaging system according to claim 5 wherein said movement of said scene recognition means in said defined area represents the simulated movement of a vehicle and wherein said output scenes comprise a continuous video display of the field of view of the vehicle operator.
Claim 11
Dependent Claim 25 words
The imaging system according to claim 9 wherein said display is produced in real-time response to the movement of said vehicle in said defined area.
Claim 12
Dependent Claim 418 words
A computer-controlled imaging system responsive to the position data and orientation data of a scene recognition means for providing raster display data to a raster type display device defining a two dimensional perspective view of a portion of a three dimensional system within the field of view of the scene recognition means, comprising: a data base having a defined area part with a digital three coordinate system and a library part having a plurality of two dimensional rectangular image frames of electromagnetic spectrum band representations of images; said defined area part of said data base having frame data which defines the location and size of each of said image frames relative to said coordinate system, and the scale thereof; means for supplying position vectors and rotational observation data defining the location and the field of view of said scene recognition means relative to said defined area coordinate system, interface means for receiving said observation data, field of view processor means connected to said interface means to access said observation data and connected to said defined area part of said data base, said processor means including means for determining which of said image frames are included in said field of view of said scene recognition means and their respective ranges relative to said observation data and said frame data to compute four screen corner coordinates in said three coordinates which correspond to the defined area coordinates of the corners of each said included image frames; controller means connected to said field of view processor means and including means to receive computed data therefrom including the identity of said image frames included in said field of view, said ranges of said included frames and said screen coordinates of each of said included image frames; said controller means being connected to said library part of said data base, at least one processing channel means controlled by said controller means and connected to said library part of said data base wherein said library part of said data base is connected between said controller means and said at least one processing channel, each of said at least one processing channels operating to map at least one of said included frames to the enclosed space defined by the corresponding ones of said screen corner coordinates; scene construction means connected to said processing channels for assembling a scene based on said ranges of said included frames on a digital basis with the included frame nearest said observer occluding more distant ones of said included frames.
Claim 13
Dependent Claim 418 words
A computer-controlled imaging system responsive to the position data and orientation data of a scene recognition means for providing raster display data to a raster type display device defining a two dimensional perspective view of a portion of a three dimensional system within the field of view of the scene recognition means, comprising: a data base having a defined area part with a digital three coordinate system and a library part having a plurality of two dimensional rectangular image frames of electromagnetic spectrum band representations of images; said defined area part of said data base having frame data which defines the location and size of each of said image frames relative to said coordinate system, and the scale thereof; means for supplying position vectors and rotational observation data defining the location and the field of view of said scene recognition means relative to said defined area coordinate system, interface means for receiving said observation data, field of view processor means connected to said interface means to access said observation data and connected to said defined area part of said data base, said processor means including means for determining which of said image frames are included in said field of view of said scene recognition means and their respective ranges relative to said observation data and said frame data to compute four screen corner coordinates in said three coordinates which correspond to the defined area coordinates of the corners of each said included image frames; controller means connected to said field of view processor means and including means to receive computed data therefrom including the identity of said image frames included in said field of view, said ranges of said included frames and said screen coordinates of each of said included image frames; said controller means being connected to said library part of said data base, at least one processing channel means controlled by said controller means and connected to said library part of said data base wherein said library part of said data base is connected between said controller means and said at least one processing channel, each of said at least one processing channels operating to map at least one of said included frames to the enclosed space defined by the corresponding ones of said screen corner coordinates; scene construction means connected to said processing channels for assembling a scene based on said ranges of said included frames on a digital basis with the included frame nearest said observer occluding more distant ones of said included frames.
Claim 14
Dependent Claim 28 words
A computer-controlled imaging system according to claim 11 wherein said image frames are image representations selected from a group consisting of IR, visual, millimeter wave or radar images.
Claim 15
Dependent Claim 32 words
A computer-controlled imaging system according to claim 11 wherein at least one of said image frames is a pictorial representation of a two dimensional object photographed from a predetermined average aspect angle.
Claim 16
Dependent Claim 17 words
A computer-controlled imaging system according to claim 13 wherein said aspect angle is about minus 15 degrees.
Claim 17
Dependent Claim 35 words
A computer-controlled imaging system according to claim 11 wherein some of said image frames are a series of pictorial representations of a particular object photographed at different height intervals relative to the vertical axis thereof.
Claim 18
Dependent Claim 31 words
A computer-controlled imaging system according to claim 11 wherein at least one of said image frames is a pictorial representation of a group of objects to thereby increase detail simulation thereof.
Claim 19
Dependent Claim 19 words
A computer-controlled imaging system according to claim 11 wherein some of said frames are pictorial representations of terrain surfaces.
Claim 20
Dependent Claim 46 words
A computer-controlled imaging system according to claim 17 wherein said some of said image frames for a particular terrain surface are in a group in which variations of said particular terrain surface from frame to frame provide motion simulation effects including blowing wind and running water.
Claim 21
Dependent Claim 26 words
A computer-controlled imaging system according to claim 17 wherein at least some of said frames are pictorial representations of textured surfaces such as water and grass.
Claim 22
Dependent Claim 44 words
A computer-controlled imaging system according to claim 19 wherein said defined area part of said data base includes defined elongated surface areas for natural and man-made terrain features, said frames of pictorial representations of textured surfaces being appropriately provided to represent said terrain features.
Claim 23
Dependent Claim 33 words
A computer-controlled imaging system according to claim 11 directed to portraying a large three dimensional, two axis object, storing a series of pictures in increments of small angles in both azimuth and elevation.
Claim 24
Dependent Claim 20 words
A computer-controlled imaging data system according to claim 21 wherein said small angles are on the order of one degree.
Claim 25
Dependent Claim 36 words
A computer-controlled imaging system according to claim 21 wherein said small angles are precisely obtained by taking pictures in connection with rotating a model of said large object on rotatable tables having vertical and horizontal axes.
Claim 26
Dependent Claim 33 words
A computer-controlled imaging system according to claim 21 wherein said large object is broken down into separate 2D subsurfaces which are assembled by at least two of said one or more processing channels.
Claim 27
Dependent Claim 27 words
A computer-controlled imaging system according to claim 21 wherein a series of photographs are taken of said large objects at angular azimuth intervals at a fixed elevation.
Claim 28
Dependent Claim 20 words
A computer-controlled imaging system according to claim 11 wherein said angular azimuth intervals are on the order of 30 degrees.
Claim 29
Dependent Claim 22 words
A computer-controlled imaging system according to claim 11 wherein at least one of said image frames contains one or more light sources.
Claim 30
Dependent Claim 27 words
A computer-controlled imaging system according to claim 11 wherein at least one of said frames has a translucent characteristic for adding a special effect to a scene.
Claim 31
Dependent Claim 19 words
A computer-controlled imaging system according to claim 28 wherein said special effects comprise fog, dust, smoke shadow or haze.
Claim 32
Dependent Claim 30 words
A computer-controlled imaging system according to either of claims 28 or 29 wherein said translucent characteristic is stored as a mask which defines the outline, shape and transmissivity factor thereof.
Claim 33
Dependent Claim 23 words
A computer-controlled imaging system according to claim 30 wherein a series of said frames have varying mask shapes to generate a motion effect.
Claim 34
Dependent Claim 28 words
The computer-controlled imaging system according to claim 11 further comprising means for producing occlusion of the contents of distant frames by those in closer frames in said scene.
Claim 35
Dependent Claim 61 words
An image data system according to claim 32 wherein at least one of said frames portrays an elongated object, said defined area part of said data base having multiple range points for different sections of said elongated object with the particular multiple range point closest to said observer having priority relative to occlusion comparison with other ones of said included frames.
Claim 36
Dependent Claim 24 words
A computer-controlled imaging system according to claim 33 wherein two of said multiple range points are provided for opposite ends of said elongated object.
Claim 37
Dependent Claim 73 words
A computer-controlled imaging system according to claim 11 wherein said image frames of electromagnetic spectrum band representations are in analog form, one of said at least one processing channels further comprises: A/D converter means for converting said representations to digital data form; buffer means accepting said digital data in either the X or Y axis; and means for mapping the image of said digital data to the corner coordinates of a video screen.
Claim 38
Dependent Claim 22 words
A computer-controlled imaging system according to claim 35 including means for modifying the intensity values of said data in said buffer means.
Claim 39
Dependent Claim 65 words
A computer-controlled imaging system according to claim 11 wherein said image frames of electromagnetic spectrum band representations are in digital data form; and wherein one of said at least one processing channel includes buffer means for accepting said digital data in either the X or Y axis, and means for mapping the image of said digital data to the corner coordinates of said display means.
Claim 40
Dependent Claim 22 words
A computer-controlled imaging system according to claim 37 including means for modifying the intensity values of said data in said buffer means.
Claim 41
Dependent Claim 66 words
A computer-controlled imaging system according to claim 11 wherein said scene construction means comprises channel combiner means for multiplexing signals from a plurality of processing channels and corresponding range information from said controller means, said channel combiner further comprising switch means for selecting data from said plurality of processing channels outputting scene data relative to range in the field of view of said scene recognition means.
Claim 42
Dependent Claim 20 words
One of any of claims 35, 36, 37, 38, or 39 wherein said raster display means is a video screen.
Claim 43
Dependent Claim 63 words
A computer-controlled imaging system according to any of claims 11, 32, 35 or 39 wherein said output scenes are produced in a continual sequential stream and correspond to any movement of said scene recognition means in said defined area; and wherein said sequential stream of output scenes are produced at a rate sufficient to appear as a continuous display to a human observer.
Claim 44
Dependent Claim 38 words
A computer-controlled imaging system according to claim 41 wherein said output scenes are produced in real-time response to the position and orientation of said scene recognition means in said defined area including changes in said position and orientation.
Claim 45
Dependent Claim 48 words
A computer-controlled imaging system according to claim 41 wherein said movement of said scene recognition means in said defined area represents the simulated movement of a vehicle and wherein said output scenes comprise a continuous video display of the field of view of the operator of said vehicle.
Claim 46
Dependent Claim 23 words
A computer-generated imaging system according to claim 11 including means for warping said images in said image frames requisite to said scene representation.
Claim 47
Dependent Claim 20 words
A computer-controlled imaging system according to claim 44 including means for accomplishing both linear and perspective image warping as desired.
Claim 48
Dependent Claim 32 words
A computer-controlled imaging system according to claim 11 including special effect means associated with said scene construction means for adding translucent images including smoke, haze or dust into the scene as desired.

References Cited (Backward Citations)

US4107780A Cited
US4199875A Cited
US4179823A Cited
US4152766A Cited
US4181953A Cited
US4263726A Cited
US4179824A Cited
US4213252A Cited
US4209832A Cited
US4208719A Cited
US4229797A Cited
US4208810A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1990-02-23 1990-08-25 1991-02-24 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1994-02-23 1994-08-25 1995-02-24 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 1998-02-23 1998-08-25 1999-02-24 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag