EP0315051A2
Expired / Lapsed
EP
⏱️ 0.0 years remaining
Perspective mapping in a computer-controlled imaging system
Assignee: Honeywell Inc
•
Filing: 1983-07-27
•
Granted: —
•
Expires: 2003-07-27
Abstract
Abstract A computer controlled digital imaging process system is devised which operates to compose and construct a sequential stream of scenes for a 2-dimensional display from a library of images of objects such as trees. The processing speed is sufficient to permit a real-time, or near real-time, analysis of the images by a human operator or a hardware/software equivalent thereof. The images of objects stored in the library are in rectangular form. A vehicle such as a helicopter simulator has a field of view which represents what is seen through the "windshield" thereof which in the simulator is the screen of a computer monitor. A perspective mapping process is provided for mapping images of objects which appear in the field of view from the corresponding images in the library to the face of the monitor screen. The four corners of a stored image are located by calculations in the face of the monitor screen and the mapping of rows and columns of a stored image is done in two passes or stages. Whereas linear mapping involves the linear conversion of pixel lengths, the perspective mapping herein makes such conversions on the basis of different parts of the object being different distances from the "windshield" or face of the monitor screen and thus the more realistic effects of a perspective view are achieved.
Inventors
- 👤 Karl M. Fant
Bibliographic Details
Application Number
—
Jurisdiction
EP
Data Source
google_patents
Last Synchronized
2026-11-01 19:30
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/20; H04N21/23; H04N21/234; H04N21/2343; H04N21/234318; G; G06; G06T; G06T15/00; G06T15/04; G09; G09B; G09B9/00; G09B9/02; G09B9/08; G09B9/30; G09B9/301; H04N21/40; H04N21/47; H04N21/472; H04N21/47205
Claims Analysis
Total Claims: 8
Claim 1
Independent Claim
427 words
System for mapping a digital input image to a viewing plane wherein said image comprises elements arranged in columns and rows representing a matrix of pixel intensity values in a 3D coordinate system having an observation point on a main axis thereof and a viewing plane extending normal to said axis and spaced from said observation point, said system defining a reference plane intersecting said main axis and extending normal to said viewing plane, characterized by the following features: means for sequentially and orthogonally projecting said columns of said input image to said reference plane to form first-pass object lines in said reference plane; means for processing each of said first pass object lines in a manner which simulates projecting divergent lines having a separation of at least one pixel from said origin through said viewing plane and said corresponding first-object line such that the intersections of said divergent lines with said viewing plane describe an intermediate image line having segments between said divergent lines having a length equal to the number of pixels separating said divergent lines; means for obtaining the pixel ratio for each of said first pass object line segments relative to the corresponding one of said intermediate image line segments; means for mapping the pixels of each column sequentially and fractionally to the first pass object line segments of the corresponding first pass object line; means for projecting divergent planes from said origin through rows of said viewing plane, said divergent planes having a separation of at least one pixel, each of said divergent planes intersecting said viewing plane to form a final image line and intersecting said input image to form a second pass object line; means for processing each of said second pass object lines by extending second pass divergent lines from said origin through columns of said viewing plane having a separation of at least one pixel and through said second pass object line, said second pass divergent lines intersecting said viewing plane to form a horizontally extending correctly positioned final image line with segments each having a length equal to the number of pixels separating said second pass divergent lines and intersecting said second pass object line to form segments; means for obtaining the pixel ratio for each of said second pass object line segments relative to the corresponding one of said final image line segments, for each of said intermediate image rows; and means for mapping the pixels of the row sequentially and fractionally to the second pass object line segments of the corresponding second pass object line.
Claim 2
Dependent Claim
427 words
System for mapping a digital input image to a viewing plane wherein said image comprises elements arranged in columns and rows representing a matrix of pixel intensity values in a 3D coordinate system having an observation point on a main axis thereof and a viewing plane extending normal to said axis and spaced from said observation point, said system defining a reference plane intersecting said main axis and extending normal to said viewing plane, characterized by the following features: means for sequentially and orthogonally projecting said columns of said input image to said reference plane to form first-pass object lines in said reference plane; means for processing each of said first pass object lines in a manner which simulates projecting divergent lines having a separation of at least one pixel from said origin through said viewing plane and said corresponding first-object line such that the intersections of said divergent lines with said viewing plane describe an intermediate image line having segments between said divergent lines having a length equal to the number of pixels separating said divergent lines; means for obtaining the pixel ratio for each of said first pass object line segments relative to the corresponding one of said intermediate image line segments; means for mapping the pixels of each column sequentially and fractionally to the first pass object line segments of the corresponding first pass object line; means for projecting divergent planes from said origin through rows of said viewing plane, said divergent planes having a separation of at least one pixel, each of said divergent planes intersecting said viewing plane to form a final image line and intersecting said input image to form a second pass object line; means for processing each of said second pass object lines by extending second pass divergent lines from said origin through columns of said viewing plane having a separation of at least one pixel and through said second pass object line, said second pass divergent lines intersecting said viewing plane to form a horizontally extending correctly positioned final image line with segments each having a length equal to the number of pixels separating said second pass divergent lines and intersecting said second pass object line to form segments; means for obtaining the pixel ratio for each of said second pass object line segments relative to the corresponding one of said final image line segments, for each of said intermediate image rows; and means for mapping the pixels of the row sequentially and fractionally to the second pass object line segments of the corresponding second pass object line.
Claim 3
Dependent Claim
552 words
System for mapping in a 3D coordinate system having a viewing plane extending normal to said axis and spaced from said viewing point, said system having a reference plane containing said main axis and extending normal to said viewing plane, said system operating on a digital input image arranged in columns and rows and represented as a matrix of pixel intensity values, said input image being on the opposite side of said viewing plane from said view ing point, said system being applicable to map said input image to said viewing plane, characterized by the following features: means for successively and orthogonally projecting said columns of said input image to said reference plane to form first pass object lines in said reference plane, means for processing each of said first pass object lines in sequence by extending radiating rays in said reference plane from said origin through said viewing plane and said first pass object line, said radiating rays intersecting said viewing plane to form an intermediate image line with segments each having the length of one pixel and intersecting said first pass object line to form segments each having a different length, means for prorating the total number of said input image rows with respect to said first pass object line segments to obtain the pixel ratio for each of said first pass object line segments relative to the corresponding one of said intermediate image line segments, for each of said input columns mapping the pixels thereof sequentially and fractionally to the first pass object line segments of the corresponding first pass object line, means for summing and averaging for each segment of each of said first pass object lines the intensity values of each pixel mapped thereto and applying the composite value to the corresponding intermediate image line segment, means for processing said input image by extending radiating planes from said origin through rows of said viewing plane having one pixel separation and through said input image, each of said radiating planes intersecting said viewing plane to form a final image line and intersecting said input image to form a second pass object line, means for processing each of said second pass object lines by extending second pass radiating rays from said origin through columns of said viewing plane having one pixel separation and through said second pass object line, said second pass radiating rays intersecting said viewing plane to form a horizontally extending correctly positioned final image line with segments each having the length of one pixel and intersecting said second pass object line to form segments each having a different length, means for prorating the total number of said intermediate image rows with respect to said second pass object line segments to obtain the pixel ratio for each of said second pass object line segments relative to the corresponding one of said final image line segments, for each of said intermediate image rows mapping the pixels of the row sequentially and fractionally to the second pass object line segments of the corresponding second pass object line, means for summing and averaging for each segment of each of said second pass object lines the intensity values of each pixel mapped thereto applicable to each final image pixel and applying the composite value to the corresponding final image line segment.
Claim 4
Dependent Claim
552 words
System for mapping in a 3D coordinate system having a viewing plane extending normal to said axis and spaced from said viewing point, said system having a reference plane containing said main axis and extending normal to said viewing plane, said system operating on a digital input image arranged in columns and rows and represented as a matrix of pixel intensity values, said input image being on the opposite side of said viewing plane from said view ing point, said system being applicable to map said input image to said viewing plane, characterized by the following features: means for successively and orthogonally projecting said columns of said input image to said reference plane to form first pass object lines in said reference plane, means for processing each of said first pass object lines in sequence by extending radiating rays in said reference plane from said origin through said viewing plane and said first pass object line, said radiating rays intersecting said viewing plane to form an intermediate image line with segments each having the length of one pixel and intersecting said first pass object line to form segments each having a different length, means for prorating the total number of said input image rows with respect to said first pass object line segments to obtain the pixel ratio for each of said first pass object line segments relative to the corresponding one of said intermediate image line segments, for each of said input columns mapping the pixels thereof sequentially and fractionally to the first pass object line segments of the corresponding first pass object line, means for summing and averaging for each segment of each of said first pass object lines the intensity values of each pixel mapped thereto and applying the composite value to the corresponding intermediate image line segment, means for processing said input image by extending radiating planes from said origin through rows of said viewing plane having one pixel separation and through said input image, each of said radiating planes intersecting said viewing plane to form a final image line and intersecting said input image to form a second pass object line, means for processing each of said second pass object lines by extending second pass radiating rays from said origin through columns of said viewing plane having one pixel separation and through said second pass object line, said second pass radiating rays intersecting said viewing plane to form a horizontally extending correctly positioned final image line with segments each having the length of one pixel and intersecting said second pass object line to form segments each having a different length, means for prorating the total number of said intermediate image rows with respect to said second pass object line segments to obtain the pixel ratio for each of said second pass object line segments relative to the corresponding one of said final image line segments, for each of said intermediate image rows mapping the pixels of the row sequentially and fractionally to the second pass object line segments of the corresponding second pass object line, means for summing and averaging for each segment of each of said second pass object lines the intensity values of each pixel mapped thereto applicable to each final image pixel and applying the composite value to the corresponding final image line segment.
Claim 5
Independent Claim
453 words
A method of mapping a digital input image to a viewing screen which is moveable in a 3D coordinate system and wherein said image comprises columns and rows of pixels representing a matrix of pixel intensity values in said system, said system having an observation point on a main axis thereof and a viewing screen having a format with columns and rows extending normal to said axis and spaced from said observation point, said system defining a vertical reference plane parallel to said main axis and extending normal to said viewing screen, characterized by the steps of: projecting sequentially and orthogonally said columns of said input image to said reference plane to form first pass object lines in said reference plane; processing each line of said first pass object lines by projecting divergent lines from said observation point to said each line of said first pass object lines to define an immediate vertically extending image column line in relation to said viewing screen having equal line segments of a length at least equal to one pixel length, said divergent lines intersecting said each line of said first pass object lines and resulting in corresponding first pass line segments thereof between said divergent lines having respective lengths corresponding to the number of said pixels separating adjacent ones of said divergent lines; calculating pixel ratios of said first pass line segments relative to corresponding ones of said line segments of said intermediate image column line; mapping pixels respectively from said first pass line segments to corresponding ones of said line segments of said intermediate image column line; projecting divergent planes from said observation point through said rows of said viewing screen having a separation of at least one pixel length in said screen, each of said divergent planes intersecting said screen to form a final image row line and intersecting said input image to form a second pass object line; processing each said second pass object line in each of said divergent planes by projecting second pass divergent lines from said observation point through said columns of said screen having a separation of at least one pixel in said screen, said second pass divergent lines intersecting each said second pass object lines to form second pass line segments thereof and intersecting said screen to form horizontally extending correctly positioned final image rows, said second pass line segments having respective lengths corresponding to the number of said pixels separating adjacent ones of said second pass divergent lines; calculating pixel ratios of said second pass line segments relative to corresponding line segments of said final image row; and mapping pixels respectively from said second pass line segments to corresponding line segments of each said final image row.
Claim 6
Independent Claim
453 words
A method of mapping a digital input image to a viewing screen which is moveable in a 3D coordinate system and wherein said image comprises columns and rows of pixels representing a matrix of pixel intensity values in said system, said system having an observation point on a main axis thereof and a viewing screen having a format with columns and rows extending normal to said axis and spaced from said observation point, said system defining a vertical reference plane parallel to said main axis and extending normal to said viewing screen, characterized by the steps of: projecting sequentially and orthogonally said columns of said input image to said reference plane to form first pass object lines in said reference plane; processing each line of said first pass object lines by projecting divergent lines from said observation point to said each line of said first pass object lines to define an immediate vertically extending image column line in relation to said viewing screen having equal line segments of a length at least equal to one pixel length, said divergent lines intersecting said each line of said first pass object lines and resulting in corresponding first pass line segments thereof between said divergent lines having respective lengths corresponding to the number of said pixels separating adjacent ones of said divergent lines; calculating pixel ratios of said first pass line segments relative to corresponding ones of said line segments of said intermediate image column line; mapping pixels respectively from said first pass line segments to corresponding ones of said line segments of said intermediate image column line; projecting divergent planes from said observation point through said rows of said viewing screen having a separation of at least one pixel length in said screen, each of said divergent planes intersecting said screen to form a final image row line and intersecting said input image to form a second pass object line; processing each said second pass object line in each of said divergent planes by projecting second pass divergent lines from said observation point through said columns of said screen having a separation of at least one pixel in said screen, said second pass divergent lines intersecting each said second pass object lines to form second pass line segments thereof and intersecting said screen to form horizontally extending correctly positioned final image rows, said second pass line segments having respective lengths corresponding to the number of said pixels separating adjacent ones of said second pass divergent lines; calculating pixel ratios of said second pass line segments relative to corresponding line segments of said final image row; and mapping pixels respectively from said second pass line segments to corresponding line segments of each said final image row.
Claim 7
Independent Claim
481 words
A method of mapping a digital input image to a viewing screen which is moveable in a 3D coordinate system and wherein said image comprises columns and rows of pixels representing a matrix of pixel intensity values in said system, said system having an observation point on a main axis thereof and a viewing screen having a format with columns and rows of pixels extending normal to said axis and spaced from said observation point, said system defining a vertical and horizontal reference plane parallel to said main axis and extending normal to said viewing screen, characterized by the steps of: projecting sequentially and orthogonally said columns of said input image to said vertical reference plane to form first pass object lines in said vertical reference plane; processing each line of said first pass object lines by projecting divergent lines from said observation point to said each line of said first pass object lines to define an intermediate vertically extending image column line in relation to said viewing screen having equal line segments of a length at least equal to one pixel length, said divergent lines intersecting said each line of said first pass object lines and resulting in corresponding first pass line segments thereof between said divergent lines having respective lengths corresponding to the number of said pixels separating adjacent ones of said divergent lines; calculating pixel ratios of said first pass line segments relative to corresponding ones of said line segments of said intermediate image column line; mapping pixels respectively from said first pass line segments to corresponding ones of said line segments of said intermediate image column line; projecting divergent planes from said observation point through said rows of said viewing screen having a separation of at least one pixel length in said screen, each of said divergent planes intersecting said screen to form a final image row line and intersecting said input image to form a second pass object line; projecting sequentially and orthogonally said second pass object lines to said horizontal reference plane to form constructional second pass object lines in said horizontal reference plane; processing each said constructional second pass object line by projecting second pass divergent lines from said observation point through said columns of said screen having a sepration of at least one pixel in said screen, said second pass divergent lines intersecting each said constructional second pass object line to form second pass line segments thereof and intersecting said screen to form horizontally extending correctly positioned final image rows, said second pass line segments having respective lengths corresponding to the number of said pixels separating adjacent ones of said second pass divergent lines; calculating pixel rations of said second pass line segments relative to corresponding line segments of said final image row; and mapping pixels respectively from said second pass line segments to corresponding line segments of each said final image row.
Claim 8
Independent Claim
481 words
A method of mapping a digital input image to a viewing screen which is moveable in a 3D coordinate system and wherein said image comprises columns and rows of pixels representing a matrix of pixel intensity values in said system, said system having an observation point on a main axis thereof and a viewing screen having a format with columns and rows of pixels extending normal to said axis and spaced from said observation point, said system defining a vertical and horizontal reference plane parallel to said main axis and extending normal to said viewing screen, characterized by the steps of: projecting sequentially and orthogonally said columns of said input image to said vertical reference plane to form first pass object lines in said vertical reference plane; processing each line of said first pass object lines by projecting divergent lines from said observation point to said each line of said first pass object lines to define an intermediate vertically extending image column line in relation to said viewing screen having equal line segments of a length at least equal to one pixel length, said divergent lines intersecting said each line of said first pass object lines and resulting in corresponding first pass line segments thereof between said divergent lines having respective lengths corresponding to the number of said pixels separating adjacent ones of said divergent lines; calculating pixel ratios of said first pass line segments relative to corresponding ones of said line segments of said intermediate image column line; mapping pixels respectively from said first pass line segments to corresponding ones of said line segments of said intermediate image column line; projecting divergent planes from said observation point through said rows of said viewing screen having a separation of at least one pixel length in said screen, each of said divergent planes intersecting said screen to form a final image row line and intersecting said input image to form a second pass object line; projecting sequentially and orthogonally said second pass object lines to said horizontal reference plane to form constructional second pass object lines in said horizontal reference plane; processing each said constructional second pass object line by projecting second pass divergent lines from said observation point through said columns of said screen having a sepration of at least one pixel in said screen, said second pass divergent lines intersecting each said constructional second pass object line to form second pass line segments thereof and intersecting said screen to form horizontally extending correctly positioned final image rows, said second pass line segments having respective lengths corresponding to the number of said pixels separating adjacent ones of said second pass divergent lines; calculating pixel rations of said second pass line segments relative to corresponding line segments of said final image row; and mapping pixels respectively from said second pass line segments to corresponding line segments of each said final image row.
References Cited (Backward Citations)
No citation records indexed.
USPTO Annuity & Maintenance Windows
Maintenance schedule is calculated for granted US utility patents.