US3905045A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus for image processing
Assignee: Control Data Corp
•
Filing: 1973-06-29
•
Granted: 1975-09-09
•
Expires: 1993-06-29
Abstract
Abstract A special purpose pipeline digital computer is disclosed for processing a pair of related, digitally encoded, images to produce a difference image showing any dissimilarities between the first image and the second image. The computer is comprised of a number of special purpose pipeline processors linked to a supervisory general purpose processor. First, a initial image warp transformation is computed by a spatial transformation pipeline processor using a plurality of operator selected, feature related, match points on the pair of images, and then, image correlation is performed by a dot product processor working with a square root and divide processor to identify the exact matching location of a second group matching points selected in a geometrical pattern, on the pair of images. The final image warp transformation to achieve image registration occurs in the spatial transformation processor, using a localized polylateral technique having the geometrically selected match points as the vertrices of the polylaterals. Finally, photoequalization is performed and the difference image is generated from the pair of registered images by a photoequalization processor.
Inventors
- 👤 Donald Francis Nickel
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 13:34
CPC Classifications
A; A61; A61B; A61B6/00; A61B6/02; G; G06; G06T; G06T5/00; G06T5/80
Claims Analysis
Total Claims: 10
Claim 1
Independent Claim
546 words
Apparatus for producing a difference image, by sequential operation of a plurality of elements, from related subjects represented on a first and a second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said apparatus comprising: a supervisory computer for coNtrolling the flow of digitally encoded data representative of images during the operation of said apparatus, means connected with said supervisory computer for supplying encoded digital image data thereto representative of gray scale values on said first and second images, means connected with said supervisory computer for providing mass memory storage capability for use by the elements of said apparatus as the elements thereof perform image processing steps in sequential order, first and second spatial transformation processors, each connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said data ultimately being retrieved from and returned to said means for providing a mass memory storage, said processors operating initially to perform an initial image warp transformation using operator selected match points on said first and second images, and which at a subsequent step in the sequence produces a final image warp transformation using data calculated in steps subsequent to said initial image warp transformation, a dot product processor connected to receive data from said supervisory computer, ultimately retrieved from said means for providing mass memory storage, said data resulting from said initial image warp transformation produced by said spatial transformation processors, a square root and divide processor connected to receive data from said dot product processor and to transfer processed data to said supervisory computer, said data being re-introduced to said spatial transformation processors for production of said final image warp transformation data, said dot product processor and square root and divide processors providing image correlation data for said spatial transformation processors for said final image warp transformation, a plurality of interpolation processors, connected to said supervisory computer, to receive data resulting from the final image warp transformation performed by said spatial transformation processors, said interpolation processors adapted to determine the gray scale values of transformed picture cells, at least one of said processors connected to receive data from said supervisory computer and at least one of said processors connected to transfer processed data to said supervisory computer, a photo equalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said processor to receive the data resulting from the operation of said interpolation processors and to simultaneously photo equalize one of said images with the other of said images and to mathematically determine a difference in gray scale values between one of said images and the other of said images on a picture cell by picture basis wherein one of the images has undergone image warp transformation and photo equalization with respect to the other so that the two picture cells are equivalent in image detail to one another, and means connected with said supervisory computer for producing a difference image in operator usable form from the difference values produced by said photo equalization and difference image processor.
Claim 2
Dependent Claim
546 words
Apparatus for producing a difference image, by sequential operation of a plurality of elements, from related subjects represented on a first and a second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said apparatus comprising: a supervisory computer for coNtrolling the flow of digitally encoded data representative of images during the operation of said apparatus, means connected with said supervisory computer for supplying encoded digital image data thereto representative of gray scale values on said first and second images, means connected with said supervisory computer for providing mass memory storage capability for use by the elements of said apparatus as the elements thereof perform image processing steps in sequential order, first and second spatial transformation processors, each connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said data ultimately being retrieved from and returned to said means for providing a mass memory storage, said processors operating initially to perform an initial image warp transformation using operator selected match points on said first and second images, and which at a subsequent step in the sequence produces a final image warp transformation using data calculated in steps subsequent to said initial image warp transformation, a dot product processor connected to receive data from said supervisory computer, ultimately retrieved from said means for providing mass memory storage, said data resulting from said initial image warp transformation produced by said spatial transformation processors, a square root and divide processor connected to receive data from said dot product processor and to transfer processed data to said supervisory computer, said data being re-introduced to said spatial transformation processors for production of said final image warp transformation data, said dot product processor and square root and divide processors providing image correlation data for said spatial transformation processors for said final image warp transformation, a plurality of interpolation processors, connected to said supervisory computer, to receive data resulting from the final image warp transformation performed by said spatial transformation processors, said interpolation processors adapted to determine the gray scale values of transformed picture cells, at least one of said processors connected to receive data from said supervisory computer and at least one of said processors connected to transfer processed data to said supervisory computer, a photo equalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said processor to receive the data resulting from the operation of said interpolation processors and to simultaneously photo equalize one of said images with the other of said images and to mathematically determine a difference in gray scale values between one of said images and the other of said images on a picture cell by picture basis wherein one of the images has undergone image warp transformation and photo equalization with respect to the other so that the two picture cells are equivalent in image detail to one another, and means connected with said supervisory computer for producing a difference image in operator usable form from the difference values produced by said photo equalization and difference image processor.
Claim 3
Dependent Claim
22 words
The apparatus of claim 1 and further comprising means for data buffering connected between said supervisory computer and said dot product processor.
Claim 4
Dependent Claim
25 words
The apparatus of claim 1 and further comprising means for data buffering connected between said supervisory computer and at least one of said interpolation processors.
Claim 5
Dependent Claim
574 words
Apparatus for producing a difference image by sequential operation of a plurality of elements from related subjects represented on a first and a second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said apparatus comprising: a supervisoRy computer for controlling the flow of digitally encoded data representative of images during the operation of said apparatus, means connected with said supervisory computer for supplying encoded digital image data thereto representative of gray scale values on said first and second images, means connected with said supervisory computer for providing mass memory capability for use by the elements of said apparatus as the elements thereof perform image processing steps in sequential order, processing means for spatially transforming at least one of said images to achieve registration with the other by assigning a transformed location on the registered image for each picture cell in the original image, and means connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said data ultimately being retrieved from and returned to said means for providing a mass memory storage, said means operating initially to perform an initial image warp transformation using operator selected match points on said first and second images, and which, at a subsequent step in the sequence, produces a final image warp transformation using data supplied in steps subsequent to said initial warp transformation, a dot product processor connected to receive data from said supervisory computer, ultimately retrieved from said means for providing mass storage, said data resulting from said initial image warp transformation produced by said spatial transformation means, a square root and divide processor connected to receive data from said dot product processor and to transfer processed data to said supervisory computer, said data being re-introduced to said spatial transformation means for production of said final image warp transformation data, said dot product processor and square root and divide processors providing image correlation data for said spatial transformation means for said final image warp transformation, processing means for interpolating the gray scale values of picture cells transformed by said spatial transformation processing means connected to said supervisory computer, to receive data resulting from the final image warp transformation performed by said spatial transformation processing means, said means adapted to determine the gray scale values of transformed picture cells, said means connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, a photo equalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said processor to receive the data resulting from the operation of said interpolation processing means and to simultaneously photoequalize one of said images with the other of said images and to mathematically determine a difference in gray scale values between one of said images and the other of said images on a picture cell by picture basis wherein one of the images has undergone image warp transformation and photo equalization with respect to the other so that the two picture cells are equivalent in image detail to one another, and means connected with said supervisory computer for producing a difference image in operator usable form from the difference values produced by said photo equalization and difference image processor.
Claim 6
Dependent Claim
574 words
Apparatus for producing a difference image by sequential operation of a plurality of elements from related subjects represented on a first and a second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said apparatus comprising: a supervisoRy computer for controlling the flow of digitally encoded data representative of images during the operation of said apparatus, means connected with said supervisory computer for supplying encoded digital image data thereto representative of gray scale values on said first and second images, means connected with said supervisory computer for providing mass memory capability for use by the elements of said apparatus as the elements thereof perform image processing steps in sequential order, processing means for spatially transforming at least one of said images to achieve registration with the other by assigning a transformed location on the registered image for each picture cell in the original image, and means connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said data ultimately being retrieved from and returned to said means for providing a mass memory storage, said means operating initially to perform an initial image warp transformation using operator selected match points on said first and second images, and which, at a subsequent step in the sequence, produces a final image warp transformation using data supplied in steps subsequent to said initial warp transformation, a dot product processor connected to receive data from said supervisory computer, ultimately retrieved from said means for providing mass storage, said data resulting from said initial image warp transformation produced by said spatial transformation means, a square root and divide processor connected to receive data from said dot product processor and to transfer processed data to said supervisory computer, said data being re-introduced to said spatial transformation means for production of said final image warp transformation data, said dot product processor and square root and divide processors providing image correlation data for said spatial transformation means for said final image warp transformation, processing means for interpolating the gray scale values of picture cells transformed by said spatial transformation processing means connected to said supervisory computer, to receive data resulting from the final image warp transformation performed by said spatial transformation processing means, said means adapted to determine the gray scale values of transformed picture cells, said means connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, a photo equalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, said processor to receive the data resulting from the operation of said interpolation processing means and to simultaneously photoequalize one of said images with the other of said images and to mathematically determine a difference in gray scale values between one of said images and the other of said images on a picture cell by picture basis wherein one of the images has undergone image warp transformation and photo equalization with respect to the other so that the two picture cells are equivalent in image detail to one another, and means connected with said supervisory computer for producing a difference image in operator usable form from the difference values produced by said photo equalization and difference image processor.
Claim 7
Independent Claim
490 words
A method for producing a difference image from related subjects represented on a first and a second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said method performed on an apparatus comprised of a supervisory computer, a dot product processor connected to receive data from said supervisory computer, a square root and divide processor connected to receive data from said dot product processor and to transfEr processed data to said supervisory computer, a photoequalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, first and second spatial transformation processors, each connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, a plurality of interpolation processors adapted to determine the gray scale values of transformed picture cells, at least one of said processors connected to receive data from said supervisory computer and at least one of said processors connected to transfer processed data to said supervisory computer, means connected with said supervisory computor for supplying encoded digital image data, means connected with said supervisory computer for providing mass memory storage capability, and means connected with said supervisory computer for producing a difference image in operator usable form, said method comprising the steps of: a. initially, manually positioning the features on said images to obtain approximate correspondence of at least some major image features; b. identifying at least four corresponding image control point pairs related to features appearing on both images and measuring the relative positions of said points; c. calculating image warp values, for at least one of said images for determining the estimated location of plurality of match point pairs selected in a geometric pattern, based on the control point pairs determined in step (b); d. assigning an image correlation value to an array of picture cells surrounding each of said geometrically selected match point pairs; e. determining by successive calculations based on comparison of a plurality of relative displacements of each array the location producing the best correlation value to determine the precise location of each of said match point pairs; f. using the precisely determined location of an initial group of match point pairs to determine the estimated location of additional match point pairs; g. repeating steps f and e until the precise location of a predetermined number of match points is determined throughout the pair of images; h. warping one image to achieve registration with the other based on the location of the match point pairs; i. photoequalizing the gray scale information content of said images to achieve corresponding gray scale information content values for corresponding features of the images; and j. producing a difference image from the pair of images by subtracting one image from the other.
Claim 8
Independent Claim
490 words
A method for producing a difference image from related subjects represented on a first and a second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said method performed on an apparatus comprised of a supervisory computer, a dot product processor connected to receive data from said supervisory computer, a square root and divide processor connected to receive data from said dot product processor and to transfEr processed data to said supervisory computer, a photoequalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, first and second spatial transformation processors, each connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, a plurality of interpolation processors adapted to determine the gray scale values of transformed picture cells, at least one of said processors connected to receive data from said supervisory computer and at least one of said processors connected to transfer processed data to said supervisory computer, means connected with said supervisory computor for supplying encoded digital image data, means connected with said supervisory computer for providing mass memory storage capability, and means connected with said supervisory computer for producing a difference image in operator usable form, said method comprising the steps of: a. initially, manually positioning the features on said images to obtain approximate correspondence of at least some major image features; b. identifying at least four corresponding image control point pairs related to features appearing on both images and measuring the relative positions of said points; c. calculating image warp values, for at least one of said images for determining the estimated location of plurality of match point pairs selected in a geometric pattern, based on the control point pairs determined in step (b); d. assigning an image correlation value to an array of picture cells surrounding each of said geometrically selected match point pairs; e. determining by successive calculations based on comparison of a plurality of relative displacements of each array the location producing the best correlation value to determine the precise location of each of said match point pairs; f. using the precisely determined location of an initial group of match point pairs to determine the estimated location of additional match point pairs; g. repeating steps f and e until the precise location of a predetermined number of match points is determined throughout the pair of images; h. warping one image to achieve registration with the other based on the location of the match point pairs; i. photoequalizing the gray scale information content of said images to achieve corresponding gray scale information content values for corresponding features of the images; and j. producing a difference image from the pair of images by subtracting one image from the other.
Claim 9
Independent Claim
557 words
A method for producing a difference image from related subjects represented on a first and second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said method performed on an apparatus comprised of a supervisory computer, a dot product processor connected to receive data from said supervisory computer, a square root and divide processor connected to receive data from said dot product processor and to transfer processed data to said supervisory computer, a photoequalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, processing means for spatially transforming at least one of said images to achieve registration with the other by assigning a transformed location on the registered image for each picture cell in the original image, said means connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, processing means for interpolating the gray scale values of picture cells transformed by said spatial transformation processing means to determine the gray scale value of transformed picture cells from adjacent picture cell gRay scale values in the original image, said processing means being connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, means connected with said supervisory computer for supplying encoded digital image data with respect to said first and second images, means connected with said supervisory computer for providing mass memory storage capability for storing gray scale values for picture cells in said first and second images during processing of data, and for said difference image, means connected with said supervisory computer for producing a difference image in operator usable form, said method comprising the steps of: initially, obtaining a preliminary coarse positioning of the features on said images to obtain approximate correspondence of at least some major image features; identifying at least four corresponding image control point pairs related to features appearing on both images and measuring the relative positions of said points; calculating image warp values, for at least one of said images for determining the estimated location of plurality of match point pairs selected in geometric pattern, based on the control point pairs determined in the second step, assigning an image correlation value to an array of picture cells surrounding each of said geometrically selected match point pairs, determining by successive calculations based on comparison of a plurality of relative displacements of each array the location producing the best correlation value to determine the precise location of each of said match point pairs, using the precisely determined location of an initial group of match point pairs to determine the estimated location of additional match point pairs, repeating the fifth and sixth steps until the precise location of a predetermined number of match points is determined throughout the pair of images, warping one image to achieve registration with the other based on the location of the match point pairs, photoequalizing the gray scale information content of said images to achieve corresponding gray scale information content values for corresponding features of the images; and producing a difference image from the pair of images by subtracting one image from the other.
Claim 10
Independent Claim
557 words
A method for producing a difference image from related subjects represented on a first and second image, wherein said first and second images are represented by digitally encoded values representative of gray scale values in a predetermined gray scale range for a plurality of picture cells into which each of said images is divided, said method performed on an apparatus comprised of a supervisory computer, a dot product processor connected to receive data from said supervisory computer, a square root and divide processor connected to receive data from said dot product processor and to transfer processed data to said supervisory computer, a photoequalization and difference image processor connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, processing means for spatially transforming at least one of said images to achieve registration with the other by assigning a transformed location on the registered image for each picture cell in the original image, said means connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, processing means for interpolating the gray scale values of picture cells transformed by said spatial transformation processing means to determine the gray scale value of transformed picture cells from adjacent picture cell gRay scale values in the original image, said processing means being connected to receive data from said supervisory computer and to transfer processed data to said supervisory computer, means connected with said supervisory computer for supplying encoded digital image data with respect to said first and second images, means connected with said supervisory computer for providing mass memory storage capability for storing gray scale values for picture cells in said first and second images during processing of data, and for said difference image, means connected with said supervisory computer for producing a difference image in operator usable form, said method comprising the steps of: initially, obtaining a preliminary coarse positioning of the features on said images to obtain approximate correspondence of at least some major image features; identifying at least four corresponding image control point pairs related to features appearing on both images and measuring the relative positions of said points; calculating image warp values, for at least one of said images for determining the estimated location of plurality of match point pairs selected in geometric pattern, based on the control point pairs determined in the second step, assigning an image correlation value to an array of picture cells surrounding each of said geometrically selected match point pairs, determining by successive calculations based on comparison of a plurality of relative displacements of each array the location producing the best correlation value to determine the precise location of each of said match point pairs, using the precisely determined location of an initial group of match point pairs to determine the estimated location of additional match point pairs, repeating the fifth and sixth steps until the precise location of a predetermined number of match points is determined throughout the pair of images, warping one image to achieve registration with the other based on the location of the match point pairs, photoequalizing the gray scale information content of said images to achieve corresponding gray scale information content values for corresponding features of the images; and producing a difference image from the pair of images by subtracting one image from the other.
References Cited (Backward Citations)
US2989890A
Cited
US3212397A
Cited
US3283071A
Cited
US3432674A
Cited
US3564133A
Cited
US3535443A
Cited
US3582651A
Cited
US3597083A
Cited
US3627918A
Cited
US3636254A
Cited
US3748644A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1978-09-08 | 1979-03-10 | 1979-09-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1982-09-08 | 1983-03-10 | 1983-09-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1986-09-08 | 1987-03-10 | 1987-09-09 | $7700.00 | Window Closed / Lapsed |