← Back to Patent Explorer
US5946425A Expired / Lapsed US ⏱️ 0.0 years remaining

Method and apparatus for automatic alingment of volumetric images containing common subject matter

Assignee: Massachusetts Institute of Technology
•
Filing: 1996-06-03
•
Granted: 1999-08-31
•
Expires: 2016-06-03
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Different tomographic images of the same subject matter are optimally related to one another through a two-step procedure whereby, first, movements are plotted on a subregion level, producing a vector map relating subregions in a first set of scan frames to subregions in another set of scan frames; and then, based on the aggregate of subregion movements, the invention characterizes the "global" displacement relating the volume represented by the first set of scan frames to that represented by the second set. More specifically, the invention generates translation and rotation vectors that describe the movements underlying shifts in subject matter from one scan to the other, and which can be applied to one frame set to align it with the other.

Inventors

  • 👤 V. Michael Bove, Jr.
  • 👤 Tamas Sandor

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 21:57
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/30; G06T7/38; G06T7/32; G06T2200/00; G06T2200/04; G06T2207/00; G06T2207/10; G06T2207/10072; G06T2207/20; G06T2207/20016; G06T2207/20021

Claims Analysis

Total Claims: 22
Claim 1
Independent Claim 197 words
A method of aligning sets of image frames, (i) each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, (ii) each image frame comprising a series of image points encoded electronically as a grid of pixels, and (iii) the sets including redundant volumetric subject matter, the method comprising the steps of a. automatically identifying common volumetric subject matter on a subregion level by systematically comparing pixels representing a subregion of a selected frame of a first frame set to pixels representing subregions of a plurality of frames of the second frame set in order to identify correspondences between subregions of the first frame set and subregions of the second frame set; b. defining a field of three-dimensional translation vectors mapping each of a plurality of the first-set subregions to corresponding second-set subregions with the smallest mapping error; c. deriving, from the translation vectors, a set of global vectors specifying translation and rotation between the common volumetric subject matter; and d. based on the global vectors, translating and rotating the first frame set such that the common volumetric subject matter encoded by the frame sets is aligned.
Claim 2
Independent Claim 197 words
A method of aligning sets of image frames, (i) each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, (ii) each image frame comprising a series of image points encoded electronically as a grid of pixels, and (iii) the sets including redundant volumetric subject matter, the method comprising the steps of a. automatically identifying common volumetric subject matter on a subregion level by systematically comparing pixels representing a subregion of a selected frame of a first frame set to pixels representing subregions of a plurality of frames of the second frame set in order to identify correspondences between subregions of the first frame set and subregions of the second frame set; b. defining a field of three-dimensional translation vectors mapping each of a plurality of the first-set subregions to corresponding second-set subregions with the smallest mapping error; c. deriving, from the translation vectors, a set of global vectors specifying translation and rotation between the common volumetric subject matter; and d. based on the global vectors, translating and rotating the first frame set such that the common volumetric subject matter encoded by the frame sets is aligned.
Claim 3
Dependent Claim 81 words
The method of claim 1 wherein the global vectors are derived according to steps comprising: a. utilizing the translation vectors to generate a single rotation vector maximally consistent with the mapping vectors and relating the first volume to the second volume; b. utilizing the mapping vectors to generate a single translation vector maximally consistent with the mapping vectors and relating the first volume to the second volume, the rotation and translation vectors encoding spatial displacement between the first and second volumes.
Claim 4
Dependent Claim 21 words
The method of claim 2 wherein the single rotation vector and the single translation vector are generated by a least-squares fit.
Claim 5
Dependent Claim 30 words
The method of claim 1 further comprising the step of preprocessing each set of frames to reduce high-frequency noise and to select for anatomical features of a predetermined size range.
Claim 6
Dependent Claim 17 words
The method of claim 4 wherein the preprocessing step comprises filtering with the Laplacian of a Gaussian.
Claim 7
Independent Claim 290 words
A method of aligning sets of image frames, (i) each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, (ii) each image frame being represented as a pixelmap image datafile comprising a grid of pixels, and (iii) the sets including common volumetric subject matter, the method comprising the steps of: a. defining, in a first frame of a first set, a search block comprising a plural number of pixels; b. defining, at identical locations in each of a plurality of frames of a second set, a target window comprising a plural number of pixels at least as large as the number of pixels in the search block; c. searching for common volumetric subject matter by comparing the pixels of the search block with the pixels of each of the target windows and deriving an error factor representative of image differences therebetween; d. identifying common volumetric subject matter by selecting the target-window pixels associated with the smallest error factor; e. defining a three-dimensional translation vector mapping the search block to the selected target-window pixels; f. defining, in the first frame of the first set, a new search block comprising a group of pixels offset with respect to the previous search block; g. repeating steps (b) through (e); h. completing the search for common volumetric subject matter by repeating steps (f) and (g) until all of the pixels of the first frame of the first set have been defined in a search block; i. deriving, from the translation vectors, a set of global vectors specifying translation and rotation between the common volumetric subject matter; and j. based on the global vectors, aligning the first frame set with the second frame set.
Claim 8
Independent Claim 290 words
A method of aligning sets of image frames, (i) each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, (ii) each image frame being represented as a pixelmap image datafile comprising a grid of pixels, and (iii) the sets including common volumetric subject matter, the method comprising the steps of: a. defining, in a first frame of a first set, a search block comprising a plural number of pixels; b. defining, at identical locations in each of a plurality of frames of a second set, a target window comprising a plural number of pixels at least as large as the number of pixels in the search block; c. searching for common volumetric subject matter by comparing the pixels of the search block with the pixels of each of the target windows and deriving an error factor representative of image differences therebetween; d. identifying common volumetric subject matter by selecting the target-window pixels associated with the smallest error factor; e. defining a three-dimensional translation vector mapping the search block to the selected target-window pixels; f. defining, in the first frame of the first set, a new search block comprising a group of pixels offset with respect to the previous search block; g. repeating steps (b) through (e); h. completing the search for common volumetric subject matter by repeating steps (f) and (g) until all of the pixels of the first frame of the first set have been defined in a search block; i. deriving, from the translation vectors, a set of global vectors specifying translation and rotation between the common volumetric subject matter; and j. based on the global vectors, aligning the first frame set with the second frame set.
Claim 9
Dependent Claim 27 words
The method of claim 6 wherein the subject matter comprises features each having a size, the target window being larger than the size of the smallest feature.
Claim 10
Dependent Claim 20 words
The method of claim 6 wherein the search block has 256 pixels and the target windows each have 2304 pixels.
Claim 11
Dependent Claim 81 words
The method of claim 6 wherein the global vectors are derived according to steps comprising: a. utilizing the translation vectors to generate a single rotation vector maximally consistent with the mapping vectors and relating the first volume to the second volume; b. utilizing the mapping vectors to generate a single translation vector maximally consistent with the mapping vectors and relating the first volume to the second volume, the rotation and translation vectors encoding spatial displacement between the first and second volumes.
Claim 12
Dependent Claim 30 words
The method of claim 6 further comprising the step of preprocessing each set of frames to reduce high-frequency noise and to select for anatomical features of a predetermined size range.
Claim 13
Dependent Claim 17 words
The method of claim 10 wherein the preprocessing step comprises filtering with the Laplacian of a Gaussian.
Claim 14
Dependent Claim 25 words
The method of claim 6 wherein the new search window is offset with respect to the previous search window so as to be adjacent thereto.
Claim 15
Dependent Claim 199 words
Apparatus for aligning first and second sets of digitized image frames, each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, the sets including common volumetric subject matter, said apparatus comprising: a. a first set of memory buffers for storing the first set of digitized frames; b. a second set of memory buffers for storing the second set of digitized frames; c. analysis means configured to: i. identify common volumetric subject matter by systematically comparing groups of pixels from a selected frame of the first frame set to groups of pixels of a plurality of frames of the second frame set; ii. define a field of three-directional translation vectors mapping each of a plurality of pixel groups of the first frame set to corresponding pixel groups of the second frame set with the smallest mapping error; iii. derive, from the translation vectors, a set of global vectors specifying translation and rotation between the volumes; and iv. align, based on the global vectors, the pixels of the first frame set with the pixels of the second frame set such that the volumes encoded by the frame sets are aligned.
Claim 16
Dependent Claim 199 words
Apparatus for aligning first and second sets of digitized image frames, each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, the sets including common volumetric subject matter, said apparatus comprising: a. a first set of memory buffers for storing the first set of digitized frames; b. a second set of memory buffers for storing the second set of digitized frames; c. analysis means configured to: i. identify common volumetric subject matter by systematically comparing groups of pixels from a selected frame of the first frame set to groups of pixels of a plurality of frames of the second frame set; ii. define a field of three-directional translation vectors mapping each of a plurality of pixel groups of the first frame set to corresponding pixel groups of the second frame set with the smallest mapping error; iii. derive, from the translation vectors, a set of global vectors specifying translation and rotation between the volumes; and iv. align, based on the global vectors, the pixels of the first frame set with the pixels of the second frame set such that the volumes encoded by the frame sets are aligned.
Claim 17
Dependent Claim 33 words
The apparatus of claim 13 wherein the analysis means is further configured to preprocess each set of frames to reduce high-frequency noise and to select for anatomical features of a predetermined size range.
Claim 18
Dependent Claim 325 words
Apparatus for aligning first and second sets of digitized image frames, each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, the sets including common volumetric subject matter, said apparatus comprising: a. a computer memory comprising a first set of memory buffers for storing the first set of digitized frames and a second set of memory buffers for storing the second set of digitized frames; b. analysis means configured to: i. define, in a first memory buffer of the first set, a search block comprising a plural number of pixels; ii. define, at identical locations in each of a plurality of memory buffers of the second set, a target window comprising a plural number of pixels at least as large as the number of pixels in the search block; iii. search for common volumetric subject matter by comparing the pixels of the search block with the pixels of each of the target windows; iv. derive an error factor representative of image differences therebetween; v. identify common volumetric subject matter by selecting the target-window pixels associated with the smallest error factor; vi. define and store, in the computer memory, a three-dimensional translation vector mapping the search block to the selected target-window pixels; vii. define, in the first frame of the first set, a new search block comprising a group of pixels offset with respect to the previous search block; viii. repeat (ii) through (vi); ix. complete the search for common volumetric subject matter by repeating (vii) and (viii) until all of the pixels of the first frame of the first set have been defined in a search block; xii. derive, from the translation vectors, a set of global vectors specifying translation and rotation between the common volumetric subject matter and store the global vectors in the computer memory; and xiii. based on the global vectors, align the first frame set with the second frame set.
Claim 19
Dependent Claim 325 words
Apparatus for aligning first and second sets of digitized image frames, each set being representative of a volume and comprising a series of frames digitally encoding contiguous planar slices of the volume, the sets including common volumetric subject matter, said apparatus comprising: a. a computer memory comprising a first set of memory buffers for storing the first set of digitized frames and a second set of memory buffers for storing the second set of digitized frames; b. analysis means configured to: i. define, in a first memory buffer of the first set, a search block comprising a plural number of pixels; ii. define, at identical locations in each of a plurality of memory buffers of the second set, a target window comprising a plural number of pixels at least as large as the number of pixels in the search block; iii. search for common volumetric subject matter by comparing the pixels of the search block with the pixels of each of the target windows; iv. derive an error factor representative of image differences therebetween; v. identify common volumetric subject matter by selecting the target-window pixels associated with the smallest error factor; vi. define and store, in the computer memory, a three-dimensional translation vector mapping the search block to the selected target-window pixels; vii. define, in the first frame of the first set, a new search block comprising a group of pixels offset with respect to the previous search block; viii. repeat (ii) through (vi); ix. complete the search for common volumetric subject matter by repeating (vii) and (viii) until all of the pixels of the first frame of the first set have been defined in a search block; xii. derive, from the translation vectors, a set of global vectors specifying translation and rotation between the common volumetric subject matter and store the global vectors in the computer memory; and xiii. based on the global vectors, align the first frame set with the second frame set.
Claim 20
Dependent Claim 27 words
The apparatus of claim 15 wherein the subject matter comprises features each having a size, the target window being larger than the size of the smallest feature.
Claim 21
Dependent Claim 20 words
The apparatus of claim 15 wherein the search block has 256 pixels and the target windows each have 2304 pixels.
Claim 22
Dependent Claim 22 words
The method of claim 6 wherein the new search window is offset with respect to the previous search window to overlap therewith.

References Cited (Backward Citations)

US4710876A Cited
US4719585A Cited
US5170347A Cited
US4977505A Cited
US5568384A Cited
US5359513A Cited
US5633951A Cited
US5576767A Cited
US5531520A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2002-08-30 2003-03-01 2003-08-31 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2006-08-30 2007-03-01 2007-08-31 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2010-08-30 2011-03-01 2011-08-31 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag