US4737921A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Three dimensional medical image display system
Assignee: Philips Nuclear Medicine Inc
•
Filing: 1985-06-03
•
Granted: 1988-04-12
•
Expires: 2005-06-03
Abstract
Abstract A real-time three-dimensional display device particularly suited for medical imaging is disclosed. The device includes a plurality of individual processing elements each having an image memory for storing a mini-image of a portion of the object as viewed from any given direction and a merge control means for generating a combined image of the object including the depth thereof by selection on a pixel-by-pixel basis from each of the mini-images. In two different embodiments, priority codes are assigned to each of the processing elements reflecting the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements. In one embodiment, the combined image is generated in accordance with the priority codes. In another embodiment, a Z buffer is used to provide for hidden surface removal on a pixel-by-pixel basis. Improved shadow, shading and gradient processors are provided to provide three-dimensional imaging as well as an improved scan conversion means for generating a coherent image from the combined images merged from all of the processing elements.
Inventors
- 👤 Samuel M. Goldwasser
- 👤 David A. Talton
- 👤 R. Anthony Reynolds
- 👤 Theodore A. Bapty
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 11:42
CPC Classifications
G; G06; G06T; G06T17/00
Claims Analysis
Total Claims: 61
Claim 1
Independent Claim
235 words
A real-time three-dimensional display device comprising: (a) a plurality of individual processing elements each having: (i) an associated object memory for storing a first digital representation of a portion of a three-dimensional objet to be displayed; (ii) an image memory for storing a second digital representation of a mini-image of the visible surface of that portion of the object as viewed from a selected direction with respect to a predetermined plane including the relative depth of that surface at each pixel of the mini-image; (iii) means for selecting said direction including means for mapping said first digital representation into said second digital representation; and (b) means for generating priority codes based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given pixel in the combinedimage produced by all of said processing elements; and (c) merge control means responsive to said priority codes for generating the combined image of said object including, at each pixel, the depth of the visible surface of the object from said predetermined plane said combined image being generated on a pixel-by-pixel basis from said mini-images, each pixel of said combined image including only a selected pixel of said mini-images which is visible for a given orientation of said object, the pixel being selected in accordance with said priority codes.
Claim 2
Dependent Claim
235 words
A real-time three-dimensional display device comprising: (a) a plurality of individual processing elements each having: (i) an associated object memory for storing a first digital representation of a portion of a three-dimensional objet to be displayed; (ii) an image memory for storing a second digital representation of a mini-image of the visible surface of that portion of the object as viewed from a selected direction with respect to a predetermined plane including the relative depth of that surface at each pixel of the mini-image; (iii) means for selecting said direction including means for mapping said first digital representation into said second digital representation; and (b) means for generating priority codes based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given pixel in the combinedimage produced by all of said processing elements; and (c) merge control means responsive to said priority codes for generating the combined image of said object including, at each pixel, the depth of the visible surface of the object from said predetermined plane said combined image being generated on a pixel-by-pixel basis from said mini-images, each pixel of said combined image including only a selected pixel of said mini-images which is visible for a given orientation of said object, the pixel being selected in accordance with said priority codes.
Claim 3
Dependent Claim
22 words
The display device of claim 1 further comprising: (d) a video post-processing unit for generating an enhanced image from said combined image.
Claim 4
Dependent Claim
17 words
The display device of claim 2 further comprising: (e) a frame buffer for storing said enhanced image.
Claim 5
Dependent Claim
22 words
The display device of claim 3 further comprising: (f) a display means, responsive to said frame buffer, for displaying said enhanced image.
Claim 6
Dependent Claim
26 words
The display device of claim 2 wherein said video post-processing unit further comprises: a scan conversion means for generating a coherent image from said combined image.
Claim 7
Dependent Claim
51 words
The display device of claim 2 wherein said video post-processing unit further comprises: a shading processor means for varying the intensity of portions of said combined image with respect to other portions of said combined image depending upon the relative distance and orientation of such portions from a simulated light source.
Claim 8
Dependent Claim
31 words
The display device of claim 6 wherein said shading processor means controls the intensity of portions of said combined image relative to the intensity of other portions of said combined image.
Claim 9
Dependent Claim
30 words
The display device of claim 2 wherein said video post-processing unit further comprises: a shadow processor for adding shadow effects caused by a simulated light source to said combined image.
Claim 10
Dependent Claim
90 words
The display device of claim 2 wherein said video post processing unit further comprises: (i) a scan conversion means for generating a coherent image from said combined image; (ii) a shading processor means responsive to said scan conversion means for varying the intensity of portions of said coherent image with respect to the intensity of other portions of said coherent image; and (iii) a shadow processor responsive to said shading processor for adding shadow effects caused by a simulated light source to said coherent image to produce said enhanced image.
Claim 11
Dependent Claim
25 words
The display device of claim 9 further comprising: (e) a frame buffer responsive to said video post-processor unit for storing the enhanced image produced thereby.
Claim 12
Dependent Claim
25 words
The display device of claim 10 further comprising: (f) a display means responsive to said frame buffer for displaying the enhanced image of said object.
Claim 13
Dependent Claim
50 words
The display device of claim 1 wherein said means for generating a priority code further comprising: logic means for generating a low priority code for pixels in the mini-image of a given processing element whenever the object memory for that processing element contains no digital representations of said three-dimensional object.
Claim 14
Dependent Claim
29 words
The display device of claim 1 further comprising: means for controlling said mapping means whereby the mapping of said first to said second digital representation may be selectively controlled.
Claim 15
Dependent Claim
31 words
The display device of claim 13 wherein said means for controlling selectively permits the mapping of points from said first to said second digital representation having a predetermined set of densities.
Claim 16
Dependent Claim
36 words
The display device of claim 13 wherein said means for controlling selectively permits the mapping of points from said first to said second digital representation having a predetermined depth function with respect to said predetermined plane.
Claim 17
Dependent Claim
39 words
The display device of claim 13 wherein said first digital representation includes a time dimension and wherein said means for controlling selectively permits the mapping of points from said first to said second digital representation having selected time sequences.
Claim 18
Dependent Claim
131 words
A real-time three-dimensional display device comprising: (a) a plurality of individual processing elements each having an image memory for storing a mini-image generated by that processing element including the relative depth of each pixel of such mini-image; (b) means associated with said processing elements for generating said mini-images; and (c) a merge control means for generating a combined image from each of said mini-images by selection based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given for a given pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis said combined image including at each pixel the depth from a predetermined plane.
Claim 19
Dependent Claim
131 words
A real-time three-dimensional display device comprising: (a) a plurality of individual processing elements each having an image memory for storing a mini-image generated by that processing element including the relative depth of each pixel of such mini-image; (b) means associated with said processing elements for generating said mini-images; and (c) a merge control means for generating a combined image from each of said mini-images by selection based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given for a given pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis said combined image including at each pixel the depth from a predetermined plane.
Claim 20
Dependent Claim
22 words
The display device of claim 17 further comprising: (d) a video post-processing unit for generating an enhanced image from said combined image.
Claim 21
Dependent Claim
17 words
The display device of claim 18 further comprising: (e) a frame buffer for storing said enhanced image.
Claim 22
Dependent Claim
22 words
The display device of claim 19 further comprising: (f) a display means, responsive to said frame buffer, for displaying said enhanced image.
Claim 23
Dependent Claim
26 words
The display device of claim 18 wherein said video post-processing unit further comrpises: a scan conversion means for generating a coherent image from said combined image.
Claim 24
Dependent Claim
51 words
The display device of claim 18 wherein said video post-processing unit further comprises: a shading processor means for varying the intensity of portions of said combined image with respect to other portions of said combined image depending upon the relative distance and orientation of such portions from a simulated light source.
Claim 25
Dependent Claim
31 words
The display device of claim 22 wherein said shading processor means controls the intensity of portions of said combined image relative to the intensity of other portions of said combined image.
Claim 26
Dependent Claim
30 words
The display device of claim 18 wherein said video post-processing unit further comprises: a shadow processor for adding shadow effects caused by a simulated light source to said combined image.
Claim 27
Dependent Claim
90 words
The display device of claim 18 wherein said video post processing unit further comprises: (i) a scan conversion means for generating a coherent image from said combined image; (ii) a shading processor means responsive to said scan conversion means for varying the intensity of portions of said coherent image with respect to the intensity of other portions of said coherent image; and (iii) a shadow processor responsive to said shading processor for adding shadow effects caused by a simulated light source to said coherent image to produce said enhanced image.
Claim 28
Dependent Claim
25 words
The display device of claim 25 further comprising: (e) a frame buffer responsive to said video post-processos unit for storing the enhanced image produced thereby.
Claim 29
Dependent Claim
22 words
The display device of claim 26 further comprising: (f) a display means responsive to said frame buffer for displaying said enhanced image.
Claim 30
Dependent Claim
27 words
The display device of claim 17 further comprising: (d) means for controlling said mini-image generation means whereby the generation of each of said mini-images is selectively controlled.
Claim 31
Dependent Claim
23 words
The display device of claim 28 wherein said means for controlling selectively permits the generation of mini-images having a predetermined set of densities.
Claim 32
Dependent Claim
28 words
The display means of claim 28 wherein said means for controlling selectively permits the generation of mini-images having a predetermined depth function with respect to a predetermined plane.
Claim 33
Dependent Claim
22 words
The display device of claim 28 wherein said means for controlling selectively permits the generation of mini-images in a selected time sequence.
Claim 34
Dependent Claim
218 words
A real time, interactive, medical image display system for displaying data representing a three-dimensional anatomical object, said data having been collected by at least one medical image acquisition device comprising: (a) a host computer for receiving and storing said data; (b) an image display processor coupled to said host computer, said image display processor having: (i) a plurality of individual processing elements each having an image memory for storing a mini-image of the visible surface of a portion of said object as viewed from a selected direction with respect to a predetermined plane including the relative depth of that surface; (ii) means associated with said processing elements for selecting said direction and for generating said mini-images; and (iii) a merge control means for generating a combined image from each of said mini-images by selection based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis, each pixel of said combined image including the depth of the visible surface of the object from said predetermined plane; and (c) display means, coupled to said image display processor, for displaying said combined image.
Claim 35
Dependent Claim
218 words
A real time, interactive, medical image display system for displaying data representing a three-dimensional anatomical object, said data having been collected by at least one medical image acquisition device comprising: (a) a host computer for receiving and storing said data; (b) an image display processor coupled to said host computer, said image display processor having: (i) a plurality of individual processing elements each having an image memory for storing a mini-image of the visible surface of a portion of said object as viewed from a selected direction with respect to a predetermined plane including the relative depth of that surface; (ii) means associated with said processing elements for selecting said direction and for generating said mini-images; and (iii) a merge control means for generating a combined image from each of said mini-images by selection based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis, each pixel of said combined image including the depth of the visible surface of the object from said predetermined plane; and (c) display means, coupled to said image display processor, for displaying said combined image.
Claim 36
Dependent Claim
42 words
The system of claim 32 wherein said image display processor further comprises: (iv) an object access unit coupled between said host computer and each of said individual processing elements for assigning subsets of said data to selected ones of said processing elements.
Claim 37
Dependent Claim
57 words
The system of claim 32 wherein said image display processor further comprises: (iv) a coordinate transform means, coupled to said host computer, for generating mapping signals to each of said individual processing elements, said mapping signals varying the min-image produced by each of said processing elements depending upon the direction selected with respect to said predetermined plane.
Claim 38
Dependent Claim
64 words
The system of claim 32 wherein each such individual processing element of said image display processor further comprises: (iv) a coordinate transform means, coupled to said host computer, for generating mapping signals to such processing element, said mapping signals varying the mini-image produced by that processing element depending upon the portion of the object or objects whose mini-image is computed by that processing element.
Claim 39
Dependent Claim
34 words
The system of claim 32 wherein said image display processor further comprises: (iv) control means coupled to said host computer and to said individual processing elements for selectively controlling the generation of said mini-images.
Claim 40
Dependent Claim
27 words
The system of claim 32 wherein said image display processor further comprises: (iv) a video post processing unit for generating an enhanced image from said combined image.
Claim 41
Dependent Claim
26 words
The system of claim 37 wherein said video post processing unit further comprises: a scan conversion means for generating a coherent image from said combined image.
Claim 42
Dependent Claim
55 words
The system of claim 37 wherein said video post processing unit further comprises: a shading processor for varying the intensity of portions of said combined image with respect to the intensity of other portions of said combined image depending upon the relative distance and orientation of such portions with respect to a simulated light source.
Claim 43
Dependent Claim
24 words
The system of claim 37 wherein said video post processing unit further comprises: a shadow processor for adding shadow effects to said combined image.
Claim 44
Dependent Claim
63 words
The system of claim 32 wherein each of said individual processing elements of said image display processor further comprises: an object memory for storing a first digital representation of portions of said objects; an image memory for storing a second digital representation of the mini-image of that portion of said object; and a means for mapping said first to said second digital representations.
Claim 45
Dependent Claim
41 words
The system of claim 41 wherein each of said individual processing elements of said image display processor further comprises: means coupled between said object memory and said image memory for controlling the mapping of said first to said second digital representation.
Claim 46
Dependent Claim
38 words
The system of claim 42 wherein said first digital representation includes a time dimension and wherein said means for controlling selectively permits the mapping of points from said first to said second digital representation having selected time sequences.
Claim 47
Dependent Claim
32 words
The system of claim 42 wherein said means for controlling the mapping means permits the mapping of points from said first to said second digital representation having a predetermined set of densities.
Claim 48
Dependent Claim
37 words
The system of claim 42 wherein said means for controlling the mapping means permits the mapping of points from said first to said second digital representation having a predetermined depth function with respect to a predetermined plane.
Claim 49
Dependent Claim
77 words
The system of claim 41 wherein said first and said second digital representations each include a density dimension and wherein each such individual processing element further includes: a volume feature counter for accumulating the number of points stored in the mini-image of that processing element having a non-zero density dimension, said host computer being responsive to the volume feature counters of each of said processing elements whereby the volume of said anatomical object may be automatically computed.
Claim 50
Dependent Claim
118 words
Am image display device comprising: (a) a plurality of individual processing elements, each for computing a mini-image of a portion of an object and each having an image memory for storing that mini-image including the relative depth thereof; and (b) a merge control means for generating a combined image from each of said mini-images by selection based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a give pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis said combined image including the depth at each pixel from a predetermined plane.
Claim 51
Dependent Claim
118 words
Am image display device comprising: (a) a plurality of individual processing elements, each for computing a mini-image of a portion of an object and each having an image memory for storing that mini-image including the relative depth thereof; and (b) a merge control means for generating a combined image from each of said mini-images by selection based upon the relative significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a give pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis said combined image including the depth at each pixel from a predetermined plane.
Claim 52
Dependent Claim
195 words
A real-time three-dimensional image display device comprising: (a) a plurality of individual processing elements, each for producing a mini-image of a portion of a three-dimensional object; (b) merge control means for generating a combined image of said object on a pixel-by-pixel basis from each of said mini-images, each pixel of said combined image having a density value and a depth value relative to a predetermined plane, said combined image as generated by said merge control means having insufficient data to yield a coherent image at certain orientations of said object as said combined image is projected on a display means; and (c) scan conversion means responsive to said combined image for generating a coherent image despite said insufficient data said scan conversion means having: (i) a serpentine buffer for delaying each given pixel of said combined image; and (ii) a template memory, said serpentine buffer being responsive thereto, for storing neighboring pixels of said delayed pixel, the density value of said given pixel being substituted by the density value of a neighboring pixel whenever said neighboring pixel has a non-zero density value and a relative depth less than the relative depth of said given pixel.
Claim 53
Dependent Claim
195 words
A real-time three-dimensional image display device comprising: (a) a plurality of individual processing elements, each for producing a mini-image of a portion of a three-dimensional object; (b) merge control means for generating a combined image of said object on a pixel-by-pixel basis from each of said mini-images, each pixel of said combined image having a density value and a depth value relative to a predetermined plane, said combined image as generated by said merge control means having insufficient data to yield a coherent image at certain orientations of said object as said combined image is projected on a display means; and (c) scan conversion means responsive to said combined image for generating a coherent image despite said insufficient data said scan conversion means having: (i) a serpentine buffer for delaying each given pixel of said combined image; and (ii) a template memory, said serpentine buffer being responsive thereto, for storing neighboring pixels of said delayed pixel, the density value of said given pixel being substituted by the density value of a neighboring pixel whenever said neighboring pixel has a non-zero density value and a relative depth less than the relative depth of said given pixel.
Claim 54
Dependent Claim
22 words
The image display device of claim 48 wherein said template memory stores the density value and depth value of eight neighboring pixels.
Claim 55
Dependent Claim
168 words
A real-time, three-dimensional image display device comprising: (a) a means for producing an image on a pixel-by-pixel basis, each pixel of said image having a density value and a depth value relative to a predetermined plane; (b) a shading processor responsive to said image for adding shading effects to said iamge, said shading processor having: (i) a gradient shading processor responsive to said depth values, for computing the surface normal of each pixel of said image on a pixel-by-pixel basis; and at least one of (ii) a density shading processor responsive to said density values; and (iii) a depth shading processor responsive to said depth values; and wherein said shading processor further includes a means responsive to outputs of said gradient shading processor and at least one of said density, and depth shading processors for generating a final image on a pixel-by-pixel basis, the intensity of said final image being varied in accordane with the depth value, or the density value and the surfae normal for each pixel.
Claim 56
Dependent Claim
168 words
A real-time, three-dimensional image display device comprising: (a) a means for producing an image on a pixel-by-pixel basis, each pixel of said image having a density value and a depth value relative to a predetermined plane; (b) a shading processor responsive to said image for adding shading effects to said iamge, said shading processor having: (i) a gradient shading processor responsive to said depth values, for computing the surface normal of each pixel of said image on a pixel-by-pixel basis; and at least one of (ii) a density shading processor responsive to said density values; and (iii) a depth shading processor responsive to said depth values; and wherein said shading processor further includes a means responsive to outputs of said gradient shading processor and at least one of said density, and depth shading processors for generating a final image on a pixel-by-pixel basis, the intensity of said final image being varied in accordane with the depth value, or the density value and the surfae normal for each pixel.
Claim 57
Dependent Claim
160 words
A real-time, interactive display system comprising: (a) a host computer; (b) an image display processor coupled to said host computer, said image display processor having: (i) a plurality of individual processing elements each having an image memory for storing a mini-image generated by that processing element including the relative depth; (ii) means associated with each of said processing elements, for generating said mini-images; and (iii) merge control means for generating a combined iamge from each of said mini-images by selection based upon the reltive significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis each pixel of said combined image including the depth at that pixel from a predetermined plane; and (c) display means, coupled to said image display processor, for displaying said combined image.
Claim 58
Dependent Claim
160 words
A real-time, interactive display system comprising: (a) a host computer; (b) an image display processor coupled to said host computer, said image display processor having: (i) a plurality of individual processing elements each having an image memory for storing a mini-image generated by that processing element including the relative depth; (ii) means associated with each of said processing elements, for generating said mini-images; and (iii) merge control means for generating a combined iamge from each of said mini-images by selection based upon the reltive significance of a given pixel of the mini-image produced by a given processing element as compared to the pixels of mini-images produced by other processing elements for a given pixel in the combined image produced by all of said processing elements on a pixel-by-pixel basis each pixel of said combined image including the depth at that pixel from a predetermined plane; and (c) display means, coupled to said image display processor, for displaying said combined image.
Claim 59
Dependent Claim
36 words
The system of claim 51 wherein said image display processor further comprises: an access unit coupled between said host computer and each of said individual processing elements for controlling the mini-images generated by each processing element.
Claim 60
Independent Claim
22 words
The system of either of claims 32 or 51 wherein said merge control means generates said combined image in raster scan order.
Claim 61
Dependent Claim
19 words
The display device of claim 17 wherein said merge control means generates said combined image in raster scan order.
References Cited (Backward Citations)
US3441789A
Cited
US4130083A
Cited
US4160973A
Cited
US4209832A
Cited
US4360831A
Cited
US4384338A
Cited
US4439760A
Cited
US4509043A
Cited
US4436684B1
Cited
US4436684A
Cited
US4570233A
Cited
US4475104A
Cited
US4627087A
Cited
US4586038A
Cited
US4641351A
Cited
US4625289A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1991-04-12 | 1991-10-12 | 1992-04-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1995-04-12 | 1995-10-12 | 1996-04-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 1999-04-12 | 1999-10-12 | 2000-04-12 | $7700.00 | Window Closed / Lapsed |