Patent US6351573B1 successfully refreshed from Google Patents.
US6351573B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Imaging device and method
Assignee: Schneider Medical Tech Inc
•
Filing: 1996-10-07
•
Granted: 2002-02-26
•
Expires: 2016-10-07
Abstract
Abstract A method and apparatus for obtaining and displaying in real time an image of an object obtained by one modality such that the image corresponds to a line of view established by another modality. In a preferred embodiment, the method comprises the following steps: obtaining a follow image library of the object via a first imaging modality; providing a lead image library obtained via the second imaging modality; referencing the lead image library to the follow image library; obtaining a lead image of the object in real time via the second imaging modality along a lead-view; comparing the real time lead image to lead images in the lead image library via digital image analysis to identify a follow image line of view corresponding to the real time lead view; transforming the identified follow image to correspond to the scale, rotation and position of the lead image; and displaying the transformed follow image, the comparing, transforming and displaying steps being performed substantially simultaneously with the step of obtaining the lead image in real time.
Inventors
- 👤 M. Bret Schneider
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 19:38
CPC Classifications
G; G16; G16H; G16H30/00; G16H30/20; G16H20/00; G16H20/40; A; A61; A61B; A61B90/00; A61B90/36; A61B90/37; A61B2090/374; A61B2090/378; A61B90/10
Claims Analysis
Total Claims: 33
Claim 1
Independent Claim
145 words
A method for obtaining and displaying an image of an object being examined, the method comprising the following steps: obtaining a follow image library of the interior of the object being examined via a three dimensional imaging modality; obtaining a real time lead image of the object via a two dimensional imaging modality along an external lead view of a user's line of sight; referencing the real time lead image to the follow image library via digital image analysis to identify a follow image line of view corresponding to the user's line of sight; transforming a follow image from the follow image library to correspond to the real time lead image; and displaying the transformed follow image in the user's line of sight, the referencing, transforming and displaying steps being performed substantially in real time after the step of obtaining the real time lead image.
Claim 2
Independent Claim
145 words
A method for obtaining and displaying an image of an object being examined, the method comprising the following steps: obtaining a follow image library of the interior of the object being examined via a three dimensional imaging modality; obtaining a real time lead image of the object via a two dimensional imaging modality along an external lead view of a user's line of sight; referencing the real time lead image to the follow image library via digital image analysis to identify a follow image line of view corresponding to the user's line of sight; transforming a follow image from the follow image library to correspond to the real time lead image; and displaying the transformed follow image in the user's line of sight, the referencing, transforming and displaying steps being performed substantially in real time after the step of obtaining the real time lead image.
Claim 3
Dependent Claim
21 words
The method of claim 1 further comprising slicing the transformed follow image to a selected depth prior to the displaying step.
Claim 4
Dependent Claim
27 words
The method of claim 1 wherein the referencing step comprises segmenting the real time lead image and the follow image into first and second sets of subobjects.
Claim 5
Dependent Claim
14 words
The method of claim 3 wherein the identifying step further comprises classifying the subobjects.
Claim 6
Dependent Claim
13 words
The method of claim 1 wherein all steps are performed in real time.
Claim 7
Dependent Claim
14 words
The method of claim 1 wherein the displaying step comprises using a stereoscopic display.
Claim 8
Independent Claim
146 words
A method for obtaining and displaying an image of an object being examined having an exterior surface and an interior, the method comprising the following steps: obtaining a real time two dimensional lead image of the exterior surface of the object being examined substantially along a user's line of sight to the exterior surface; referencing the lead image to a three dimensional follow image library to identify a follow image line of view corresponding to the line of sight, the follow image library including at least one follow image of the interior of the object; transforming a follow image from the follow image library to correspond to the real time lead image; and displaying the transformed follow image in the user's line of sight, the referencing, transforming and displaying steps being performed substantially in real time after the step of obtaining the real time lead image.
Claim 9
Independent Claim
146 words
A method for obtaining and displaying an image of an object being examined having an exterior surface and an interior, the method comprising the following steps: obtaining a real time two dimensional lead image of the exterior surface of the object being examined substantially along a user's line of sight to the exterior surface; referencing the lead image to a three dimensional follow image library to identify a follow image line of view corresponding to the line of sight, the follow image library including at least one follow image of the interior of the object; transforming a follow image from the follow image library to correspond to the real time lead image; and displaying the transformed follow image in the user's line of sight, the referencing, transforming and displaying steps being performed substantially in real time after the step of obtaining the real time lead image.
Claim 10
Dependent Claim
30 words
The method of claim 7 wherein the displaying step comprises forming a composite image from the real time lead image and the transformed follow image and displaying the composite image.
Claim 11
Dependent Claim
24 words
The method of claim 7 wherein the displaying step comprises displaying the transformed follow image on a see-through display mounted on the user's head.
Claim 12
Dependent Claim
34 words
The method of claim 7 further comprising, prior to the step of obtaining the real time lead image: providing a lead image library, and correlating the lead image library to the follow image library.
Claim 13
Dependent Claim
43 words
The method of claim 10 wherein the step of referencing the real time lead image to the follow image library comprises the use of digital image analysis to correlate the real time lead image with a lead image in the lead image library.
Claim 14
Dependent Claim
26 words
The method of claim 10 wherein the step of correlating the lead image library to the follow image library comprises the use of digital image analysis.
Claim 15
Dependent Claim
21 words
The method of claim 7 further comprising slicing the transformed follow image to a selected depth prior to the displaying step.
Claim 16
Dependent Claim
18 words
The method of claim 7 further comprising tracking an instrument and displaying the instrument and the object together.
Claim 17
Dependent Claim
32 words
The method of claim 7 further comprising obtaining a follow image library comprising pre-sliced follow images, the referencing and transforming steps comprising selecting a follow image slice from the follow image library.
Claim 18
Dependent Claim
15 words
The method of claim 7 further comprising obtaining the follow image library in real time.
Claim 19
Dependent Claim
97 words
An imaging apparatus comprising: a three dimensional follow image library; a two dimensional lead imager for obtaining lead images along a user's line of sight; a display for displaying images in the user's line of sight; and processing means for interreferencing in real time lead images from the lead imager of an exterior surface of an object being examined along the user's line of sight with a follow image from the follow image library of an interior of the object being examined and for displaying the follow image on the display in the user's line of sight.
Claim 20
Dependent Claim
97 words
An imaging apparatus comprising: a three dimensional follow image library; a two dimensional lead imager for obtaining lead images along a user's line of sight; a display for displaying images in the user's line of sight; and processing means for interreferencing in real time lead images from the lead imager of an exterior surface of an object being examined along the user's line of sight with a follow image from the follow image library of an interior of the object being examined and for displaying the follow image on the display in the user's line of sight.
Claim 21
Dependent Claim
21 words
The apparatus of claim 17 further comprising depth control for selecting a depth at which a follow image should be sliced.
Claim 22
Dependent Claim
36 words
The apparatus of claim 17 further comprising a lead image library, the processing means further comprising means for interreferencing in real time images from the lead imager with a lead image from the lead image library.
Claim 23
Dependent Claim
12 words
The apparatus of claim 17 wherein the display comprises a see-through display.
Claim 24
Dependent Claim
13 words
The apparatus of claim 17 wherein the lead imager comprises a video camera.
Claim 25
Dependent Claim
14 words
The apparatus of claim 21 wherein the video camera comprises a head-mounted video camera.
Claim 26
Dependent Claim
12 words
The apparatus of claim 17 wherein the display is a stereoscopic display.
Claim 27
Dependent Claim
32 words
The apparatus of claim 17 further comprising a follow imager, the processing means further comprising means for obtaining follow images from the follow imager for the follow image library in real time.
Claim 28
Independent Claim
146 words
A method for obtaining and displaying an image of a first object being examined having an exterior surface and an interior, the method comprising the steps of: obtaining a follow image of the first object being examined via a three dimensional imaging modality; obtaining a real time lead image of the exterior surface of the first object via a two dimensional imaging modality substantially along a user's line of sight to the exterior surface; referencing the lead image to the follow image to identify a follow image line of view according to the user's line of sight; transforming the follow image to correspond to the scale, rotation or position indicated by the lead image; and displaying the transformed follow image in the user's line of sight, the referencing, transforming, and displaying steps being performed substantially in real time after the step of obtaining the lead image.
Claim 29
Independent Claim
146 words
A method for obtaining and displaying an image of a first object being examined having an exterior surface and an interior, the method comprising the steps of: obtaining a follow image of the first object being examined via a three dimensional imaging modality; obtaining a real time lead image of the exterior surface of the first object via a two dimensional imaging modality substantially along a user's line of sight to the exterior surface; referencing the lead image to the follow image to identify a follow image line of view according to the user's line of sight; transforming the follow image to correspond to the scale, rotation or position indicated by the lead image; and displaying the transformed follow image in the user's line of sight, the referencing, transforming, and displaying steps being performed substantially in real time after the step of obtaining the lead image.
Claim 30
Independent Claim
206 words
A method for obtaining and displaying an image of a first and second object, the first object being examined and the second object being partially within the interior of the first object, the method comprising the steps of: obtaining a follow image of the first object being examined via a three dimensional imaging modality; obtaining a real time lead image of the exterior surface of the first and second objects via a two dimensional imaging modality substantially along a user's line of sight to the exterior surfaces; referencing the lead image to the follow image of the first object to identify a follow image line of view according to the user's line of sight; transforming the follow image of the first object to correspond to the scale, rotation or position indicated by the lead image; modifying the follow image of the first object to include a representation of the second object that is partially within the interior of the first object according to the scale, rotation or position of the second object in the lead image; and displaying the follow image in the user's line of sight, the referencing, transforming, and modifying being performed substantially in real time after the step of obtaining the lead image.
Claim 31
Independent Claim
206 words
A method for obtaining and displaying an image of a first and second object, the first object being examined and the second object being partially within the interior of the first object, the method comprising the steps of: obtaining a follow image of the first object being examined via a three dimensional imaging modality; obtaining a real time lead image of the exterior surface of the first and second objects via a two dimensional imaging modality substantially along a user's line of sight to the exterior surfaces; referencing the lead image to the follow image of the first object to identify a follow image line of view according to the user's line of sight; transforming the follow image of the first object to correspond to the scale, rotation or position indicated by the lead image; modifying the follow image of the first object to include a representation of the second object that is partially within the interior of the first object according to the scale, rotation or position of the second object in the lead image; and displaying the follow image in the user's line of sight, the referencing, transforming, and modifying being performed substantially in real time after the step of obtaining the lead image.
Claim 32
Independent Claim
172 words
A method for obtaining and displaying an image of a first and second object, the first object being examined and the second object being partially within the interior of the first object, the method comprising the steps of: obtaining a follow image of the first object being examined via a three dimensional imaging modality; obtaining an image of the second object via a two dimensional imaging modality from a user's point of view; transforming the follow image of the first object to the scale, rotation or position of the first object from the user's point of view; modifying the follow image of the first object to include a representation of the second object that is partially within the interior of the first object according to the scale, rotation or position of the second object from the user's point of view; and displaying the follow image in the user's point of view, the transforming and modifying being performed substantially in real time after the step of obtaining the image of the second object.
Claim 33
Independent Claim
172 words
A method for obtaining and displaying an image of a first and second object, the first object being examined and the second object being partially within the interior of the first object, the method comprising the steps of: obtaining a follow image of the first object being examined via a three dimensional imaging modality; obtaining an image of the second object via a two dimensional imaging modality from a user's point of view; transforming the follow image of the first object to the scale, rotation or position of the first object from the user's point of view; modifying the follow image of the first object to include a representation of the second object that is partially within the interior of the first object according to the scale, rotation or position of the second object from the user's point of view; and displaying the follow image in the user's point of view, the transforming and modifying being performed substantially in real time after the step of obtaining the image of the second object.
References Cited (Backward Citations)
US4341220A
Cited
US4791934A
Cited
US5099846A
Cited
US5291889A
Cited
US5261404A
Cited
US5283837A
Cited
US5337231A
Cited
US5361307A
Cited
US5406479A
Cited
US5531520A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-02-25 | 2005-08-27 | 2006-02-26 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-02-25 | 2009-08-27 | 2010-02-26 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-02-25 | 2013-08-27 | 2014-02-26 | $7700.00 | Window Closed / Lapsed |