← Back to Patent Explorer
US6165181A Expired / Lapsed US ⏱️ 0.0 years remaining

Apparatus and method for photogrammetric surgical localization

Assignee: Sofamor Danek Holdings Inc
•
Filing: 1998-10-15
•
Granted: 2000-12-26
•
Expires: 2018-10-15
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method and apparatus for defining the location of a medical instrument relative to features of a medical workspace including a patient's body region are described. Pairs of two-dimensional images are obtained, preferably by means of two video cameras making images of the workspace along different sightlines which intersect. A fiducial structure is positioned in the workspace for defining a three dimensional coordinate framework, and a calibration image pair is made. The calibration image pair comprises two 2D projections from different locations of the fiducial structure. After the calibration image pair is made, the fiducial structure is removed. A standard projection algorithm is used to reconstruct the 3D framework of the fiducial structure from the calibration image pair. Appropriate image pairs can then be used to locate and track any other feature such as a medical instrument, in the workspace, so long as the cameras remain fixed in their positions relative to the workspace. The computations are desirably performed with a computer workstation including computer graphics capability, image processing capability, and providing a real-time display of the workspace as imaged by the video cameras. Also, the 3D framework of the workspace can be aligned with the 3D framework of any selected volume scan, such as MRI, CT, or PET, so that the instrument can be localized and guided to a chosen feature. No guidance arc or other apparatus need be affixed to the patient to accomplish the tracking and guiding operations.

Inventors

  • 👤 Mark Peter Heilbrun
  • 👤 Paul McDonald
  • 👤 J. Clayton Wiker
  • 👤 Spencer Koehler
  • 👤 William Peters

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 23:15
CPC Classifications
A; A61; A61B; A61B5/00; A61B5/06; A61B34/00; A61B34/20; A61B5/061; A61B5/064; A61B6/00; A61B6/12; A61B90/00; A61B90/10; A61B90/90; A61B90/92; G; G06; G06T; G06T7/00; G06T7/30; G06T7/33; H; H04; H04N; H04N13/00; H04N13/20; H04N13/204; H04N13/239; H04N13/246; A61B17/00; A61B2017/00017; A61B2017/00199; A61B34/10; A61B2034/107; A61B2034/2046; A61B2034/2055; A61B2034/2065; A61B34/25; A61B2034/256; A61B90/36; A61B2090/363; A61B2090/364; A61B90/37; A61B2090/371; A61B6/08; G06T2207/00; G06T2207/10; G06T2207/10004; G06T2207/10012; G06T2207/10024; G06T2207/10072; G06T2207/10116; G06T2207/30; G06T2207/30004; G06T2207/30016; G06T2207/30204; H04N2013/0074; H04N2013/0077; H04N2013/0081; H04N2013/0092

Claims Analysis

Total Claims: 56
Claim 1
Independent Claim 154 words
An apparatus for establishing a workspace coordinate reference framework for features of a medical workspace including a patient's body region, the apparatus comprising: a calibration fiducial structure having fiducial markers supported in a fixed, known spatial relationship relative to each other, said calibration fiducial structure being positionable in the medical workspace; an imager positioned relative to the medical workspace and capable of producing calibration images of the medical workspace with the calibration fiducial structure positioned therein a digitizer in communication with the optical imager and capable of receiving calibration information relating to the calibration images and producing digitized calibration image signals, a computer in communication with the digitizer, the computer being programmed to receive the calibration image signals, establish, from the calibration image signals and the known spatial relationship of the fiducial markers, a workspace coordinate framework defining the workspace in three dimensional coordinates; and determine workspace coordinates of the features of the workspace.
Claim 2
Independent Claim 154 words
An apparatus for establishing a workspace coordinate reference framework for features of a medical workspace including a patient's body region, the apparatus comprising: a calibration fiducial structure having fiducial markers supported in a fixed, known spatial relationship relative to each other, said calibration fiducial structure being positionable in the medical workspace; an imager positioned relative to the medical workspace and capable of producing calibration images of the medical workspace with the calibration fiducial structure positioned therein a digitizer in communication with the optical imager and capable of receiving calibration information relating to the calibration images and producing digitized calibration image signals, a computer in communication with the digitizer, the computer being programmed to receive the calibration image signals, establish, from the calibration image signals and the known spatial relationship of the fiducial markers, a workspace coordinate framework defining the workspace in three dimensional coordinates; and determine workspace coordinates of the features of the workspace.
Claim 3
Dependent Claim 54 words
The apparatus of claim 1, further including a medical instrument positionable within the medical workspace and wherein the imager is capable of producing subsequent images of the medical workspace with the medical instrument positioned therein and the digitizer is capable of receiving subsequent information relating to subsequent images and producing digitized subsequent image signals.
Claim 4
Dependent Claim 72 words
The apparatus of claim 2, wherein the computer is programed to receive a set of scan coordinates of a scan image in a scan coordinate framework, the scan image having identifiable features, align the scan coordinate framework with the workspace coordinate framework, receive the subsequent image signals, determine workspace coordinates of the medical instrument from the subsequent image signals, and determine a locational relationship between the medical instrument and the scan images.
Claim 5
Dependent Claim 42 words
The apparatus of claim 3, wherein the imager includes a first camera and a second camera having respective first and second sightlines of the medical workspace, the first and second sightlines being arranged at an angle and intersecting in the medical workspace.
Claim 6
Dependent Claim 33 words
The apparatus of claim 4, further comprising a display unit in communication with the computer for displaying video images of the medical workspace, wherein the computer supplies display signals to the display unit.
Claim 7
Dependent Claim 42 words
The apparatus of claim 1, wherein the imager includes a first camera and a second camera having respective first and second sightlines of the medical workspace, the first and second sightlines being arranged at an angle and intersecting in the medical workspace.
Claim 8
Dependent Claim 14 words
The apparatus of claim 6, wherein the first and second cameras include video cameras.
Claim 9
Dependent Claim 32 words
The apparatus of claim 1, further comprising a display unit in communication with the computer for displaying images of the medical workspace, wherein the computer supplies display signals to the display unit.
Claim 10
Independent Claim 181 words
An apparatus for establishing a workspace coordinate reference framework for features of a medical workspace including a patient's body region, the apparatus comprising: a calibration fiducial structure having fiducials supported in a fixed, known spatial relationship relative to each other, said calibration fiducial structure being positionable in the medical workspace; an imager positioned relative to the medical workspace and capable of producing calibration images of the medical workspace with the calibration fiducial structure positioned therein; a digitizer in communication with the imager and capable of receiving calibration information relating to the calibration images and producing digitized calibration image signals; and a computer in communication with the digitizer, the computer being configured to receive the calibration image signals, establish, from the calibration image signals and the known spatial relationship of the fiducials, a workspace coordinate framework defining the workspace in three dimensional coordinates, receive a set of scan coordinates of a scan image in a scan coordinate framework, the scan image having identifiable features, align the scan coordinate framework with the workspace coordinate framework, and determine workspace coordinates of the identifiable features.
Claim 11
Independent Claim 181 words
An apparatus for establishing a workspace coordinate reference framework for features of a medical workspace including a patient's body region, the apparatus comprising: a calibration fiducial structure having fiducials supported in a fixed, known spatial relationship relative to each other, said calibration fiducial structure being positionable in the medical workspace; an imager positioned relative to the medical workspace and capable of producing calibration images of the medical workspace with the calibration fiducial structure positioned therein; a digitizer in communication with the imager and capable of receiving calibration information relating to the calibration images and producing digitized calibration image signals; and a computer in communication with the digitizer, the computer being configured to receive the calibration image signals, establish, from the calibration image signals and the known spatial relationship of the fiducials, a workspace coordinate framework defining the workspace in three dimensional coordinates, receive a set of scan coordinates of a scan image in a scan coordinate framework, the scan image having identifiable features, align the scan coordinate framework with the workspace coordinate framework, and determine workspace coordinates of the identifiable features.
Claim 12
Dependent Claim 51 words
The apparatus of claim 9, wherein the imager is capable of producing subsequent images of the medical workspace, the digitizer is capable of receiving subsequent information relating to subsequent images and producing digitized subsequent image signals, and the computer is configured to receive the subsequent image signals and produce subsequent images.
Claim 13
Dependent Claim 35 words
The apparatus of claim 10, farther including a medical instrument positionable within the medical workspace and wherein the computer is configured to determine the workspace coordinates of the medical instrument from the subsequent image signals.
Claim 14
Dependent Claim 40 words
The apparatus of claim 10, further comprising a display unit in communication with the computer for displaying images of the medical workspace, wherein the computer produces display signal from the subsequent images and supplies display signals to the display unit.
Claim 15
Dependent Claim 13 words
The apparatus of claim 9, wherein the fiducial markers are substantially spherically shaped.
Claim 16
Dependent Claim 28 words
The apparatus of claim 9, wherein the calibration fiducial structure is configured so as to be separable from the patient's body region after the calibration images are produced.
Claim 17
Dependent Claim 42 words
The apparatus of claim 9, wherein the imager includes a first camera and a second camera having respective first and second sightlines of the medical workspace, the first and second sightlines being arranged at an angle and intersecting in the medical workspace.
Claim 18
Dependent Claim 14 words
The apparatus of claim 15, wherein the first and second cameras include video cameras.
Claim 19
Dependent Claim 21 words
The apparatus of claim 15, wherein the calibration images include a calibration image pair produced by the first and second cameras.
Claim 20
Dependent Claim 21 words
The apparatus of claim 17, wherein the subsequent images include a subsequent image pair produced by the first and second cameras.
Claim 21
Independent Claim 222 words
An apparatus for defining a location of a medical instrument relative to features of a medical workspace including a patient's body region, comprising: a workspace imager positionable for producing a plurality images of the medical workspace, wherein at least two of said images are made from one of each of two sightlines, said sightlines intersecting at an angle; a digitizer operably disposed for digitizing each of said images to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; a fiducial structure positionable in said workspace having fiducial markers held in fixed spatial relation to one another; and a computer connected to said digitizer to receive said digital image signals therefrom, said computer being programed to establish a workspace coordinate framework in three dimensions from said images made when said fiducial structure is positioned within said workspace, determine workspace coordinates in said workspace coordinate framework of any selected point which can be identified from said images, receive a set of scan coordinates for selected landmarks present in a scan made in a scan coordinate framework, correlate said scan coordinates with the workspace coordinates of said landmarks as derived from one of the images, and convert the scan coordinates of a selected feature in said scan to corresponding workspace coordinates in said workspace framework.
Claim 22
Independent Claim 222 words
An apparatus for defining a location of a medical instrument relative to features of a medical workspace including a patient's body region, comprising: a workspace imager positionable for producing a plurality images of the medical workspace, wherein at least two of said images are made from one of each of two sightlines, said sightlines intersecting at an angle; a digitizer operably disposed for digitizing each of said images to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; a fiducial structure positionable in said workspace having fiducial markers held in fixed spatial relation to one another; and a computer connected to said digitizer to receive said digital image signals therefrom, said computer being programed to establish a workspace coordinate framework in three dimensions from said images made when said fiducial structure is positioned within said workspace, determine workspace coordinates in said workspace coordinate framework of any selected point which can be identified from said images, receive a set of scan coordinates for selected landmarks present in a scan made in a scan coordinate framework, correlate said scan coordinates with the workspace coordinates of said landmarks as derived from one of the images, and convert the scan coordinates of a selected feature in said scan to corresponding workspace coordinates in said workspace framework.
Claim 23
Dependent Claim 24 words
The apparatus of claim 19, further comprising an instrument, the instrument having fiducial points held in fixed and known spatial relation to one another.
Claim 24
Dependent Claim 17 words
The apparatus of claim 19, wherein the workspace imager includes a first camera and a second camera.
Claim 25
Dependent Claim 14 words
The apparatus of claim 21, wherein the first and second cameras include video cameras.
Claim 26
Dependent Claim 32 words
The apparatus of claim 19, further comprising a display unit in communication with the computer for displaying images of the medical workspace, wherein the computer provides display signals to the display unit.
Claim 27
Independent Claim 270 words
An apparatus for localizing a medical instrument relative to features of a patient's body region, comprising: a fiducial structure positionable in a medical workspace having fiducial markers located in a known, fixed relation to each other; a workspace imager positionable for producing at least a pair of images of said medical workspace, said image pair comprising two images made along one of each of a different one of two sightlines, said sightlines intersecting at an angle; a digitizer operably disposed for digitizing each of said images of said image pair to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; and a computer connected to said digitizer to receive said digital image signals therefrom, said computer being operable to determine a first 2D coordinate from one member of a calibration image pair and a second 2D coordinate from the other member of said calibration image pair, said calibration image pair being an image pair made with said fiducial structure positioned in said medical workspace, compute a 3D workspace coordinate framework from the known, fixed relation of the fiducial markers in combination with said first and second 2D coordinates, compute an algorithm for converting any 2D coordinates derived from a subsequent image pair made after said fiducial structure is removed from said medical workspace, to corresponding 3D workspace coordinates, determine a set of 2D image coordinates reflective of a current position of a feature of interest present in both images of said subsequent image pair, and convert said set of 2D image coordinates to a set of corresponding workspace 3D coordinates.
Claim 28
Independent Claim 270 words
An apparatus for localizing a medical instrument relative to features of a patient's body region, comprising: a fiducial structure positionable in a medical workspace having fiducial markers located in a known, fixed relation to each other; a workspace imager positionable for producing at least a pair of images of said medical workspace, said image pair comprising two images made along one of each of a different one of two sightlines, said sightlines intersecting at an angle; a digitizer operably disposed for digitizing each of said images of said image pair to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; and a computer connected to said digitizer to receive said digital image signals therefrom, said computer being operable to determine a first 2D coordinate from one member of a calibration image pair and a second 2D coordinate from the other member of said calibration image pair, said calibration image pair being an image pair made with said fiducial structure positioned in said medical workspace, compute a 3D workspace coordinate framework from the known, fixed relation of the fiducial markers in combination with said first and second 2D coordinates, compute an algorithm for converting any 2D coordinates derived from a subsequent image pair made after said fiducial structure is removed from said medical workspace, to corresponding 3D workspace coordinates, determine a set of 2D image coordinates reflective of a current position of a feature of interest present in both images of said subsequent image pair, and convert said set of 2D image coordinates to a set of corresponding workspace 3D coordinates.
Claim 29
Dependent Claim 14 words
The apparatus of claim 24, wherein the imager includes a first and second camera.
Claim 30
Dependent Claim 15 words
The apparatus of claim 25, wherein the first and second cameras include an optical camera.
Claim 31
Independent Claim 132 words
A method for establishing a workspace reference framework for features of a medical workspace including a patient's body region, the method comprising the steps of: providing a calibration fiducial structure having fiducials supported in a fixed, known spatial relationship relative to each other, an imager positioned relative to the medical workspace, a digitizer in communication with the imager, and a computer in communication with the digitizer; producing calibration images of the medical workspace with the calibration fiducial structure positioned therein; producing digitized calibration image signals from the calibration images; establishing, from the calibration image signals and the known spatial relationship of the fiducials, a workspace coordinate framework defining the workspace in three dimensional coordinates; determining the workspace coordinates of features of the medical workspace; and producing subsequent images of the medical workspace.
Claim 32
Independent Claim 132 words
A method for establishing a workspace reference framework for features of a medical workspace including a patient's body region, the method comprising the steps of: providing a calibration fiducial structure having fiducials supported in a fixed, known spatial relationship relative to each other, an imager positioned relative to the medical workspace, a digitizer in communication with the imager, and a computer in communication with the digitizer; producing calibration images of the medical workspace with the calibration fiducial structure positioned therein; producing digitized calibration image signals from the calibration images; establishing, from the calibration image signals and the known spatial relationship of the fiducials, a workspace coordinate framework defining the workspace in three dimensional coordinates; determining the workspace coordinates of features of the medical workspace; and producing subsequent images of the medical workspace.
Claim 33
Dependent Claim 33 words
The method of claim 27, further comprising the steps of providing a medical instrument positioned therein and wherein the subsequent images include images of the medical workspace with the medical instrument positioned therein.
Claim 34
Dependent Claim 32 words
The method of claim 28, further comprising the steps of: producing digitized subsequent image signals from the subsequent images; and determining workspace coordinates of the medical instrument from the subsequent image signals.
Claim 35
Dependent Claim 58 words
The method of claim 29 wherein the computer stores scan coordinates of a scan image in a scan coordinate framework, the scan image having identifiable features, and further including the steps of aligning the scan coordinate framework with the workspace coordinate framework and determining a locational relationship between the medical instrument and features identified from the scan image.
Claim 36
Independent Claim 171 words
A method of localizing a feature of interest in a workspace, comprising the steps of: providing a fiducial structure comprising fiducials and a support connecting said fiducials in a known, fixed relation to each other; making calibration images of the workspace comprising two 2D images of the fiducial structure positioned in the workspace such that the fiducials are visible in the calibration images; digitizing the 2D images of the calibration images; determining a first 2D coordinate from at least one of the calibration images and a second 2D coordinate from at least a second of the calibration images; computing a 3D workspace coordinate framework from said first and second 2D coordinate and the known, fixed relation of the fiducials; making subsequent images comprising 2D images of the workspace having a patient's body region therein; digitizing the 2D images of the subsequent images and creating 3D images of the subsequent images; and determining workspace 3D coordinates of a feature of interest in the workspace from the 3D images of the subsequent images.
Claim 37
Independent Claim 171 words
A method of localizing a feature of interest in a workspace, comprising the steps of: providing a fiducial structure comprising fiducials and a support connecting said fiducials in a known, fixed relation to each other; making calibration images of the workspace comprising two 2D images of the fiducial structure positioned in the workspace such that the fiducials are visible in the calibration images; digitizing the 2D images of the calibration images; determining a first 2D coordinate from at least one of the calibration images and a second 2D coordinate from at least a second of the calibration images; computing a 3D workspace coordinate framework from said first and second 2D coordinate and the known, fixed relation of the fiducials; making subsequent images comprising 2D images of the workspace having a patient's body region therein; digitizing the 2D images of the subsequent images and creating 3D images of the subsequent images; and determining workspace 3D coordinates of a feature of interest in the workspace from the 3D images of the subsequent images.
Claim 38
Dependent Claim 74 words
The method of claim 31, wherein the at least one of the calibration images is made by a first camera and the at least second of the calibration images is made by a second camera, and further comprising the step of positioning the first and second cameras so as to have respective first and second sightlines of the workspace, the first and second sightlines being arranged at an angle and intersecting in the workspace.
Claim 39
Dependent Claim 17 words
The method of claim 31, further comprising the steps of displaying video images of the medical workspace.
Claim 40
Dependent Claim 36 words
The method of claim 31, wherein a medical instrument is provided with a plurality of instrument fiducials, and further comprising the step of determining workspace coordinates of the medical instrument from coordinates of the instrument fiducials.
Claim 41
Dependent Claim 40 words
The method of claim 34, further comprising the step of determining workspace coordinates of an operative portion of the medical instrument from the workspace coordinates of the instrument fiducials and a distance between the operative portion and the instrument fiducials.
Claim 42
Independent Claim 215 words
A method for localization of features of a medical workspace including a patient's body region, the method comprising the steps of: providing a calibration fiducial structure having fiducial markers supported in a fixed, known spatial relationship relative to each other, a plurality of cameras positioned relative to the medical workspace, a digitizer in communication with the plurality of cameras, and a computer in communication with the digitizer and storing a set of scan coordinates of a scan image in a scan coordinate framework, the scan image having identifiable features; producing at least one calibration image pair of the medical workspace with the calibration fiducial structure positioned therein; producing digitized calibration image signals from calibration information relating to the calibration image pair; establishing, from the calibration image signals and the known spatial relationship of the fiducial markers, a workspace coordinate framework defining the workspace in three dimensional coordinates; producing at least a subsequent image pair of the medical workspace; producing digitized subsequent image signals from subsequent information relating to subsequent image pairs; determining workspace coordinates of a feature of the medical workspace from the subsequent image signals; aligning the scan coordinate framework with the workspace coordinate framework; and determining a locational relationship between the feature of the medical workspace and features identified from the scan image.
Claim 43
Independent Claim 215 words
A method for localization of features of a medical workspace including a patient's body region, the method comprising the steps of: providing a calibration fiducial structure having fiducial markers supported in a fixed, known spatial relationship relative to each other, a plurality of cameras positioned relative to the medical workspace, a digitizer in communication with the plurality of cameras, and a computer in communication with the digitizer and storing a set of scan coordinates of a scan image in a scan coordinate framework, the scan image having identifiable features; producing at least one calibration image pair of the medical workspace with the calibration fiducial structure positioned therein; producing digitized calibration image signals from calibration information relating to the calibration image pair; establishing, from the calibration image signals and the known spatial relationship of the fiducial markers, a workspace coordinate framework defining the workspace in three dimensional coordinates; producing at least a subsequent image pair of the medical workspace; producing digitized subsequent image signals from subsequent information relating to subsequent image pairs; determining workspace coordinates of a feature of the medical workspace from the subsequent image signals; aligning the scan coordinate framework with the workspace coordinate framework; and determining a locational relationship between the feature of the medical workspace and features identified from the scan image.
Claim 44
Dependent Claim 44 words
The method of claim 36, further comprising positioning a medical instrument in the medical workspace, determining the workspace coordinates of the medical instrument from the subsequent image signal, and determining the locational relationship between the medical instrument and features identified from the scan images.
Claim 45
Dependent Claim 38 words
The method of claim 37, wherein the medical instrument is provided with a plurality of instrument fiducial markers, and the step of determining workspace coordinates of the medical instrument includes determining workspace coordinates of the instrument fiducial markers.
Claim 46
Dependent Claim 42 words
The method of claim 38, further comprising the step of determining workspace coordinates of an operative portion of the medical instrument from the workspace coordinates of the instrument fiducial markers and a distance between the operative portion and the instrument fiducial markers.
Claim 47
Dependent Claim 16 words
The method of claim 36, wherein the fiducials are located on a substantially spherically shaped balls.
Claim 48
Dependent Claim 59 words
The method of claim 36, wherein the plurality of cameras include a first camera and a second camera, and further comprising the step of positioning the first and second cameras so as to have respective first and second sightlines of the medical workspace, the first and second sightlines being arranged at an angle and intersecting in the medical workspace.
Claim 49
Dependent Claim 14 words
The method of claim 41, wherein the first and second cameras include video cameras.
Claim 50
Dependent Claim 26 words
The method of claim 36, further comprising the step of removing the calibration fiducial structure from the medical workspace prior to producing the subsequent image pair.
Claim 51
Dependent Claim 34 words
The method of claim 36, further comprising: providing a display unit in communication with the computer; supplying display signals from the computer to the display unit; and displaying video images of the medical workspace.
Claim 52
Dependent Claim 31 words
The method of claim 36, wherein the aligning step includes identifying workspace coordinates and scan coordinates of a plurality of points within the scan coordinate framework and the workspace coordinate framework.
Claim 53
Independent Claim 281 words
A method of stereotaxic localization of a medical instrument with respect to a structure within a patient's body region, comprising the steps of: providing an imager positioned for making a plurality of image pairs of a medical workspace having a patient's body region disposed therein, wherein each of said image pairs comprises a first 2D image made along a first sightline and a second 2D image made along a second sightline which intersects said first sightline at an angle; providing a fiducial structure for establishing a workspace coordinate framework, and including fiducials which are fixed with respect to one another, and having known spacings from one another; making a calibration image pair comprising calibration 2D images, wherein the fiducials are visible in first and second images of the calibration image pair; digitizing the calibration 2D images to produced digitized calibration 2D images; computing a 3D workspace coordinate framework from the digitized calibration 2D images and the known spacings of the fiducials; providing an internal scan of the patient's body region to identify one or more internal features; providing a medical instrument having an operative portion and having known dimensions; making and digitizing a subsequent image pair of the workspace having a portion of the medical instrument visible in both images of the subsequent image pair to produce a digitized subsequent image pair; computing workspace coordinates of the visible portion of the medical instrument from the digitized subsequent image pair; computing workspace coordinates of an operative portion of the medical instrument from the workspace coordinates of the visible portion; and determining a locational relationship between the operative portion of the medical instrument and one or more internal features identified from the scan.
Claim 54
Independent Claim 281 words
A method of stereotaxic localization of a medical instrument with respect to a structure within a patient's body region, comprising the steps of: providing an imager positioned for making a plurality of image pairs of a medical workspace having a patient's body region disposed therein, wherein each of said image pairs comprises a first 2D image made along a first sightline and a second 2D image made along a second sightline which intersects said first sightline at an angle; providing a fiducial structure for establishing a workspace coordinate framework, and including fiducials which are fixed with respect to one another, and having known spacings from one another; making a calibration image pair comprising calibration 2D images, wherein the fiducials are visible in first and second images of the calibration image pair; digitizing the calibration 2D images to produced digitized calibration 2D images; computing a 3D workspace coordinate framework from the digitized calibration 2D images and the known spacings of the fiducials; providing an internal scan of the patient's body region to identify one or more internal features; providing a medical instrument having an operative portion and having known dimensions; making and digitizing a subsequent image pair of the workspace having a portion of the medical instrument visible in both images of the subsequent image pair to produce a digitized subsequent image pair; computing workspace coordinates of the visible portion of the medical instrument from the digitized subsequent image pair; computing workspace coordinates of an operative portion of the medical instrument from the workspace coordinates of the visible portion; and determining a locational relationship between the operative portion of the medical instrument and one or more internal features identified from the scan.
Claim 55
Dependent Claim 19 words
The method of claim 46, wherein the image pairs are made by a first camera and a second camera.
Claim 56
Dependent Claim 35 words
The method of claim 46, further comprising the steps of displaying video images of the operative portion of the medical instrument and the one or more internal features identified from the scan in the workspace.

References Cited (Backward Citations)

US35816A Cited
US3821469A Cited
US3868565A Cited
DE2534516A1 Cited
US4058114A Cited
US3971133A Cited
US3963028A Cited
US3983474A Cited
US4068556A Cited
US4068156A Cited
US4262306A Cited
US4182312A Cited
DE2831278A1 Cited
US4228799A Cited
US4117337A Cited
US4209254A Cited
FR2417970B1 Cited
DE2852949A1 Cited
US4259725A Cited
US4341220A Cited
EP0018166A1 Cited
US4608977A Cited
US4419012A Cited
US4398540A Cited
US4602622A Cited
US4360028A Cited
US4638798A Cited
US4358856A Cited
DE3205085A1 Cited
GB2094590A Cited
EP0062941B1 Cited
US4465069A Cited
US4543959A Cited
US4407298A Cited
US4396945A Cited
US4473074A Cited
US4645343A Cited
DE3205915A1 Cited
US4457311A Cited
US4506676A Cited
US4528510A Cited
US4551678A Cited
US4961422A Cited
US4585350A Cited
US4651732A Cited
US4698777A Cited
US4701049A Cited
US4618978A Cited
US4727565A Cited
US4660970A Cited
US4753528A Cited
US4841967A Cited
US4674057A Cited
EP0155857A3 Cited
US4571834A Cited
US4583538A Cited
US4649504A Cited
US4775235A Cited
US4701047A Cited
US4659971A Cited
US4705395A Cited
US4721388A Cited
US4821206A Cited
US4592352A Cited
US4706665A Cited
US4673352A Cited
US4721384A Cited
USD291246S Cited
DE3508730A1 Cited
US4782239A Cited
US4672306A Cited
US4737921A Cited
US4764016A Cited
US4743771A Cited
US4805615A Cited
US4955891A Cited
EP0207452A3 Cited
US4686997A Cited
US4705401A Cited
US4737032A Cited
US4803645A Cited
US4779212A Cited
US4709156A Cited
US4794262A Cited
US4771787A Cited
US4742815A Cited
US4722056A Cited
USD299070S Cited
USD298862S Cited
USD298863S Cited
US4788481A Cited
US4776749A Cited
US4943296A Cited
US4821200A Cited
US5078140A Cited
US4822163A Cited
US4767934A Cited
US4723544A Cited
US4791934A Cited
US4733969A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-12-26 2004-06-26 2004-12-26 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-12-26 2008-06-26 2008-12-26 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-12-26 2012-06-26 2012-12-26 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag