US5389101A — Apparatus and method for photogrammetric surgical…

Claim 1

Independent Claim 331 words

Apparatus for defining a location of a medical instrument relative to features of a medical workspace including a patient's body region, comprising: workspace imaging means positionable for producing a plurality of pairs of images of the medical workspace, each of said image pairs comprising two images made along one of each of a different one of two sightlines, said sightlines intersecting at an angle; digitizing means operably disposed for digitizing each of said images of said image pairs to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; fiducial means removably positionable in said workspace for providing a series of fiducial points held in fixed spatial relation to one another; and computing means connected to said digitizing means to receive said digital image signals therefrom, said computing means being operable to: establish a workspace coordinate framework in three dimensions from a first selected one of said pairs of images made when said fiducial means is positioned within said workspace, determine workspace coordinates in said workspace coordinate framework of any selected point which can be identified from both images of said first selected image pair, receive a set of scan coordinates for each of three or more selected landmarks present in a scan made in a scan coordinate framework, and correlate said scan coordinates with the workspace coordinates of said landmarks as derived from one of said image pairs, said landmarks being selected from the group of anatomic features, surgical implants, and radiologic implants, compute conversion functions for converting the scan coordinates of a selected feature in said scan to corresponding workspace coordinates in said workspace framework, and for converting observed workspace coordinates of a selected feature observable in both of said images of a selected one of said image pairs to corresponding scan coordinates in said scan coordinate framework, and perform said conversion functions for user-selected features found in said scan or in a subsequent selected one of said image pairs.

Claim 2

Dependent Claim 331 words

Apparatus for defining a location of a medical instrument relative to features of a medical workspace including a patient's body region, comprising: workspace imaging means positionable for producing a plurality of pairs of images of the medical workspace, each of said image pairs comprising two images made along one of each of a different one of two sightlines, said sightlines intersecting at an angle; digitizing means operably disposed for digitizing each of said images of said image pairs to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; fiducial means removably positionable in said workspace for providing a series of fiducial points held in fixed spatial relation to one another; and computing means connected to said digitizing means to receive said digital image signals therefrom, said computing means being operable to: establish a workspace coordinate framework in three dimensions from a first selected one of said pairs of images made when said fiducial means is positioned within said workspace, determine workspace coordinates in said workspace coordinate framework of any selected point which can be identified from both images of said first selected image pair, receive a set of scan coordinates for each of three or more selected landmarks present in a scan made in a scan coordinate framework, and correlate said scan coordinates with the workspace coordinates of said landmarks as derived from one of said image pairs, said landmarks being selected from the group of anatomic features, surgical implants, and radiologic implants, compute conversion functions for converting the scan coordinates of a selected feature in said scan to corresponding workspace coordinates in said workspace framework, and for converting observed workspace coordinates of a selected feature observable in both of said images of a selected one of said image pairs to corresponding scan coordinates in said scan coordinate framework, and perform said conversion functions for user-selected features found in said scan or in a subsequent selected one of said image pairs.

Claim 3

Dependent Claim 104 words

The apparatus of claim 1, wherein said computing means includes memory means for storing data including a plurality of instrument dimensions, each of said instrument dimensions comprising a known distance between a fiducial mark on an instrument and a preselected operative portion of said instrument, and said plurality including instrument dimensions for a plurality of instruments, said plurality including surgical instruments, pointers, and electrodes, and wherein said computing means is further operable to compute either extrapolated workspace coordinates or extrapolated scan coordinates of said operative portion of said instrument from said instrument dimensions and the workspace coordinates of said instrument in said image pair.

Claim 4

Dependent Claim 76 words

The apparatus of claim 2, wherein said computing means further includes computer graphics means operable to compute a plurality of sets of display signals, each said set representative of at least one of said images of said workspace or of a volume scan, and said apparatus further includes display means communicatively connected to receive said display signals from said computing means, for displaying an image encoded by a selected one of said sets of display signals.

Claim 5

Dependent Claim 57 words

The apparatus of claim 3, further including at least one instrument having a shank and an operative portion, wherein two fiducial marks are provided on said shank, and wherein at least one distance which is the distance between one of said fiducial marks and said operative portion is stored in said memory means of said computing means.

Claim 6

Dependent Claim 30 words

The apparatus of claim 1, wherein said workspace imaging means includes one or more x-ray imaging devices, and said fiducial points of said fiducial means are formed of radio-opaque material.

Claim 7

Dependent Claim 16 words

The apparatus of claim 1, wherein said workspace imaging means comprises one or more video cameras.

Claim 8

Dependent Claim 14 words

The apparatus of claim 1, wherein said workspace imaging means comprises two video cameras.

Claim 9

Dependent Claim 23 words

The apparatus of claim 1, wherein said fiducial means includes at least six said fiducial points distributed in at least two distinct planes.

Claim 10

Dependent Claim 70 words

The apparatus of claim 8, wherein said fiducial means comprises at least four rods interconnected to form a cage-like array, each of said rods having first and second ends, and said rods disposed with said first ends in a first plane and said second ends in a second plane which is parallel said first plane, and wherein said fiducial points include at least some of said first and second ends.

Claim 11

Dependent Claim 68 words

The apparatus of claim 8, further including at least one additional fiducial point, and wherein said computing means is further operable to compute from said six fiducial points expected workspace coordinates of said at least one additional fiducial point, to determine actual workspace coordinates of said at least one additional fiducial point from said digitized signals, and to compare said expected workspace coordinates to said actual workspace coordinates.

Claim 12

Dependent Claim 16 words

The apparatus of claim 1, wherein said angle is between about 5 degrees and 175 degrees.

Claim 13

Dependent Claim 51 words

The apparatus of claim 1, wherein said computing means includes a memory component, and said memory component is constructed to contain fiducial reference data for a preset minimum number of said fiducial points of said fiducial means, said fiducial reference data comprising the physical coordinates of each individual said fiducial point.

Claim 14

Dependent Claim 94 words

A fiducial structure for establishing a three-dimensional coordinate framework from a photographic image pair, comprising a support frame and a set of fiducial indicators connected and supported by said support frame, said support frame comprising a plurality of rod-like elements interconnected to form an open cage, wherein said fiducial indicators are formed as a series of eight objects interconnected by four of said rod-like elements, with individual said objects disposed respectively near a first end of each of said four rod-like elements and near a second end of each of said four rod-like elements.

Claim 15

Dependent Claim 94 words

A fiducial structure for establishing a three-dimensional coordinate framework from a photographic image pair, comprising a support frame and a set of fiducial indicators connected and supported by said support frame, said support frame comprising a plurality of rod-like elements interconnected to form an open cage, wherein said fiducial indicators are formed as a series of eight objects interconnected by four of said rod-like elements, with individual said objects disposed respectively near a first end of each of said four rod-like elements and near a second end of each of said four rod-like elements.

Claim 16

Independent Claim 250 words

A method of localizing a feature of interest in a workspace, comprising the steps of: providing a fiducial structure comprising a sufficient number of fiducial indicators arranged to define a three-dimensional coordinate system and having known 3D coordinates, and support frame means for supporting and connecting said fiducial indicators, said support frame means constructed to hold said fiducial indicators in fixed relation to each other; making a calibration image pair of the workspace comprising two 2D images of the workspace made along different sightlines, and with the fiducial structure positioned in the workspace such that a preset minimum number of fiducial points are visible in both images of the calibration image pair; digitizing respective 2D images of the calibration image pair; determining a first plurality of 2D coordinates from one member of the calibration image pair and a second plurality of 2D coordinates from the other member of the calibration image pair; computing a 3D workspace coordinate framework from said first and second pluralities of 2D coordinates and the known 3D coordinates of the fiducial structure; removing the fiducial structure from the workspace; making a subsequent image pair comprising two 2D images of the workspace having a patient's body region therein, the two 2D images being made along the same respective sightlines as the calibration image pair; digitizing the respective 2D images of the subsequent image pair; and determining workspace 3D coordinates of a feature of interest in the workspace from the respective 2D images of the subsequent image pair.

Claim 17

Independent Claim 250 words

A method of localizing a feature of interest in a workspace, comprising the steps of: providing a fiducial structure comprising a sufficient number of fiducial indicators arranged to define a three-dimensional coordinate system and having known 3D coordinates, and support frame means for supporting and connecting said fiducial indicators, said support frame means constructed to hold said fiducial indicators in fixed relation to each other; making a calibration image pair of the workspace comprising two 2D images of the workspace made along different sightlines, and with the fiducial structure positioned in the workspace such that a preset minimum number of fiducial points are visible in both images of the calibration image pair; digitizing respective 2D images of the calibration image pair; determining a first plurality of 2D coordinates from one member of the calibration image pair and a second plurality of 2D coordinates from the other member of the calibration image pair; computing a 3D workspace coordinate framework from said first and second pluralities of 2D coordinates and the known 3D coordinates of the fiducial structure; removing the fiducial structure from the workspace; making a subsequent image pair comprising two 2D images of the workspace having a patient's body region therein, the two 2D images being made along the same respective sightlines as the calibration image pair; digitizing the respective 2D images of the subsequent image pair; and determining workspace 3D coordinates of a feature of interest in the workspace from the respective 2D images of the subsequent image pair.

Claim 18

Dependent Claim 36 words

The method of claim 14, further including the step of repeating said steps of making a subsequent image pair and determining the workspace 3D coordinates of the feature of interest, until a medical procedure is complete.

Claim 19

Dependent Claim 15 words

The method of claim 14, wherein the preset minimum number of fiducial points is six.

Claim 20

Dependent Claim 101 words

The method of claim 14, further including the steps of: providing volume scan data reflective of a volume scan having a defined volume scan 3D framework including scan 3D coordinates for selected features; aligning the volume scan 3D framework with the workspace 3D framework to produce a mapping function for mapping the scan 3D coordinates of a selected point to corresponding workspace 3D coordinates; selecting a target in the volume scan and determining target workspace 3D coordinates for the target using the mapping function; and comparing the target workspace 3D coordinates with the workspace 3D coordinates of the feature of interest.

Claim 21

Dependent Claim 32 words

The method of claim 15, wherein said step of repeating is performed for one or more different selected features of interest and one or more different targets selected from the volume scan.

Claim 22

Dependent Claim 74 words

The method of claim 17, wherein the feature of interest is a medical instrument having an operative portion, and further including the steps of computing an instrument vector representing a linear direction of the instrument, computing coordinates representative of a position of the operative portion of the instrument, and extrapolating the instrument vector from the coordinates of the operative portion for a distance sufficient to determine whether the instrument vector will intersect the target.

Claim 23

Dependent Claim 18 words

The method of claim 19, wherein the calibration and subsequent image pairs are made by video imaging means.

Claim 24

Dependent Claim 38 words

The method of claim 20, further including a step of providing a visual display of the workspace comprising one image of the subsequent image pair, or a stereo image derived from both images of the subsequent image pair.

Claim 25

Dependent Claim 23 words

The method of claim 21, further including a step of overlaying an icon representing a target feature on the display of the workspace.

Claim 26

Dependent Claim 18 words

The method of claim 17, wherein the calibration and subsequent image pairs are made by video imaging means.

Claim 27

Dependent Claim 23 words

The method of claim 23, further including a step of overlaying an icon representing the target feature on the display of the workspace.

Claim 28

Dependent Claim 38 words

The method of claim 23, further including a step of providing a visual display of the workspace comprising one image of the subsequent image pair, or a stereo image derived from both images of the subsequent image pair.

Claim 29

Dependent Claim 44 words

The method of claim 17, further including a step of displaying the target and the feature of interest according to their respective workspace coordinates and in a visual context comprising an image of the workspace presented in terms of said 3D workspace coordinate framework.

Claim 30

Dependent Claim 315 words

Apparatus for localizing a medical instrument relative to features of a patient's body region, comprising: a fiducial structure removably positionable in a medical workspace, and comprising a sufficient number of fiducial indicators arranged to define a three-dimensional coordinate system and having known 3D coordinates, and support frame means for supporting and connecting said fiducial indicators, said support frame means constructed to hold said fiducial indicators in fixed relation to each other; workspace imaging means positionable for producing a plurality of pairs of images of said medical workspace, each of said image pairs comprising two images made along one of each of a different one of two sightlines, said sightlines intersecting at an angle; digitizing means operably disposed for digitizing each of said images of said image pairs to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; and computing means connected to said digitizing means to receive said digital image signals therefrom, said computing means being operable to: determine a first plurality of 2D coordinates from one member of a calibration image pair and a second plurality of 2D coordinates from an other member of said calibration image pair, said calibration image pair being an image pair made with said fiducial structure positioned in said medical workspace, compute a 3D workspace coordinate framework from measured physical 3D coordinates of said fiducial structure in combination with said first and second pluralities of 2D coordinates, compute an algorithm for converting any 2D coordinates derived from a subsequent image pair made after said fiducial structure is removed from said medical workspace, to corresponding 3D workspace coordinates, determine a set of 2D image coordinates reflective of a current position of a feature of interest present in both images of said subsequent image pair, and convert said set of 2D image coordinates to a set of corresponding workspace 3D coordinates.

Claim 31

Dependent Claim 315 words

Apparatus for localizing a medical instrument relative to features of a patient's body region, comprising: a fiducial structure removably positionable in a medical workspace, and comprising a sufficient number of fiducial indicators arranged to define a three-dimensional coordinate system and having known 3D coordinates, and support frame means for supporting and connecting said fiducial indicators, said support frame means constructed to hold said fiducial indicators in fixed relation to each other; workspace imaging means positionable for producing a plurality of pairs of images of said medical workspace, each of said image pairs comprising two images made along one of each of a different one of two sightlines, said sightlines intersecting at an angle; digitizing means operably disposed for digitizing each of said images of said image pairs to produce sets of digital image signals, one said set of digital image signals corresponding to each of said images; and computing means connected to said digitizing means to receive said digital image signals therefrom, said computing means being operable to: determine a first plurality of 2D coordinates from one member of a calibration image pair and a second plurality of 2D coordinates from an other member of said calibration image pair, said calibration image pair being an image pair made with said fiducial structure positioned in said medical workspace, compute a 3D workspace coordinate framework from measured physical 3D coordinates of said fiducial structure in combination with said first and second pluralities of 2D coordinates, compute an algorithm for converting any 2D coordinates derived from a subsequent image pair made after said fiducial structure is removed from said medical workspace, to corresponding 3D workspace coordinates, determine a set of 2D image coordinates reflective of a current position of a feature of interest present in both images of said subsequent image pair, and convert said set of 2D image coordinates to a set of corresponding workspace 3D coordinates.

Claim 32

Dependent Claim 86 words

The apparatus of claim 29, wherein said feature of interest is a medical instrument having an operative portion, and said computing means is further operable to compute an instrument vector representing a linear direction of said instrument, to compute coordinates representative of a present position of said operative portion of said instrument, and to compute extrapolated vector coordinates from said coordinates of said operative portion and said instrument vector at a distance from said operative portion sufficient to determine whether said instrument vector intersects said target.

Claim 33

Dependent Claim 95 words

The apparatus of claim 28, wherein said computing means is further operable to: receive volume scan data reflective of a volume scan having a defined volume scan 3D framework; correlate said volume scan 3D framework with said workspace 3D framework to produce a function for mapping scan 3D coordinates of a selected point to selected point workspace 3D coordinates; determine target workspace 3D coordinates for a user-selected target by applying said mapping function to said scan 3D coordinates of said selected point; and compare said target feature workspace coordinates and said selected point workspace coordinates.

Claim 34

Dependent Claim 63 words

The apparatus of claim 28, further including display means operably interconnected with said computing means and said workspace imaging means for providing a visual display of said medical workspace, said visual display comprising one of said images of said subsequent image pair, a stereo image derived from both images of said subsequent image pair, or an image derived from said volume scan data.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	1998-02-13	1998-08-15	1999-02-14	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2002-02-13	2002-08-15	2003-02-14	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2006-02-13	2006-08-15	2007-02-14	$7700.00	Window Closed / Lapsed

Apparatus and method for photogrammetric surgical localization

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag