← Back to Patent Explorer
US5029220A Expired / Lapsed US ⏱️ 0.0 years remaining

Optical joint correlator for real-time image tracking and retinal surgery

Assignee: National Aeronautics and Space Administration
•
Filing: 1990-07-31
•
Granted: 1991-07-02
•
Expires: 2010-07-31
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method for tracking an object in a sequence of images is described. Such sequence of images may, for example, be a sequence of television frames. The object in the current frame is correlated with the object in the previous frame to obtain the relative location of the object in the two frames. An optical joint transform correlator apparatus is provided to carry out the process. Such joint transform correlator apparatus forms the basis for laser eye surgical apparatus where an image of the fundus of an eyeball is stabilized and forms the basis for the correlator apparatus to track the position of the eyeball caused by involuntary movement. With knowledge of the eyeball position, a surgical laser can be precisely pointed toward a position on the retina.

Inventors

  • 👤 Richard D. Juday

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-24 18:06
CPC Classifications
A; A61; A61F; A61F9/00; A61F9/007; A61F9/008; A61F9/00821; G; G06; G06T; G06T7/00; G06T7/20; G06V; G06V10/00; G06V10/88; G06V10/92; A61B; A61B17/00; A61B2017/00681; A61B2017/00694; A61B3/00; A61B3/10; A61B3/113; A61F2009/00844; A61F2009/00846; A61F2009/00861; A61F2009/00863

Claims Analysis

Total Claims: 11
Claim 1
Independent Claim 212 words
A method for tracking the position of an object in a time sequence of time-sampled images of the object comprising the steps of, displaying sequential contiguous images of said object in side-by-side relation on a first spatial light modulator to produce a first SLM image, illuminating said first SLM image with a coherent light beam to produce a first modulated beam, optically Fourier transforming said first modulated beam to produce a transformed optical image of said side-by-side images, detecting said transformed optical image to produce a first detected display of said transformed side-by-side images, displaying said first detected display on a second spatial light modulator to produce a second SLM image, illuminating said second SLM image with a coherent light beam to produce a second modulated beam, optically Fourier transforming said second modulated beam to produce a correlation optical beam of said side-by-side images, detecting said correlation optical beam to produce a correlation image of light spots representative of the joint correlation of said two images, measuring the translational relationship between said light spots to determine the positional relationship of said object between said two images, and periodically repeating the above steps with the sequence of time-frozen images being displayed in time sequence in side-by-side relationship on said first spatial light modulator.
Claim 2
Independent Claim 212 words
A method for tracking the position of an object in a time sequence of time-sampled images of the object comprising the steps of, displaying sequential contiguous images of said object in side-by-side relation on a first spatial light modulator to produce a first SLM image, illuminating said first SLM image with a coherent light beam to produce a first modulated beam, optically Fourier transforming said first modulated beam to produce a transformed optical image of said side-by-side images, detecting said transformed optical image to produce a first detected display of said transformed side-by-side images, displaying said first detected display on a second spatial light modulator to produce a second SLM image, illuminating said second SLM image with a coherent light beam to produce a second modulated beam, optically Fourier transforming said second modulated beam to produce a correlation optical beam of said side-by-side images, detecting said correlation optical beam to produce a correlation image of light spots representative of the joint correlation of said two images, measuring the translational relationship between said light spots to determine the positional relationship of said object between said two images, and periodically repeating the above steps with the sequence of time-frozen images being displayed in time sequence in side-by-side relationship on said first spatial light modulator.
Claim 3
Dependent Claim 31 words
The method of claim 1 further comprising the step of measuring the brightness of said light spots of said correlation image to determine the degree of resemblance of said two images.
Claim 4
Independent Claim 138 words
A method for tracking the location of a moving object in a time sequence of video images comprising the steps of, displaying an image of said object of the current frame in side-by-side relation with an image of said object in a previous contiguous frame to produce a joint display of said images, optically Fourier transforming said joint display of said image to produce a joint transform power spectrum of the image of said joint display, optically Fourier transforming said joint transform power spectrum to produce a correlation function between said image of said current frame and said image of said previous frame, said correlation function including at least one cross-correlation peak, and determining the location of said object in said current frame by updating its location in said previous frame with the location of said cross-correlation peak.
Claim 5
Independent Claim 138 words
A method for tracking the location of a moving object in a time sequence of video images comprising the steps of, displaying an image of said object of the current frame in side-by-side relation with an image of said object in a previous contiguous frame to produce a joint display of said images, optically Fourier transforming said joint display of said image to produce a joint transform power spectrum of the image of said joint display, optically Fourier transforming said joint transform power spectrum to produce a correlation function between said image of said current frame and said image of said previous frame, said correlation function including at least one cross-correlation peak, and determining the location of said object in said current frame by updating its location in said previous frame with the location of said cross-correlation peak.
Claim 6
Dependent Claim 218 words
Apparatus for tracking the position of an object appearing in a sequence of contiguous time-frozen images of the object comprising, a first spatial light modulator, means for displaying said contiguous images of said object in side-by-side relation on said first spatial light modulator to produce a first SLM image, means for illuminating said first SLM image with a coherent light beam to produce a first modulated beam, Fourier lens means for transforming said first modulated beam to produce a Fourier transformed optical image of said side-by-side images, means for detecting said transformed optical image to produce a first detected display of said transformed side-by-side images, a second spatial light modulator, means for displaying said second detected display on said second spatial light modulator to produce a second SLM image, means for illuminating said second SLM image with a coherent light beam to produce a second modulated beam, means for optically Fourier transforming said second modulated beam to produce a correlation optical image of said side-by-side images, and means for detecting said correlation optical beam to produce a correlation image of light spots representative of the joint correlation of said two images, and means for measuring the position of at least one of said light spots as a measure of the position between said object in said two images.
Claim 7
Dependent Claim 218 words
Apparatus for tracking the position of an object appearing in a sequence of contiguous time-frozen images of the object comprising, a first spatial light modulator, means for displaying said contiguous images of said object in side-by-side relation on said first spatial light modulator to produce a first SLM image, means for illuminating said first SLM image with a coherent light beam to produce a first modulated beam, Fourier lens means for transforming said first modulated beam to produce a Fourier transformed optical image of said side-by-side images, means for detecting said transformed optical image to produce a first detected display of said transformed side-by-side images, a second spatial light modulator, means for displaying said second detected display on said second spatial light modulator to produce a second SLM image, means for illuminating said second SLM image with a coherent light beam to produce a second modulated beam, means for optically Fourier transforming said second modulated beam to produce a correlation optical image of said side-by-side images, and means for detecting said correlation optical beam to produce a correlation image of light spots representative of the joint correlation of said two images, and means for measuring the position of at least one of said light spots as a measure of the position between said object in said two images.
Claim 8
Dependent Claim 400 words
Apparatus for aiming a surgical laser at a point in the interior of an eye comprising, gimballed tracking mirror means positioned near said eye for reflecting an optical image of the interior of said eye, surgical laser means for generating a surgical light beam, two way mirror means disposed in the path of said optical image of the interior of said eye and in the path of said surgical light beam for passing said optical image through said two way mirror and for reflecting said surgical light beam to said gimballed tracking mirror, camera means in the path of said optical image from said two way mirror means for generating an electronic image signal representative of the interior of said eye, a surgeon's TV monitor means responsive to said electronic image signal for displaying a stabilized frame image of said image of the interior of said eye, positioning means for moving a cursor to a particular point on said TV monitor so as to coincide with an aim point on said stabilized frame image of the interior of said eye and for producing x and y signals representative of the x and y locations of said cursor, joint transform correlator means responsive to said electronic image signal representative of the interior of said eye including, means for displaying said stabilized frame image of the interior of said eye on one side of a joint display and for sequentially frames of said image on another side of said joint display, means for sequentially optically producing a display of the correlation function between said side-by-side images, and means for determining the location of each sequential image with respect to said image of said stabilized frame and for producing δx and δy signals representative of the location of at least one cross-correlation peak, said δx and δy signals representative of the movement of said image with respect to said image of said stabilized frame, adder means for adding said x signal and said δx signal to produce an error x signal and for adding said y signal and said δy signal to produce an error y signal, and drive circuitry means responsive to said error x and error y signals for positioning said gimballed tracking mirror means so that said surgical laser beam is pointed to said cursor point of said stabilized frame image of the eye independent of motion of said eyeball.
Claim 9
Dependent Claim 400 words
Apparatus for aiming a surgical laser at a point in the interior of an eye comprising, gimballed tracking mirror means positioned near said eye for reflecting an optical image of the interior of said eye, surgical laser means for generating a surgical light beam, two way mirror means disposed in the path of said optical image of the interior of said eye and in the path of said surgical light beam for passing said optical image through said two way mirror and for reflecting said surgical light beam to said gimballed tracking mirror, camera means in the path of said optical image from said two way mirror means for generating an electronic image signal representative of the interior of said eye, a surgeon's TV monitor means responsive to said electronic image signal for displaying a stabilized frame image of said image of the interior of said eye, positioning means for moving a cursor to a particular point on said TV monitor so as to coincide with an aim point on said stabilized frame image of the interior of said eye and for producing x and y signals representative of the x and y locations of said cursor, joint transform correlator means responsive to said electronic image signal representative of the interior of said eye including, means for displaying said stabilized frame image of the interior of said eye on one side of a joint display and for sequentially frames of said image on another side of said joint display, means for sequentially optically producing a display of the correlation function between said side-by-side images, and means for determining the location of each sequential image with respect to said image of said stabilized frame and for producing δx and δy signals representative of the location of at least one cross-correlation peak, said δx and δy signals representative of the movement of said image with respect to said image of said stabilized frame, adder means for adding said x signal and said δx signal to produce an error x signal and for adding said y signal and said δy signal to produce an error y signal, and drive circuitry means responsive to said error x and error y signals for positioning said gimballed tracking mirror means so that said surgical laser beam is pointed to said cursor point of said stabilized frame image of the eye independent of motion of said eyeball.
Claim 10
Dependent Claim 68 words
The apparatus of claim 5 wherein said joint transform correlator means further produces a brightness signal representative of the brightness of said cross-correlation peak and said apparatus further comprises, dynamic adjustment means responsive to said brightness signal for controlling said surgical light beam as a function of the degree of correlation between said image of said stabilized frame of said eye and said real-time image of said eye.
Claim 11
Dependent Claim 31 words
The apparatus of claim 5 further comprising, means for inhibiting the firing of said surgical laser means if said error x and error y signals are greater than predetermined threshold values.

References Cited (Backward Citations)

US3542457A Cited
US4383734A Cited
US4357676A Cited
US4438765A Cited
US4443075A Cited
US4462046A Cited
US4735984A Cited
US4722101A Cited
US4695973A Cited
US4832447A Cited
US4924507A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1994-07-01 1994-12-31 1995-07-02 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1998-07-01 1998-12-31 1999-07-02 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2002-07-01 2002-12-31 2003-07-02 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag