US6842196B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and system for automatic correction of motion artifacts
Assignee: Smith and Nephew Inc
•
Filing: 2000-04-04
•
Granted: 2005-01-11
•
Expires: 2020-04-04
Abstract
Abstract Methods and systems of the present invention automatically and differentially detect and correct linear motion artifacts caused by camera movement and regional subject motion artifacts. Regional subject motion artifacts may be caused, for example in endoscopic or other surgery, by movement of surgical tools or the patient within the image field. Methods and systems of the present invention automatically correct for both types of motion occurring simultaneously. After an image is automatically corrected for both camera motion and regional subject motion, the image is displayed for viewing.
Inventors
- 👤 Dana Swift
- 👤 Larry Birdsill
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 13:36
CPC Classifications
G; G06; G06T; G06T5/00; G06T5/20; H; H04; H04N; H04N23/00; H04N23/60; H04N23/68; H04N23/50; H04N23/555; H04N23/681; H04N23/6811; H04N23/682; H04N23/683
Claims Analysis
Total Claims: 21
Claim 1
Independent Claim
171 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field, the first and second raster fields each having a plurality of pixels and pixels in the first raster field are offset from pixels in the second raster field; automatically correcting for camera motion, comprising determining whether the captured frame contains camera motion artifacts; performing auto-correlation on the first raster field with respect to the second raster field by locating optimal correlation values for X/Y coordinates for each pixel in the first raster field relative to a reference pixel in the second raster field using a repeating 3×3 convolution search to create a two-dimensional motion vector between each pixel in the first raster field and the reference pixel in the second raster field; automatically correcting for subject motion; and displaying an image corrected for camera motion and subject motion.
Claim 2
Independent Claim
171 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field, the first and second raster fields each having a plurality of pixels and pixels in the first raster field are offset from pixels in the second raster field; automatically correcting for camera motion, comprising determining whether the captured frame contains camera motion artifacts; performing auto-correlation on the first raster field with respect to the second raster field by locating optimal correlation values for X/Y coordinates for each pixel in the first raster field relative to a reference pixel in the second raster field using a repeating 3×3 convolution search to create a two-dimensional motion vector between each pixel in the first raster field and the reference pixel in the second raster field; automatically correcting for subject motion; and displaying an image corrected for camera motion and subject motion.
Claim 3
Dependent Claim
188 words
The method of claim 1 , wherein using a repeating 3×3 convolution search comprises (a) determining a first correlation value for corresponding pixels in the first and second raster fields when a first specified offset is zero for both X and Y coordinates, (b) determining a second correlation value for a pixel in the first raster field to the right of the corresponding pixel in the second raster field when a second specified offset is one for X and zero for Y, (c) calculating a difference between the first correlation value and the second correlation value, (d) squaring the difference between the values, (e) repeating steps (a), (b), (c), and (d) for all pixels in the first raster field relative to pixels in the second raster field, (f) adding the squares of the differences between correlation values at the first specified offset and at the second specified offset, and (g) determining the correlation values which produce a minimum difference between pixels in the first raster field and the second raster field to provide optimal correlation values for shifting the first raster field relative to the second raster field.
Claim 4
Dependent Claim
43 words
The method of claim 1 , wherein creating a two-dimensional motion vector comprises locating values for X/Y coordinates for each pixel in the first raster field determined to be offset more than 15 pixels from a reference pixel in the second raster field.
Claim 5
Independent Claim
225 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera, comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field; automatically correcting for camera motion, comprising locating optimal correlation values for each pixel in the first raster field relative to a reference pixel in the second raster field to create a two-dimensional motion vector between each pixel in the first raster field and the reference pixel in the second raster field; automatically correcting for subject motion comprising computing a subject motion map to automatically identify regions of subject motion in the captured frame including (a) determining actual pixel values for the first raster field, (b) computing predicted pixel values for the first raster field from the second raster field, (c) comparing the predicted pixel values and the actual pixel values for the first raster field to determine differences between the first and second raster fields in discrete regions of the captured frame, (d) identifying regions of the captured frame where differences between the first and second raster fields are relatively large, and (e) squaring the relatively large differences between the first and second raster fields to generate the subject motion map; and displaying an image corrected for camera motion and subject motion.
Claim 6
Independent Claim
225 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera, comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field; automatically correcting for camera motion, comprising locating optimal correlation values for each pixel in the first raster field relative to a reference pixel in the second raster field to create a two-dimensional motion vector between each pixel in the first raster field and the reference pixel in the second raster field; automatically correcting for subject motion comprising computing a subject motion map to automatically identify regions of subject motion in the captured frame including (a) determining actual pixel values for the first raster field, (b) computing predicted pixel values for the first raster field from the second raster field, (c) comparing the predicted pixel values and the actual pixel values for the first raster field to determine differences between the first and second raster fields in discrete regions of the captured frame, (d) identifying regions of the captured frame where differences between the first and second raster fields are relatively large, and (e) squaring the relatively large differences between the first and second raster fields to generate the subject motion map; and displaying an image corrected for camera motion and subject motion.
Claim 7
Dependent Claim
62 words
The method of claim 4 , wherein computing a subject motion map further comprises convolving the first and second raster fields of the captured frame to produce a half-height grayscale image map in regions of large differences in the subject motion map, and leaving uncorrected regions of the captured frame where differences between the first and second raster fields are relatively small.
Claim 8
Independent Claim
241 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera, comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field; automatically correcting for camera motion, comprising locating optimal correlation values for each pixel in the first raster field relative to a reference Pixel in the second raster field to create a two-dimensional motion vector between each pixel in the first raster field and the reference pixel in the second raster field; automatically correcting for subject motion comprising computing a subject motion map to automatically identify regions of subject motion in the captured frame, wherein automatically correcting for subject motion further comprises creating a binary subject location man to delineate regions of the captured frame for applying correction for subject motion including (a) establishing a threshold difference between the predicted pixel values and the actual pixel values for the first raster field, (b) comparing each pixel in the grayscale image map to the threshold difference, counting the number of pixels exceeding the threshold difference, (c) eliminating from the grayscale image map pixels where three or less neighboring pixels in the grayscale image map are above the threshold difference, and (d) leaving in the grayscale image map pixels where more than three neighboring pixels are above the threshold difference; and displaying an image corrected for camera motion and subject motion.
Claim 9
Independent Claim
241 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera, comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field; automatically correcting for camera motion, comprising locating optimal correlation values for each pixel in the first raster field relative to a reference Pixel in the second raster field to create a two-dimensional motion vector between each pixel in the first raster field and the reference pixel in the second raster field; automatically correcting for subject motion comprising computing a subject motion map to automatically identify regions of subject motion in the captured frame, wherein automatically correcting for subject motion further comprises creating a binary subject location man to delineate regions of the captured frame for applying correction for subject motion including (a) establishing a threshold difference between the predicted pixel values and the actual pixel values for the first raster field, (b) comparing each pixel in the grayscale image map to the threshold difference, counting the number of pixels exceeding the threshold difference, (c) eliminating from the grayscale image map pixels where three or less neighboring pixels in the grayscale image map are above the threshold difference, and (d) leaving in the grayscale image map pixels where more than three neighboring pixels are above the threshold difference; and displaying an image corrected for camera motion and subject motion.
Claim 10
Dependent Claim
23 words
The method of claim 6 , wherein the threshold difference is in the range from about 20 to about 150 IRE brightness units.
Claim 11
Dependent Claim
15 words
The method of claim 6 , wherein the threshold difference is 80 IRE brightness units.
Claim 12
Dependent Claim
34 words
The method of claim 6 , wherein automatically correcting for subject motion further comprises adjusting the binary subject location map by replacing pixels eliminated from the grayscale image map in regions of subject motion.
Claim 13
Dependent Claim
91 words
The method of claim 9 , the regions of subject motion having pixels eliminated forming boundaries comprising pixels, wherein adjusting the binary subject location map comprises (a) computing a two-dimensional vector from pixels at the boundaries of eliminated regions of subject motion, (b) replacing pixels eliminated from regions of subject motion with the two-dimensional vector, and (c) repeating steps (a) and (b) by computing the two-dimensional vector at locations one pixel further away from the boundaries of the eliminated regions of subject motion to create a corrected image having smooth edges.
Claim 14
Dependent Claim
49 words
The method of claim 10 , wherein computing a two-dimensional vector from pixels at the boundaries of eliminated regions of subject motion comprises identifying boundaries of eliminated regions of subject motion, and detecting pixels in two directions, one pixel at a time, adjacent to the pixels at the boundaries.
Claim 15
Dependent Claim
19 words
The method of claim 10 , wherein automatically correcting for subject motion further comprises computing a finished, corrected image.
Claim 16
Dependent Claim
53 words
The method of claim 12 , wherein computing a finished, corrected image comprises using the adjusted map to indicate regions on the captured frame where subject motion is greatest, and computing a corrected second raster field from a corrected first raster field in regions on the captured frame where subject motion is greatest.
Claim 17
Dependent Claim
19 words
The method of claim 13 , further comprising displaying the finished image corrected for camera motion and subject motion.
Claim 18
Independent Claim
199 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera, comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field, the first and second raster fields each having a plurality of pixels; locating optimal correlation values between pixels in the first raster field and pixels in the second raster field; creating a two-dimensional motion vector from optimal correlation values; creating a synthetic first raster field by duplicating the second raster field in the captured complete frame in a corrected position according to the two-dimensional motion vector; computing a subject motion map to identify regions of the captured frame where differences in pixel values between the first and second raster fields are relatively large; creating a binary subject location map to delineate regions of the captured frame for applying correction for subject motion; eliminating from the binary subject location map pixels where the number of neighboring pixels exceeds a predetermined threshold; adjusting the binary subject location map by replacing eliminated pixels; computing a finished, corrected image; and displaying the image corrected for camera motion and subject motion.
Claim 19
Independent Claim
199 words
A method for automatic correction of motion artifacts in an interlaced video image captured by an image recording camera, comprising: capturing a complete frame of an interlaced video image, the complete frame having a first raster field and an interlaced second raster field, the first and second raster fields each having a plurality of pixels; locating optimal correlation values between pixels in the first raster field and pixels in the second raster field; creating a two-dimensional motion vector from optimal correlation values; creating a synthetic first raster field by duplicating the second raster field in the captured complete frame in a corrected position according to the two-dimensional motion vector; computing a subject motion map to identify regions of the captured frame where differences in pixel values between the first and second raster fields are relatively large; creating a binary subject location map to delineate regions of the captured frame for applying correction for subject motion; eliminating from the binary subject location map pixels where the number of neighboring pixels exceeds a predetermined threshold; adjusting the binary subject location map by replacing eliminated pixels; computing a finished, corrected image; and displaying the image corrected for camera motion and subject motion.
Claim 20
Independent Claim
234 words
A system for automatic correction of motion artifacts in a live, interlaced video image, the system comprising: an image recording camera for capturing complete frames of video images, the complete frames each having a first raster field and an interlaced second raster field, each field comprising a plurality of pixels; a digital capture unit for processing live video images and captured frames of video images; a first filter for automatically correcting for camera motion comprising (a) a two-dimensional motion vector between each pixel in the first raster field and a reference pixel in the second raster field created by auto-correlation of optimal correlation values for each pixel in the first raster field relative to the reference pixel in the second raster field, and (b) a synthetic first raster field created by duplicating the second raster field in a corrected position in the captured complete frame according to the two-dimensional motion vector; a second filter for automatically correcting for subject motion comprising (a) a subject motion map computed to identify regions of subject motion, a binary subject motion map for eliminating pixels in the regions of subject motion, (b) an adjusted binary subject motion map, the binary subject motion map adjusted by replacing eliminated pixels, and (c) a corrected captured frame, the frame corrected by computing a corrected second raster field in regions where subject motion is greatest; and a video monitor for displaying images.
Claim 21
Independent Claim
234 words
A system for automatic correction of motion artifacts in a live, interlaced video image, the system comprising: an image recording camera for capturing complete frames of video images, the complete frames each having a first raster field and an interlaced second raster field, each field comprising a plurality of pixels; a digital capture unit for processing live video images and captured frames of video images; a first filter for automatically correcting for camera motion comprising (a) a two-dimensional motion vector between each pixel in the first raster field and a reference pixel in the second raster field created by auto-correlation of optimal correlation values for each pixel in the first raster field relative to the reference pixel in the second raster field, and (b) a synthetic first raster field created by duplicating the second raster field in a corrected position in the captured complete frame according to the two-dimensional motion vector; a second filter for automatically correcting for subject motion comprising (a) a subject motion map computed to identify regions of subject motion, a binary subject motion map for eliminating pixels in the regions of subject motion, (b) an adjusted binary subject motion map, the binary subject motion map adjusted by replacing eliminated pixels, and (c) a corrected captured frame, the frame corrected by computing a corrected second raster field in regions where subject motion is greatest; and a video monitor for displaying images.
References Cited (Backward Citations)
US4799105A
Cited
US5005126A
Cited
US5099846A
Cited
US5278756A
Cited
US5016102A
Cited
US5212637A
Cited
US5191413A
Cited
US5293313A
Cited
US5903319A
Cited
US5415167A
Cited
US5510834A
Cited
US5430480A
Cited
US5329317A
Cited
US5446501A
Cited
US5666953A
Cited
US5740801A
Cited
US5877819A
Cited
US5878746A
Cited
US5625421A
Cited
US5605531A
Cited
US5682205A
Cited
US5579054A
Cited
US5852475A
Cited
US5920317A
Cited
US6205178B1
Cited
US6115502A
Cited
US5784115A
Cited
US5844613A
Cited
US6269484B1
Cited
US6252975B1
Cited
US6580812B1
Cited
US6628711B1
Cited
US6545719B1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-01-11 | 2008-07-12 | 2009-01-11 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-01-11 | 2012-07-12 | 2013-01-11 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-01-11 | 2016-07-12 | 2017-01-11 | $7700.00 | Window Closed / Lapsed |