Patent US4626797A successfully refreshed from Google Patents.
Patent US5751340A successfully refreshed from Google Patents.
US5751340A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for reducing the inherently dark grid pattern from the video display of images from fiber optic bundles
Assignee: Karl Storz SE and Co KG
•
Filing: 1996-08-21
•
Granted: 1998-05-12
•
Expires: 2016-08-21
Abstract
Abstract A method and apparatus for improving an image received from a endoscope having a flexible fiber optic bundle that produces an interstitial grid overlay due to the dead space between each fiber pixel. The interstitial grid pattern in the image, is substantially eliminated by processing the image through a linear digital filter to attenuate the first-order spatial frequency components that contribute most to the interstitial pattern. The filter employs relatively small convolution kernels that are optimized for specific fiber spacing. The image is then processed through the linear digital filter by convolving the respective pixels in the image by the derived coefficients. The image is improved and the grid pattern may also be reduced by a dilation process which involves processing the image through a dilation algorithm to "grow" the bright center of each fiber pixel in the image so that the effect of the grid pattern is reduced. The process involves filling in the dark area of the grid space with the color and intensity from the nearest fiber center to obtain an equivalent image representation. The dilation process uses a non-linear image processing algorithm to replace each pixel with the maximum pixel brightness in its immediate neighborhood depending on the selection of a kernel. The dilation kernel is selected by determining the number of detector (CCD) pixels that fit in a space between the fiber cores and then selecting a matrix size and kernel pattern.
Inventors
- 👤 Karlheinz Strobl
- 👤 Bryan D. Kennedy
- 👤 David Chatenever
- 👤 Klaus Irion
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 20:41
CPC Classifications
H; H04; H04N; H04N25/00; H04N25/60; H04N25/61; A; A61; A61B; A61B1/00; A61B1/00163; A61B1/00165; H04N23/00; H04N23/50; H04N23/55; H04N23/555; H04N23/80; H04N23/81; A61B1/04; A61B1/042; H04N5/00; H04N5/14; H04N5/21
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
213 words
In combination with an endoscope and a video display, said video display having an array of pixels for displaying purposes, said endoscope including an objective lens at its distal end and a fiber optic bundle for transmitting an image to a CCD camera at it proximal end; said fiber optic bundle comprising a substantial number of optical fibers each with distal and proximal ends, the ends of said fibers forming an array which is identical at both of said ends of said bundle, whereby to forward an image from said lens to said camera, each said fiber consisting of a central light-transmitting core and a peripheral cladding, said fibers being clustered so as to form voids between groups of contacting fibers, said claddings and said voids being non-transmissive of light so as to form a visible dark grid encompassing said light-transmissive cores; said camera having arrays of pixels at photo sites on said camera respective to pixels on said display, the improvement comprising; grid reduction means receiving pixel signals from said camera and generating respective enhanced signals for said display, said grid reduction means comprising circuitry which adjusts the color and intensity of the signal generated by the CCD respective to pixels in said grid, thereby to reduce the prominence of said grid.
Claim 2
Dependent Claim
213 words
In combination with an endoscope and a video display, said video display having an array of pixels for displaying purposes, said endoscope including an objective lens at its distal end and a fiber optic bundle for transmitting an image to a CCD camera at it proximal end; said fiber optic bundle comprising a substantial number of optical fibers each with distal and proximal ends, the ends of said fibers forming an array which is identical at both of said ends of said bundle, whereby to forward an image from said lens to said camera, each said fiber consisting of a central light-transmitting core and a peripheral cladding, said fibers being clustered so as to form voids between groups of contacting fibers, said claddings and said voids being non-transmissive of light so as to form a visible dark grid encompassing said light-transmissive cores; said camera having arrays of pixels at photo sites on said camera respective to pixels on said display, the improvement comprising; grid reduction means receiving pixel signals from said camera and generating respective enhanced signals for said display, said grid reduction means comprising circuitry which adjusts the color and intensity of the signal generated by the CCD respective to pixels in said grid, thereby to reduce the prominence of said grid.
Claim 3
Dependent Claim
34 words
Apparatus according to claim 1 in which said circuit means adjusts the output signal of each camera pixel as a function of the color and intensity of at least some near neighboring camera pixels.
Claim 4
Dependent Claim
35 words
Apparatus according to claim 2 in which the intensity of the signal received from the camera is adjusted to the color and intensity of the most intense one of a group of nearby camera pixels.
Claim 5
Dependent Claim
29 words
Apparatus according to claim 3 in which said group of nearby covered pixels comprises a matrix array of surrounding camera pixels of a rectangular array including said respective pixel.
Claim 6
Dependent Claim
20 words
Apparatus according to claim 3 in which said matrix array is a symmetric matrix array which includes said respective pixel.
Claim 7
Dependent Claim
27 words
Apparatus according to claim 1 in which said circuit means comprises filter means which alternates the frequency components of the spatial frequencies which comprise the grid pattern.
Claim 8
Dependent Claim
46 words
Apparatus according to claim 6 in which said filter means comprises a convolver which multiplies the respective pixels in a sequence by respective stored values and sums the multiplied outputs to uniformly increase the intensity of respective pixels in said sequence thereby attenuating said grid pattern.
Claim 9
Dependent Claim
18 words
Apparatus according to claim 7 in which said respective stored values are coefficients of values in a kernel.
Claim 10
Dependent Claim
14 words
Apparatus according to claim 8 in which said kernel is a 3×7 stage array.
Claim 11
Dependent Claim
35 words
Apparatus according to claim 9 in which each pixel is multiplied by a coefficient derived from each stage in said array and added to the output of a previous stage and summed at an output.
Claim 12
Dependent Claim
19 words
Apparatus according to claim 10 in which said kernel is shafted a predetermined amount often processing each pixel sequence.
Claim 13
Dependent Claim
14 words
Apparatus according to claim 11 in which said filter means filters the luminance signal.
Claim 14
Dependent Claim
28 words
Apparatus according to claim 11 in which said filter means comprises a filter in the luminance channel and in both chroma channels or in red, green, blue channels.
Claim 15
Dependent Claim
25 words
Apparatus according to claim 13 including field and frame memory control means for controlling the field mode or frame mode input to said filter means.
Claim 16
Independent Claim
60 words
A method of improving an endoscope image received through a fiber optic bundle to remove said interstitial grid pattern comprising; converting said endoscope image to a digital image signal; processing said digital image signal to generate respective enhanced pixel signals; converting said processed digital signal image to a switchable color output signal; whereby said interstitial grid pattern is substantially removed.
Claim 17
Independent Claim
60 words
A method of improving an endoscope image received through a fiber optic bundle to remove said interstitial grid pattern comprising; converting said endoscope image to a digital image signal; processing said digital image signal to generate respective enhanced pixel signals; converting said processed digital signal image to a switchable color output signal; whereby said interstitial grid pattern is substantially removed.
Claim 18
Dependent Claim
28 words
The method according to claim 15 in which said processing comprises linear digital filtering of said digital image to remove the spatial frequencies composing said interstitial grid pattern.
Claim 19
Dependent Claim
76 words
The method according to claim 16 in which said linear digital filtering comprises; selecting a kernel having predetermined elements from a ratio of the pixel to fiber spacing of said fiber optic bundle; calculating the coefficient of the elements in said kernel; sequentially multiplying the pixels in said digital image by each of said coefficients in said kernel and summing said multiplied values whereby relative pixel brightness is enhanced and said interstitial pattern is substantially valued.
Claim 20
Dependent Claim
11 words
The method according to claim 17 including selecting 3×7 element kernel.
Claim 21
Dependent Claim
30 words
The method according to claim 18 in which each pixel is sequentially multiplied by each coefficient, added to the value of the previous multiplied pixel and summed at the output.
Claim 22
Dependent Claim
20 words
The method according to claim 16 in which said linear digital filtering comprises processing said digital image in a convolver.
Claim 23
Dependent Claim
12 words
The method according to claim 20 comprising processing only the luminance signal.
Claim 24
Dependent Claim
27 words
The method according to claim 15 comprising dilating respective pixels in said digital image signal to improve the overall brightness and substantially eliminate the interstitial grid pattern.
Claim 25
Dependent Claim
26 words
The method according to claim 22 comprising dilating respective pixels by replacing each pixel with the maximum pixel brightness of a pixel in the immediate neighborhood.
Claim 26
Dependent Claim
23 words
The method according to claim 23 comprises selecting a kernel of pixels; processing each pixel of said kernel in an image processing algorithm.
Claim 27
Dependent Claim
71 words
The method according to claim 24 comprising selecting an optimum kernel by determining the ratio of detector pixels to the space between fiber cores of said fiber optic bundle; select a matrix size relative to said ratio; set all coefficients of said kernel used for dilation to one; whereby said image processing algorithm replaces the brightness of each pixel with the brightness of a nearby brightest pixel in said kernel domain.
Claim 28
Dependent Claim
16 words
The method according to claim 25 in which said selected kernel domain is a symmetric matrix.
Claim 29
Dependent Claim
18 words
The method according to claim 26 in which said symmetric matrix is between 3×3 and 6×6 symmetric matrix.
References Cited (Backward Citations)
US4480636A
Cited
US4633303A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-05-11 | 2001-11-10 | 2002-05-12 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-05-11 | 2005-11-10 | 2006-05-12 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-05-11 | 2009-11-10 | 2010-05-12 | $7700.00 | Window Closed / Lapsed |