US4895431A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method of processing endoscopic images
Assignee: Olympus Corp
•
Filing: 1987-11-10
•
Granted: 1990-01-23
•
Expires: 2007-11-10
Abstract
Abstract A method of processing images taken by an endoscope having insertion section, bending section and operation section including a step of entering a first image of an object taken by the endoscope having the bending section situated in a first position, a step of entering a second image taken by the endoscope having the bending section situated in a second position, after moving the bending section into the second position by operating an operation member, the first image being partially overlapped with the second image, a step of detecting a positional relation between the first and second positions by detecting the movement of the bending section, a step of deriving a distance between corresponding points on the first and second images, a step of deriving three dimensional information of the object, and a step of displaying a three dimensional image of the object in accordance with the three dimensional information.
Inventors
- 👤 Junpei Tsujiuchi
- 👤 Nagaaki Ohyama
- 👤 Toshio Honda
- 👤 Eric Badique
- 👤 Susumu Kikuchi
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 00:53
CPC Classifications
A; A61; A61B; A61B1/00; A61B1/005; A61B1/0051; A61B1/009; A61B1/04; A61B1/042; G; G02; G02B; G02B23/00; G02B23/24; G02B23/2476; G02B23/2484; H; H04; H04N; H04N13/00; H04N13/20; H04N13/204; H04N13/207; H04N13/221; H04N13/296; A61B1/00163; A61B1/00193; A61M; A61M25/00; A61M25/01; A61M25/0105; A61M25/0133; G06; G06T; G06T2207/00; G06T2207/10; G06T2207/10004; G06T2207/10012; H04N13/10; H04N13/106; H04N13/122; H04N13/15; H04N13/167; H04N13/189; H04N2013/0074; H04N2013/0081; H04N23/00; H04N23/50; H04N23/555; Y; Y10; Y10S; Y10S359/00; Y10S359/90
Claims Analysis
Total Claims: 36
Claim 1
Independent Claim
104 words
A method of processing endoscope images taken by an endoscope having an insertion section, a bending section provided at a distal end of the insertion section and an operation section for controlling a movement of the bending section, comprising the steps of: entering a first endoscopic image of an object taken by the endoscope situated in a first position; entering a second endoscopic image of the object taken by the endoscope situated in a second position; said second endoscopic image being at least partially overlapped with said first endoscopic image; and detecting a positional relation between said first and second positions of the endoscope.
Claim 2
Independent Claim
104 words
A method of processing endoscope images taken by an endoscope having an insertion section, a bending section provided at a distal end of the insertion section and an operation section for controlling a movement of the bending section, comprising the steps of: entering a first endoscopic image of an object taken by the endoscope situated in a first position; entering a second endoscopic image of the object taken by the endoscope situated in a second position; said second endoscopic image being at least partially overlapped with said first endoscopic image; and detecting a positional relation between said first and second positions of the endoscope.
Claim 3
Dependent Claim
23 words
A method according to claim 1, wherein said first and second endoscopic images are taken by moving the bending section of the endoscope.
Claim 4
Dependent Claim
53 words
A method according to claim 2, wherein said bending section of the endoscope is moved by actuating an operation member provided in the operation section which is provided at a proximal end of the insertion section of the endoscope, and said positional relation is detected by detecting a movement of said operation member.
Claim 5
Dependent Claim
49 words
A method according to claim 3, wherein said bending section is moved by rotating an angle handle provided in the operation section, said angle handle being coupled with said bending section via an angle wire, and the positional relation is detected by detecting a rotation of said angle handle.
Claim 6
Dependent Claim
26 words
A method according to claim 4, wherein said positional relation is detected by detecting a rotation of a pattern disc coupled coaxially with the angle handle.
Claim 7
Dependent Claim
19 words
A method according to claim 5, wherein the rotation of said pattern disc is detected by a photoelectric sensor.
Claim 8
Dependent Claim
26 words
A method according to claim 4, wherein said positional relation is detected by detecting the movement of the angle wire on which a pattern is provided.
Claim 9
Dependent Claim
44 words
A method according to claim 2, wherein said bending section is bent at a single position such that a direction of an optical axis of an objective lens provided in a distal end of the bending section with respect to the object is changed.
Claim 10
Dependent Claim
44 words
A method according to claim 2, wherein said bending section is bent at two positions such that a direction of an optical axis of an objective lens provided in a distal end of the bending section with respect to the object is remained unchanged.
Claim 11
Independent Claim
120 words
A method of processing endoscopic images taken by an endoscope having an insertion section, a bending section provided at a distal end of the insertion section, and an operation section for controlling a movement of the bending section, comprising the steps of: entering a first endoscopic image of an object taken by the endoscope in a first position; entering a second endoscopic image of the object taken by the endoscope in a second position, said second endoscopic image being at least partially overlapped with said first endoscopic image; detecting a positional relation between said first and second endoscopic images; and processing said first and second endoscopic images in accordance with said positional relation to derive geometric information of the object.
Claim 12
Independent Claim
120 words
A method of processing endoscopic images taken by an endoscope having an insertion section, a bending section provided at a distal end of the insertion section, and an operation section for controlling a movement of the bending section, comprising the steps of: entering a first endoscopic image of an object taken by the endoscope in a first position; entering a second endoscopic image of the object taken by the endoscope in a second position, said second endoscopic image being at least partially overlapped with said first endoscopic image; detecting a positional relation between said first and second endoscopic images; and processing said first and second endoscopic images in accordance with said positional relation to derive geometric information of the object.
Claim 13
Dependent Claim
33 words
A method according to claim 10, wherein said processing step comprises a step of deriving a shift amount represented by a distance between corresponding two points on the first and second endoscopic images.
Claim 14
Dependent Claim
25 words
A method according to claim 11, wherein said distance is detected by deriving a correlation between small regions in the first and second endoscopic images.
Claim 15
Dependent Claim
22 words
A method according to claim 12, wherein prior to deriving the correlation, distortion of the first and second endoscopic images is corrected.
Claim 16
Dependent Claim
25 words
A method according to claim 13, wherein after the distortion of the endoscopic images has been corrected, the endoscopic images are subjected to an interpolation.
Claim 17
Dependent Claim
18 words
A method according to claim 14, wherein said interpolation is carried out in accordance with a b-spline function.
Claim 18
Dependent Claim
19 words
A method according to claim 12, wherein said correlation is detected with the aid of an electronic correlation calculator.
Claim 19
Dependent Claim
92 words
A method according to claim 16, wherein said step of detecting the correlation comprises a step of deriving correlation values of first regions in the first and second endoscopic images, a step of selecting first regions whose correlation values exceed a predetermined threshold value, a step of deriving correlation values of second regions which are smaller than said first regions in selected first regions, a step of detecting a second region having the maximum correlation value, and a step of deriving an address of the second region having the maximum correlation value.
Claim 20
Dependent Claim
65 words
A method according to claim 16, wherein said correlation is calculated in accordance with the following equation, ##EQU13## wherein f·g is an average of a product of the first and second images f and g, e,ovs/f/ ·e,ovs/g/ is a product of an average of f and a average of g, and σ f and σ g are standard deviations of the images f and g.
Claim 21
Dependent Claim
25 words
A method according to claim 12, wherein prior to deriving the correlation, the first and second endoscopic images are subjected to a spatial frequency filtering.
Claim 22
Dependent Claim
46 words
A method according to claim 12, wherein each of said first and second endoscopic images is subjected to Fourier transformation and spatial frequency filtering, successively, and output signals derived by the spatial frequency filtering are multiplied, and a multiplied signal is subjected to inverse Fourier transformation.
Claim 23
Dependent Claim
28 words
A method according to claim 19 or 20, wherein said spatial frequency filtering is carried out by extracting high frequency components of the first and second endoscopic images.
Claim 24
Dependent Claim
20 words
A method according to claim 21 wherein the high frequency components are extracted with the aid of a Laplacian filter.
Claim 25
Dependent Claim
27 words
A method according to claim 19 or 20, wherein said spatial frequency filtering is effected by extracting low frequency components in the first and second endoscopic images.
Claim 26
Dependent Claim
20 words
A method according to claim 23, wherein the low frequency components are extracted with the aid of an averaging filter.
Claim 27
Dependent Claim
50 words
A method according to claim 16, wherein the correlation value C is derived by the following equation; ##EQU14## wherein F -1 represents the inverse Fourier transformation, F and G* are Fourier transformations of the first and second endoscopic images and |F| and |G| are absolute values of F and G*.
Claim 28
Dependent Claim
19 words
A method according to claim 12, wherein said correlation is detected with the aid of an optical correlation calculator.
Claim 29
Dependent Claim
67 words
A method according to claim 26, wherein the step of detecting the distance comprises producing a holographic film containing a part of the first endoscopic image, forming a superimposed image of an image of a part of said holographic film and of an image of a part of the second endoscopic image, and detecting a position of a point having maximum light intensity in said superimposed image.
Claim 30
Dependent Claim
50 words
A method according to claim 27, wherein said holographic film is produced by projecting an image of said part of the first endoscopic image borne on a photographic film onto a raw photographic film together with reference light, and by developing the raw photographic film to provide said holographic film.
Claim 31
Dependent Claim
61 words
A method according to claim 27, wherein said holographic film is produced by displaying an incoherent image of the first endoscopic image on a display device, converting the incoherent image into a coherent image, projecting a part of the coherent image onto a raw photographic film together with reference light, and developing the raw photographic film to provide said holographic film.
Claim 32
Dependent Claim
30 words
A method according to claim 11, wherein said processing step comprises a step of calculating a height of a relevant point of the object in accordance with the shift amount.
Claim 33
Dependent Claim
29 words
A method according to claim 11, wherein said processing step comprises a step of calculating a distance between two points on the object in accordance with the shift amount.
Claim 34
Dependent Claim
36 words
A method according to claim 10, further comprising a step of displaying the first and second endoscopic images, a gray image representing depressions and protrusions of the object, and a three dimensional image of the object.
Claim 35
Dependent Claim
27 words
A method according to claim 32, wherein said displaying step comprises displaying a distance between two points on a displayed image, said points being indicated by cursors.
Claim 36
Dependent Claim
28 words
A method according to claim 32, wherein said displaying step comprises displaying a height of a point on a displayed image, said point being denoted by a cursor.
References Cited (Backward Citations)
US3507549A
Cited
US4094011A
Cited
US4174179A
Cited
US4637056A
Cited
DE3412533A1
Cited
US4697210A
Cited
US4702229A
Cited
US4669054A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1993-01-22 | 1993-07-24 | 1994-01-23 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 1997-01-22 | 1997-07-24 | 1998-01-23 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2001-01-22 | 2001-07-24 | 2002-01-23 | $7700.00 | Window Closed / Lapsed |