US7232409B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for displaying endoscopic images
Assignee: EndActive Inc
•
Filing: 2003-11-20
•
Granted: 2007-06-19
•
Expires: 2023-11-20
Abstract
Abstract A method is disclosed for displaying endoscopic images that includes three-dimensional surfaces, variable viewing points, directions, and orientations. A computer receives a captured endoscopic image. A virtual surface is defined in the computer with the captured image textured onto the virtual surface. A virtual viewing point, virtual viewing direction, and virtual viewing orientation are defined relative to the virtual surface. A rendered image of the virtual surface is then created. The rendered image is displayed to the user. Video is displayed on the virtual surface by updating the image texture with each new frame.
Inventors
- 👤 Eric Lawrence Hale
- 👤 Nathan Jon Schara
- 👤 Hans David Hoeg
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 21:50
CPC Classifications
A; A61; A61B; A61B1/00; A61B1/00002; A61B1/00043; A61B1/00045; A61B1/00004; A61B1/00009; G; G06; G06T; G06T3/00; G06T3/04; G06T3/047
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
132 words
A method for providing images of a viewed surface to a user, the method comprising: moving an endoscope relative to a real surface which provides an endoscope view; using the endoscope to acquire an image of the real surface; providing a virtual surface approximating the topography of the real surface; mapping the acquired image onto the virtual surface; establishing a second viewing position relative to the real surface that represents a view different than the endoscope view; determining position data indicating the difference between the endoscope view and the view from the second viewing position as the endoscope moves; using the mapped virtual surface and the position data to render an image representing a view of the real surface from the second viewing position; and providing the rendered image to the user.
Claim 2
Independent Claim
132 words
A method for providing images of a viewed surface to a user, the method comprising: moving an endoscope relative to a real surface which provides an endoscope view; using the endoscope to acquire an image of the real surface; providing a virtual surface approximating the topography of the real surface; mapping the acquired image onto the virtual surface; establishing a second viewing position relative to the real surface that represents a view different than the endoscope view; determining position data indicating the difference between the endoscope view and the view from the second viewing position as the endoscope moves; using the mapped virtual surface and the position data to render an image representing a view of the real surface from the second viewing position; and providing the rendered image to the user.
Claim 3
Dependent Claim
53 words
The method of claim 1 , wherein at least the steps of using the endoscope to acquire an image, mapping the acquired image onto the virtual surface, and using the mapped virtual surface and the position data to render an image are repeated when the endoscope is moved relative to the real surface.
Claim 4
Dependent Claim
17 words
The method of claim 1 , wherein the image is one of a series of video images.
Claim 5
Dependent Claim
16 words
The method of claim 1 , wherein the topographical approximation is based on volumetric scan data.
Claim 6
Dependent Claim
15 words
The method of claim 1 , wherein the topographical approximation is based on stereo imaging.
Claim 7
Dependent Claim
17 words
The method of claim 1 , wherein the second viewing position represents the position of a user.
Claim 8
Dependent Claim
14 words
The method of claim 1 , wherein the virtual surface represents an anatomical object.
Claim 9
Dependent Claim
12 words
The method of claim 1 , wherein the virtual surface is planar.
Claim 10
Dependent Claim
66 words
The method of claim 1 , wherein the position of the endoscope is represented by a first viewing set including a scope viewing point, a scope viewing direction, and a scope orientation relative to the real surface, and the second position is represented by a second viewing set including a virtual viewing point, a virtual viewing direction, and a virtual orientation corresponding to the second position.
Claim 11
Dependent Claim
23 words
The method of claim 1 , wherein a virtual viewing point is arranged in a manner generally corresponding to an endoscopic viewing point.
Claim 12
Dependent Claim
26 words
The method of claim 1 , wherein a virtual viewing point is arranged in a manner generally corresponding to an actual viewing point of a user.
Claim 13
Dependent Claim
26 words
The method of claim 1 , wherein a virtual viewing direction is directed in a manner generally corresponding to an actual viewing direction of a user.
Claim 14
Dependent Claim
26 words
The method of claim 1 , wherein a virtual viewing orientation is oriented in a manner generally corresponding to an actual viewing orientation of a user.
Claim 15
Dependent Claim
23 words
The method of claim 1 , wherein the image is mapped onto the virtual surface according to a mapping that adjusts for distortion.
Claim 16
Independent Claim
129 words
An apparatus for providing images of a viewed surface to a user, comprising: an endoscope providing an endoscope view that captures an image of a real surface when moved relative to the real surface; a processor that creates a virtual surface approximating the topography of the real surface, maps the image acquired by said endoscope onto the virtual surface, determines position data indicating the difference between the endoscope view and a view from a second viewing position relative the real surface different than the endoscope view as the endoscope moves, and uses the mapped virtual surface and the position data to render an image representing a view of the real surface from the second viewing position; and a monitor in communication with said computer that displays the rendered image.
Claim 17
Independent Claim
129 words
An apparatus for providing images of a viewed surface to a user, comprising: an endoscope providing an endoscope view that captures an image of a real surface when moved relative to the real surface; a processor that creates a virtual surface approximating the topography of the real surface, maps the image acquired by said endoscope onto the virtual surface, determines position data indicating the difference between the endoscope view and a view from a second viewing position relative the real surface different than the endoscope view as the endoscope moves, and uses the mapped virtual surface and the position data to render an image representing a view of the real surface from the second viewing position; and a monitor in communication with said computer that displays the rendered image.
Claim 18
Dependent Claim
39 words
The apparatus of claim 15 , wherein, each time the endoscope acquires a new image, the processor maps the new image onto the virtual surface and uses the mapped virtual surface and the position data to render another image.
Claim 19
Dependent Claim
16 words
The method of claim 15 wherein the image is one of a series of video images.
Claim 20
Independent Claim
137 words
A method for providing images of a viewed surface to a user, the method comprising: inserting an endoscope into a cavity; moving the endoscope relative to a real surface which provides an endoscope view; using the endoscope to acquire an image of the real surface; providing a virtual surface approximating the topography of the real surface; mapping the acquired image onto the virtual surface; establishing a second viewing position representing a view different than the endoscope view relative to the real surface; determining position data indicating the difference between the endoscope view and the view from the second viewing position as the endoscope moves; using the mapped virtual surface and the position data to render an image representing a view of the real surface from the second viewing position; and providing the rendered image to the user.
Claim 21
Independent Claim
137 words
A method for providing images of a viewed surface to a user, the method comprising: inserting an endoscope into a cavity; moving the endoscope relative to a real surface which provides an endoscope view; using the endoscope to acquire an image of the real surface; providing a virtual surface approximating the topography of the real surface; mapping the acquired image onto the virtual surface; establishing a second viewing position representing a view different than the endoscope view relative to the real surface; determining position data indicating the difference between the endoscope view and the view from the second viewing position as the endoscope moves; using the mapped virtual surface and the position data to render an image representing a view of the real surface from the second viewing position; and providing the rendered image to the user.
Claim 22
Dependent Claim
52 words
The method of claim 18 wherein at least the steps of using the endoscope to acquire an image, mapping the acquired image onto the virtual surface, and using the mapped virtual surface and the position data to render an image are repeated when the endoscope is moved relative to the real surface.
Claim 23
Dependent Claim
17 words
The method of claim 18 , wherein the image is one of a series of video images.
References Cited (Backward Citations)
US3572325A
Cited
US3880148A
Cited
US4697577A
Cited
US5307804A
Cited
US5313306A
Cited
US5230623A
Cited
US5515160A
Cited
US5704897A
Cited
US5661519A
Cited
US5623560A
Cited
JPH06269403A
Cited
US5920395A
Cited
US5899851A
Cited
WO1995001749A1
Cited
US5531227A
Cited
US5976076A
Cited
US5617857A
Cited
US5995108A
Cited
US5776050A
Cited
US5638819A
Cited
US6007484A
Cited
US6167296A
Cited
US5677763A
Cited
US20020045855A1
Cited
US5954634A
Cited
US6097423A
Cited
US6135946A
Cited
US6283918B1
Cited
US6371909B1
Cited
US6500115B2
Cited
US6139499A
Cited
US20020161280A1
Cited
US6471637B1
Cited
US20050027167A1
Cited
US20050020883A1
Cited
WO2001022865A1
Cited
US6443894B1
Cited
US6505065B1
Cited
US6464631B1
Cited
US6442417B1
Cited
US6695774B2
Cited
US20020099263A1
Cited
US20030016883A1
Cited
US6648817B2
Cited
US20050228250A1
Cited
US20040127769A1
Cited
US6663559B2
Cited
US20040210105A1
Cited
US20050015005A1
Cited
US20050054895A1
Cited
US20050085718A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2010-06-18 | 2010-12-18 | 2011-06-19 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2014-06-18 | 2014-12-18 | 2015-06-19 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2018-06-18 | 2018-12-18 | 2019-06-19 | $7700.00 | Window Closed / Lapsed |