← Back to Patent Explorer
US5313306A Expired / Lapsed US ⏱️ 0.0 years remaining

Omniview motionless camera endoscopy system

Assignee: Sony Corp
•
Filing: 1993-06-01
•
Granted: 1994-05-17
•
Expires: 2013-06-01
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A endoscopic-type device for omnidirectional image viewing providing electronic pan-and-tilt orientation, rotation, and magnification within a selected field-of-view for use in applications in various environments such as in internal medicine inspection, monitoring, and surgery. The imaging device (using optical or infrared images) is based on the effect that the image from a wide angle lens, which produces a circular image of an entire field-of-view, can be mathematically corrected using high speed electronic circuitry. More specifically, an incoming image from a endoscope image acquisition source, including a wide angle lens, is transmitted through an image conduit and captured by a camera that produces output signals according to that image. A transformation of these output signals is performed for the viewing region of interest and viewing direction, and a corrected image is output as a video image signal for viewing, recording, or analysis. Multiple simultaneous images can be output from a single input image.

Inventors

  • 👤 Daniel P. Kuban
  • 👤 H. Lee Martin
  • 👤 Steven D. Zimmermann

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-23 20:41
CPC Classifications
H; H04; H04N; H04N7/00; H04N7/18; H04N7/183; A; A61; A61B; A61B1/00; A61B1/00163; A61B1/00174; A61B1/00002; A61B1/00004; A61B1/00006; A61B1/00009; A61B1/00064; A61B1/00071; A61B1/0008; A61B1/00096; A61B1/00183; G; G06; G06F; G06F16/00; G06F16/40; G06T; G06T3/00; G06T3/04; G06T3/047; G06T3/12; G08; G08B; G08B13/00; G08B13/18; G08B13/189; G08B13/194; G08B13/196; G08B13/19617; G08B13/19626; G08B13/19628; G08B13/19678; G08B13/19689; H04N1/00; H04N1/21; H04N1/2104; H04N1/2158; H04N1/2166; H04N1/217; H04N23/00; H04N23/58; H04N23/60; H04N23/698; H04N25/00; H04N5/00; H04N5/222; H04N5/262; H04N5/2628; H04N7/002; A61B90/00; A61B90/08; A61B2090/0813

Claims Analysis

Total Claims: 23
Claim 1
Independent Claim 293 words
A device for providing perspective and distortion corrected views, in a desired format, of a selected portion of a field of view in an environment, said device comprising: an imaging system for receiving selected optical and infrared images of said selected portion of a field of view and for producing output signals corresponding to said selected optical and infrared images, said imaging system including a light source, an image conduit to conduct light from said light source into the environment and return said images from the environment, and a video camera to create said output signals; a lens attached to a distal end of said image conduit of said imaging system, said distal end for placement in the environment, for conveyance of said selected optical and infrared images through said image conduit of said imaging system; image capture circuitry for receiving and providing digitized signals from said output signals from said imaging system; image transform circuitry for processing said digitized signals from said image capture circuitry according to selected viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing output signals according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selected user and external computer input to select said angles of pan, tilt, and rotation and percentage of magnification, and for converting said selected viewing angles of pan, tilt, and rotation and percentage of magnification for input to said image transform circuitry to control said processing of said image transform circuitry; and an output connected to said image transform circuitry for recording said perspective and distortion corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification.
Claim 2
Independent Claim 293 words
A device for providing perspective and distortion corrected views, in a desired format, of a selected portion of a field of view in an environment, said device comprising: an imaging system for receiving selected optical and infrared images of said selected portion of a field of view and for producing output signals corresponding to said selected optical and infrared images, said imaging system including a light source, an image conduit to conduct light from said light source into the environment and return said images from the environment, and a video camera to create said output signals; a lens attached to a distal end of said image conduit of said imaging system, said distal end for placement in the environment, for conveyance of said selected optical and infrared images through said image conduit of said imaging system; image capture circuitry for receiving and providing digitized signals from said output signals from said imaging system; image transform circuitry for processing said digitized signals from said image capture circuitry according to selected viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing output signals according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selected user and external computer input to select said angles of pan, tilt, and rotation and percentage of magnification, and for converting said selected viewing angles of pan, tilt, and rotation and percentage of magnification for input to said image transform circuitry to control said processing of said image transform circuitry; and an output connected to said image transform circuitry for recording said perspective and distortion corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification.
Claim 3
Dependent Claim 270 words
An endoscopy device for providing perspective corrected views of a selected portion of perspective distorted optical images from an environment into a desired format, said device comprising: an imaging system for receiving optical images from the environment and for producing output signals corresponding to said perspective distorted optical images, said imaging system including light source, an image conduit for conveying light from said light source into the environment, a wide angle lens at a distal end of said image conduit in the environment for optical conveyance of said optical images through said image conduit and a video camera positioned exterior the environment to receive images from said lens, said optical images to said video camera being perspective distorted by said wide angle lens; image capture circuitry for receiving, and producing digitized signals from, said output signals from said imaging system; image transform circuitry for processing said digitized signals from said image capture circuitry according to selected viewing angles of pan, tilt, and rotation and percentage of magnification for producing output signals of perspective corrected images according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selecting said viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing signals to control said processing of said image transform circuitry as to said viewing angles of pan, tilt, and rotation and percentage of magnification; and an output connected to said image transform circuitry for recording said perspective corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification.
Claim 4
Dependent Claim 270 words
An endoscopy device for providing perspective corrected views of a selected portion of perspective distorted optical images from an environment into a desired format, said device comprising: an imaging system for receiving optical images from the environment and for producing output signals corresponding to said perspective distorted optical images, said imaging system including light source, an image conduit for conveying light from said light source into the environment, a wide angle lens at a distal end of said image conduit in the environment for optical conveyance of said optical images through said image conduit and a video camera positioned exterior the environment to receive images from said lens, said optical images to said video camera being perspective distorted by said wide angle lens; image capture circuitry for receiving, and producing digitized signals from, said output signals from said imaging system; image transform circuitry for processing said digitized signals from said image capture circuitry according to selected viewing angles of pan, tilt, and rotation and percentage of magnification for producing output signals of perspective corrected images according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selecting said viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing signals to control said processing of said image transform circuitry as to said viewing angles of pan, tilt, and rotation and percentage of magnification; and an output connected to said image transform circuitry for recording said perspective corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification.
Claim 5
Dependent Claim 33 words
The device of claim 2 wherein said imaging system further comprises a video recorder for receiving and recording said output signals of said video camera for selective input to said image transform circuitry.
Claim 6
Dependent Claim 40 words
The device of claim 2 further comprising a further input for inputting control signals to said image transform circuitry to achieve simultaneous multiple perspective corrected views in said output and selected scanning of said perspective corrected views in said output.
Claim 7
Dependent Claim 27 words
The device of claim 4 wherein said input and said further input have selective user inputs including computer keyboard input, voice activated input and touch screen input.
Claim 8
Dependent Claim 39 words
The device of claim 4 wherein said further input includes discrete switches to control said processing of said image transform circuitry, said discrete switches in a keypad, said keypad being sterilizable when said device is utilized for medical purposes.
Claim 9
Dependent Claim 81 words
The device of claim 1 wherein said image transform circuitry is programmed to implement the following two equations: ##EQU7## where: A=(cos φ cos ∂-sin φ sin ∂ cos β) B=(sin φ cos ∂+cos φ sin ∂ cos β) C=(cos φ sin ∂+sin φ cos ∂ cos β) D=(sin φ sin ∂-cos φ cos ∂ cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane φ=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates.
Claim 10
Dependent Claim 81 words
The device of claim 2 wherein said image transform circuitry is programmed to implement the following two equations: ##EQU8## where: A=(cos φ cos ∂-sin φ sin ∂ cos β) B=(sin φ cos ∂+cos φ sin ∂ cos β) C=(cos φ sin ∂+sin φ cos ∂ cos β) D=(sin φ sin ∂-cos φ cos ∂ cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane φ=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates.
Claim 11
Dependent Claim 368 words
An endoscopic device for use in internal medicine to provide perspective corrected views of a selected portion of perspective distorted optical images from an environment within a patient into a desired format, said device comprising: an imaging system for receiving optical images from the environment and for producing output signals corresponding to said perspective distorted optical images, said imaging system including an image conduit, a video camera at a proximal end of said image conduit exterior the environment, a wide angle lens at a distal end of said image conduit for placement within the environment for optical conveyance of said optical images from the environment through said image conduit to said video camera, said optical images to said video camera being perspective distorted by said wide angle lens, said imaging system being sterilizable; image transform circuitry for processing said output signals from said imaging system according to selected viewing angles of pan, tilt, and rotation and percentage of magnification for producing output signals of perspective corrected images according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selecting said viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing signals to control said processing of said image transform circuitry as to said viewing angles of pan, tilt, and rotation and percentage of magnification; and a further input for inputting control signals to said image transform circuitry to achieve multiple perspective corrected views in said output means and selected scanning of said video camera; and an output connected to said image transform circuitry for recording said perspective corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification; wherein said image transform circuitry is programmed to implement the following two equations: ##EQU9## where: A=(cos φ cos ∂-sin φ sin ∂ cos β) B=(sin φ cos ∂+cos φ sin ∂ cos β) C=(cos φ cos ∂+sin φ cos ∂ cos β) D=(sin φ sin ∂-cos φ cos ∂ cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane φ=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates.
Claim 12
Dependent Claim 368 words
An endoscopic device for use in internal medicine to provide perspective corrected views of a selected portion of perspective distorted optical images from an environment within a patient into a desired format, said device comprising: an imaging system for receiving optical images from the environment and for producing output signals corresponding to said perspective distorted optical images, said imaging system including an image conduit, a video camera at a proximal end of said image conduit exterior the environment, a wide angle lens at a distal end of said image conduit for placement within the environment for optical conveyance of said optical images from the environment through said image conduit to said video camera, said optical images to said video camera being perspective distorted by said wide angle lens, said imaging system being sterilizable; image transform circuitry for processing said output signals from said imaging system according to selected viewing angles of pan, tilt, and rotation and percentage of magnification for producing output signals of perspective corrected images according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selecting said viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing signals to control said processing of said image transform circuitry as to said viewing angles of pan, tilt, and rotation and percentage of magnification; and a further input for inputting control signals to said image transform circuitry to achieve multiple perspective corrected views in said output means and selected scanning of said video camera; and an output connected to said image transform circuitry for recording said perspective corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification; wherein said image transform circuitry is programmed to implement the following two equations: ##EQU9## where: A=(cos φ cos ∂-sin φ sin ∂ cos β) B=(sin φ cos ∂+cos φ sin ∂ cos β) C=(cos φ cos ∂+sin φ cos ∂ cos β) D=(sin φ sin ∂-cos φ cos ∂ cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane φ=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates.
Claim 13
Dependent Claim 27 words
The device of claim 9 wherein said input and said further input have selective user inputs including computer keyboard input, voice activated input and touch screen input.
Claim 14
Dependent Claim 31 words
The device of claim 10 wherein said further input includes discrete switches to control said processing of said image transform circuitry, said discrete switches in a keypad, said keypad being sterilizable.
Claim 15
Dependent Claim 31 words
The device of claim 10 wherein said further input comprises discrete switches to input said selected angles of pan, tilt, and rotation and percentage of magnification into said image transform circuitry.
Claim 16
Dependent Claim 23 words
The device of claim 11 further comprising an output line from said image transform circuitry to selectively activate actuating equipment within the environment.
Claim 17
Dependent Claim 27 words
The device of claim 9 wherein said imaging system further comprises a light source to direct light through said image conduit into said environment within the patient.
Claim 18
Dependent Claim 365 words
An endoscopic device for use in confined industrial inspection to provide perspective corrected views of a selected portion of perspective distorted optical images from an environment within an industrial device into a desired format, said device comprising: an imaging system for receiving optical images from the environment and for producing output signals corresponding to said perspective distorted optical images, said imaging system including an image conduit, a video camera at a proximal end of said image conduit exterior the environment, a wide angle lens at a distal end of said image conduit for placement within the environment for optical conveyance of said optical images from the environment through said image conduit to said video camera, said optical images to said video camera being perspective distorted by said wide angle lens; image transform circuitry for processing said output signals from said imaging system according to selected viewing angles of pan, tilt, and rotation and percentage of magnification for producing output signals of perspective corrected images according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selecting said viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing signals to control said processing of said image transform circuitry as to said viewing angles of pan, tilt, and rotation and percentage of magnification; and a further input for inputting control signals to said image transform circuitry to achieve multiple perspective corrected views in said output means and selected scanning of said video camera; and an output connected to said image transform circuitry for recording said perspective corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification; wherein said image transform circuitry is programmed to implement the following two equations: ##EQU10## where: A=(cos φ cos ∂-sin φ sin ∂ cos β) B=(sin φ cos ∂+cos φ sin ∂ cos β) C=(cos φ sin ∂+cos φ cos ∂ cos β) D=(sin φ sin ∂-cos φ cos ∂ cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane φ=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates.
Claim 19
Dependent Claim 365 words
An endoscopic device for use in confined industrial inspection to provide perspective corrected views of a selected portion of perspective distorted optical images from an environment within an industrial device into a desired format, said device comprising: an imaging system for receiving optical images from the environment and for producing output signals corresponding to said perspective distorted optical images, said imaging system including an image conduit, a video camera at a proximal end of said image conduit exterior the environment, a wide angle lens at a distal end of said image conduit for placement within the environment for optical conveyance of said optical images from the environment through said image conduit to said video camera, said optical images to said video camera being perspective distorted by said wide angle lens; image transform circuitry for processing said output signals from said imaging system according to selected viewing angles of pan, tilt, and rotation and percentage of magnification for producing output signals of perspective corrected images according to a combination of said digitized signals and said selected viewing angles of pan, tilt, and rotation and percentage of magnification; an input for selecting said viewing angles of pan, tilt, and rotation and percentage of magnification, and for producing signals to control said processing of said image transform circuitry as to said viewing angles of pan, tilt, and rotation and percentage of magnification; and a further input for inputting control signals to said image transform circuitry to achieve multiple perspective corrected views in said output means and selected scanning of said video camera; and an output connected to said image transform circuitry for recording said perspective corrected views according to said selected viewing angles of pan, tilt, and rotation and percentage of magnification; wherein said image transform circuitry is programmed to implement the following two equations: ##EQU10## where: A=(cos φ cos ∂-sin φ sin ∂ cos β) B=(sin φ cos ∂+cos φ sin ∂ cos β) C=(cos φ sin ∂+cos φ cos ∂ cos β) D=(sin φ sin ∂-cos φ cos ∂ cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane φ=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates.
Claim 20
Dependent Claim 28 words
The device of claim 15 wherein said further input includes discrete switches to control said processing of said image transform circuitry, said discrete switches enclosed in a keypad.
Claim 21
Dependent Claim 31 words
The device of claim 15 wherein said further input comprises discrete switches to input said selected angles of pan, tilt, and rotation and percentage of magnification into said image transform circuitry.
Claim 22
Dependent Claim 23 words
The device of claim 16 further comprising an output line from said image transform circuitry to selectively activate actuating equipment within the environment.
Claim 23
Dependent Claim 28 words
The device of claim 15 wherein said imaging system further comprises a light source to direct light through said image conduit into the environment within the industrial device.

References Cited (Backward Citations)

US4661855A Cited
US4772942A Cited
US4728839A Cited
US4858002A Cited
US4918473A Cited
US4945367A Cited
US5067019A Cited
US5068735A Cited
US5023725A Cited
US5231673A Cited
US5185667A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1997-05-16 1997-11-15 1998-05-17 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2001-05-16 2001-11-15 2002-05-17 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2005-05-16 2005-11-15 2006-05-17 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag