USRE36207E
Expired / Lapsed
US
⏱️ 0.0 years remaining
Omniview motionless camera orientation system
Assignee: Sony Corp
•
Filing: 1996-07-12
•
Granted: 1999-05-04
•
Expires: 2016-07-12
Abstract
Abstract A device for omnidirectional image viewing providing pan-and-tilt orientation, rotation, and magnification within a hemispherical field-of-view that utilizes no moving parts. The imaging device is based on the effect that the image from a fisheye lens, which produces a circular image of at entire hemispherical field-of-view, which can be mathematically corrected using high speed electronic circuitry. More specifically, an incoming fisheye image from any image acquisition source is captured in memory of the device, a transformation is performed for the viewing region of interest and viewing direction, and a corrected image is output as a video image signal for viewing, recording, or analysis. As a result, this device can accomplish the functions of pan, tilt, rotation, and zoom throughout a hemispherical field-of-view without the need for any mechanical mechanisms. The preferred embodiment of the image transformation device can provide corrected images at real-time rates, compatible with standard video equipment. The device can be used for any application where a conventional pan-and-tilt or orientation mechanism might be considered including inspection, monitoring, surveillance, and target acquisition.
Inventors
- 👤 Steven D. Zimmermann
- 👤 H. Lee Martin
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 20:41
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/04; G06T3/047; G06T3/12; G08; G08B; G08B13/00; G08B13/18; G08B13/189; G08B13/194; G08B13/196; G08B13/19617; G08B13/19626; G08B13/19628; H; H04; H04N; H04N1/00; H04N1/21; H04N1/2104; H04N1/2158; H04N1/2166; H04N1/217; H04N23/00; H04N23/58; H04N23/60; H04N23/698; H04N25/00; H04N5/00; H04N5/222; H04N5/262; H04N5/2628; H04N7/00; H04N7/002; H04N7/18; H04N7/183; A; A61; A61B; A61B90/00; A61B90/08; A61B2090/0813; G03; G03B; G03B37/00; G03B37/06
Claims Analysis
Total Claims: 14
Claim 1
Independent Claim
236 words
A device for providing perspective corrected views of a selected portion of a hemispherical view in a desired format that utilizes no moving parts, which comprises: a camera imaging system for receiving optical images and for producing output signals corresponding to said optical images; fisheye lens means attached to said camera imaging system for producing said optical images, throughout said hemispherical field-of-view, for optical conveyance to said camera imaging system; image capture means for receiving said output signals from said camera imaging system and for digitizing said output signals from said camera imaging system; input image memory means for receiving said digitized signals; image transform processor means for processing said digitized signals in said input image memory means according to selected viewing angles and magnification, and for producing output transform calculation signals according to a combination of said digitized signals, said selected viewing angles and said selected magnification; output image memory means for receiving said output signals from said image transform processor means; input means for selecting said viewing angles and magnification; microprocessor means for receiving said selected viewing angles and magnification from said input means and for converting said selected viewing angles and magnification for input to said image transform processor means to control said processing of said transform processor means; and output means connected to said output image memory means for recording said perspective corrected view according to said selected viewing angles and magnification.
Claim 2
Independent Claim
236 words
A device for providing perspective corrected views of a selected portion of a hemispherical view in a desired format that utilizes no moving parts, which comprises: a camera imaging system for receiving optical images and for producing output signals corresponding to said optical images; fisheye lens means attached to said camera imaging system for producing said optical images, throughout said hemispherical field-of-view, for optical conveyance to said camera imaging system; image capture means for receiving said output signals from said camera imaging system and for digitizing said output signals from said camera imaging system; input image memory means for receiving said digitized signals; image transform processor means for processing said digitized signals in said input image memory means according to selected viewing angles and magnification, and for producing output transform calculation signals according to a combination of said digitized signals, said selected viewing angles and said selected magnification; output image memory means for receiving said output signals from said image transform processor means; input means for selecting said viewing angles and magnification; microprocessor means for receiving said selected viewing angles and magnification from said input means and for converting said selected viewing angles and magnification for input to said image transform processor means to control said processing of said transform processor means; and output means connected to said output image memory means for recording said perspective corrected view according to said selected viewing angles and magnification.
Claim 3
Dependent Claim
29 words
The device of claim 1 wherein said output means includes image display means for providing a perspective corrected image display according to said selected viewing angle and said magnification.
Claim 4
Dependent Claim
26 words
The device of claim 1 wherein said input means further provides for input of a selected portion of said hemispherical view to said transform processor means.
Claim 5
Dependent Claim
24 words
The device of claim 1 wherein said input means further provides for input of a selected tilting of said viewing angle through 180 degrees.
Claim 6
Dependent Claim
30 words
The device of claim 1 wherein said input means further provides for input of a selected rotation of said viewing angle through 360 degrees to achieve said perspective corrected view.
Claim 7
Dependent Claim
24 words
The device of claim 1 wherein said input means further provides for input of a selected pan of said viewing angle through 180 degrees.
Claim 8
Dependent Claim
24 words
The device of claim 1 wherein said output transform calculation signals of said image transform processor means are produced in real-time at video rates.
Claim 9
Dependent Claim
15 words
The device of claim 1 wherein said input means is a user-operated manipulator switch means.
Claim 10
Dependent Claim
87 words
The device of claim 1 wherein said image transform processor means is programmed to implement the following two equations: ##EQU7## where: A=(cos .O slashed. cos ∂-sin .O slashed. sin ∂cos β) B=(sin .O slashed. cos ∂+cos .O slashed. sin ∂cos β) C=(cos .O slashed. sin ∂+sin .O slashed. cos ∂cos β) D=(sin .O slashed. sin ∂-cos .O slashed. cos ∂cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane .O slashed.=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates
Claim 11
Independent Claim
296 words
A device for providing perspective corrected views of a selected portion of a hemispherical view in a desired format that utilizes no moving parts, which comprises: a camera imaging system for receiving optical images and for producing output signals corresponding to said optical images; fisheye lens means attached to said camera imaging system for producing said optical images, throughout said hemispherical field-of-view, for optical conveyance to said camera imaging system; image capture means for receiving said output signals from said camera imaging system and for digitizing said output signals from said camera imaging system; input image memory means for receiving said digitized signals; image transform processor means for processing said digitized signals in said input image memory means according to selected viewing angles and magnification, and for producing output signals, said selected viewing angles and said selected magnification, according to the equations; ##EQU8## where: A=(cos .O slashed. cos ∂-sin .O slashed. sin ∂cos β) B=(sin .O slashed. cos ∂+cos .O slashed. sin ∂cos β) C=(cos .O slashed. sin ∂+sin .O slashed. cos ∂cos β) D=(sin .O slashed. sin ∂-cos .O slashed. cos ∂cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane .O slashed.=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates output image memory means for receiving said output signals from said image transform processor means; input means for selecting said viewing angles and magnification; microprocessor means for receiving said selected viewing angles and magnification from said input means and for converting said selected viewing and magnification for input to said image transform processor means to control said processing of said transform processor means; and output means connected to said output image means for recording said perspective corrected views according to said selected viewing angles and implementation.
Claim 12
Independent Claim
296 words
A device for providing perspective corrected views of a selected portion of a hemispherical view in a desired format that utilizes no moving parts, which comprises: a camera imaging system for receiving optical images and for producing output signals corresponding to said optical images; fisheye lens means attached to said camera imaging system for producing said optical images, throughout said hemispherical field-of-view, for optical conveyance to said camera imaging system; image capture means for receiving said output signals from said camera imaging system and for digitizing said output signals from said camera imaging system; input image memory means for receiving said digitized signals; image transform processor means for processing said digitized signals in said input image memory means according to selected viewing angles and magnification, and for producing output signals, said selected viewing angles and said selected magnification, according to the equations; ##EQU8## where: A=(cos .O slashed. cos ∂-sin .O slashed. sin ∂cos β) B=(sin .O slashed. cos ∂+cos .O slashed. sin ∂cos β) C=(cos .O slashed. sin ∂+sin .O slashed. cos ∂cos β) D=(sin .O slashed. sin ∂-cos .O slashed. cos ∂cos β) and where: R=radius of the image circle β=zenith angle ∂=Azimuth angle in image plane .O slashed.=Object plane rotation angle m=Magnification u,v=object plane coordinates x,y=image plane coordinates output image memory means for receiving said output signals from said image transform processor means; input means for selecting said viewing angles and magnification; microprocessor means for receiving said selected viewing angles and magnification from said input means and for converting said selected viewing and magnification for input to said image transform processor means to control said processing of said transform processor means; and output means connected to said output image means for recording said perspective corrected views according to said selected viewing angles and implementation.
Claim 13
Independent Claim
252 words
A device for providing perspective corrected views of a selected portion or a hemispherical view in a desired format that utilizes no moving parts, which comprises: a camera imaging system for receiving optical images and for producing output signals corresponding to said optical images; fisheye lens means attached to said camera imaging system for producing said optical images, throughout said hemispherical field-of-view, for optical conveyance to said camera imaging system; image capture means for receiving said output signals from said camera imaging system and for digitizing said output signals from said camera imaging system; input image memory means for receiving said digitized signals; image transform processor means for processing said digitized signals in said input image memory means according to selected viewing angles and magnification, and for producing output transform calculation signals in real-time at video rates according to a combination of said digitized signals, said viewing angles and said selected magnification; user operated input means for selecting said viewing angles and magnification; microprocessor means for receiving said selected viewing angles and magnification from said user operated input means and for converting said selected viewing angles and magnification for input to said image transform processor means to control said processing of said transform processor means; output image memory means for receiving said output transform calculation signals in real-time and at video rates from said image transform processor means; and output means connected to said output image memory means for recording said perspective corrected views according to said selected viewing angles and magnification.
Claim 14
Independent Claim
252 words
A device for providing perspective corrected views of a selected portion or a hemispherical view in a desired format that utilizes no moving parts, which comprises: a camera imaging system for receiving optical images and for producing output signals corresponding to said optical images; fisheye lens means attached to said camera imaging system for producing said optical images, throughout said hemispherical field-of-view, for optical conveyance to said camera imaging system; image capture means for receiving said output signals from said camera imaging system and for digitizing said output signals from said camera imaging system; input image memory means for receiving said digitized signals; image transform processor means for processing said digitized signals in said input image memory means according to selected viewing angles and magnification, and for producing output transform calculation signals in real-time at video rates according to a combination of said digitized signals, said viewing angles and said selected magnification; user operated input means for selecting said viewing angles and magnification; microprocessor means for receiving said selected viewing angles and magnification from said user operated input means and for converting said selected viewing angles and magnification for input to said image transform processor means to control said processing of said transform processor means; output image memory means for receiving said output transform calculation signals in real-time and at video rates from said image transform processor means; and output means connected to said output image memory means for recording said perspective corrected views according to said selected viewing angles and magnification.
References Cited (Backward Citations)
EP0011909A1
Cited
WO1982003712A1
Cited
US4772942A
Cited
JPH02127877A
Cited
US5067019A
Cited
US5068735A
Cited
US5023725A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-05-03 | 2002-11-02 | 2003-05-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-05-03 | 2006-11-02 | 2007-05-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-05-03 | 2010-11-02 | 2011-05-04 | $7700.00 | Window Closed / Lapsed |