Patent US6201574B1 successfully refreshed from Google Patents.
US6201574B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
Motionless camera orientation system distortion correcting sensing element
Assignee: Sony Corp
•
Filing: 1997-02-05
•
Granted: 2001-03-13
•
Expires: 2017-02-05
Abstract
Abstract A device for omnidirectional image viewing providing pan-and-tilt orientation, rotation, and magnification within a hemispherical field-of-view that utilizes no moving parts. The imaging device is based on the effect that the image from a fisheye lens, which produces a circular image of an entire hemispherical field-of-view, can be mathematically corrected using high-speed electronic circuitry. More specifically, an incoming fisheye image is captured on a Charge Coupled Diode array in such a way as to remove the distortion caused by the lens by locating the picture pickup elements in a nonlinear manner described herein. As a result, this device can accomplish the functions of pan, tilt, rotation, and zoom throughout a hemispherical field-of-view without the need for any mechanical mechanisms. The preferred embodiment of the image capture device can provide corrected images at standard video frame rates, compatible with standard video equipment. The device can be used for aiming the video device in any application where a conventional pan-and-tilt or orientation mechanism might be considered including inspection, monitoring, surveillance, video teleconferencing, and target acquisition.
Inventors
- 👤 H. Lee Martin
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 23:12
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/12; H; H04; H04N; H04N23/00; H04N23/60; H04N23/698; G06F; G06F16/00; G06F16/40; G08; G08B; G08B13/00; G08B13/18; G08B13/189; G08B13/194; G08B13/196; G08B13/19617; G08B13/19626; G08B13/19628; H04N1/00; H04N1/21; H04N1/2104; H04N1/2158; H04N1/2166; H04N1/217; H04N23/58; H04N25/00; H04N5/00; H04N5/222; H04N5/262; H04N5/2628; H04N7/00; H04N7/002; H04N7/18; H04N7/183; A; A61; A61B; A61B90/00; A61B90/08; A61B2090/0813
Claims Analysis
Total Claims: 42
Claim 1
Independent Claim
174 words
An electronic imaging system comprising: a wide-angle lens for producing a wide-angle image, the wide-angle lens producing a perspective distortion in the wide-angle image; and an imaging sensor, having a surface in optical communication with the wide-angle lens, for generating an output signal representing at least a portion of a corrected wide-angle image, the imaging sensor comprising a plurality of imaging elements, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image, thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 2
Dependent Claim
174 words
An electronic imaging system comprising: a wide-angle lens for producing a wide-angle image, the wide-angle lens producing a perspective distortion in the wide-angle image; and an imaging sensor, having a surface in optical communication with the wide-angle lens, for generating an output signal representing at least a portion of a corrected wide-angle image, the imaging sensor comprising a plurality of imaging elements, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image, thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 3
Dependent Claim
17 words
The system of claim 1 wherein the plurality of imaging elements are distributed as a two-dimensional array.
Claim 4
Dependent Claim
20 words
The system of claim 2 wherein each of the plurality of imaging elements is electronically addressable by a two-dimensional address.
Claim 5
Dependent Claim
20 words
The system of claim 1 wherein each of the plurality of imaging elements includes a pixel of a charge-coupled device.
Claim 6
Dependent Claim
13 words
The system of claim 1 wherein the output signal is a video signal.
Claim 7
Dependent Claim
15 words
The system of claim 1 wherein the output signal includes a plurality of image data.
Claim 8
Dependent Claim
25 words
The system of claim 1 further comprising a display for displaying at least a portion of the corrected wide-angle image responsive to the output signal.
Claim 9
Dependent Claim
32 words
The system of claim 1 further comprising an image processing unit for selectively magnifying a first region of the corrected wide-angle image responsive to the output signal and a user command signal.
Claim 10
Dependent Claim
42 words
The system of claim 8 further comprising an image processing unit for selectively panning from a second region of the corrected wide-angle image to a third region of the corrected wide-angle image responsive to the output signal and a user command signal.
Claim 11
Dependent Claim
23 words
The system of claim 8 further comprising a user interface device coupled to the image processing unit for generating the user command signal.
Claim 12
Dependent Claim
170 words
A sensor used in an electronic imaging system having a wide-angle lens for producing a wide-angle image having a perspective distortion, the sensor comprising: a surface in optical communication with the wide-angle lens; and a plurality of imaging elements, coupled to the surface, for generating an output signal representing at least a portion of a corrected wide-angle image, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image. thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 13
Dependent Claim
170 words
A sensor used in an electronic imaging system having a wide-angle lens for producing a wide-angle image having a perspective distortion, the sensor comprising: a surface in optical communication with the wide-angle lens; and a plurality of imaging elements, coupled to the surface, for generating an output signal representing at least a portion of a corrected wide-angle image, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image. thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 14
Dependent Claim
17 words
The sensor of claim 11 wherein the plurality of imaging elements are distributed as a two-dimensional array.
Claim 15
Dependent Claim
20 words
The sensor of claim 12 wherein each of the plurality of imaging elements is electronically addressable by a two-dimensional address.
Claim 16
Dependent Claim
20 words
The sensor of claim 11 wherein each of the plurality of imaging elements includes a pixel of a charge-coupled device.
Claim 17
Dependent Claim
13 words
The sensor of claim 11 wherein the output signal is a video signal.
Claim 18
Dependent Claim
15 words
The sensor of claim 11 wherein the output signal includes a plurality of image data.
Claim 19
Dependent Claim
173 words
A processing terminal comprising: a wide-angle lens for producing a wide-angle image, the wide-angle lens producing a perspective distortion in the wide-angle image; and an imaging sensor, having a surface in optical communication with the wide-angle lens, for generating an output signal representing at least a portion of a corrected wide-angle image, the imaging sensor comprising a plurality of imaging elements, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image; thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 20
Dependent Claim
173 words
A processing terminal comprising: a wide-angle lens for producing a wide-angle image, the wide-angle lens producing a perspective distortion in the wide-angle image; and an imaging sensor, having a surface in optical communication with the wide-angle lens, for generating an output signal representing at least a portion of a corrected wide-angle image, the imaging sensor comprising a plurality of imaging elements, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image; thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 21
Dependent Claim
176 words
A processing terminal configured to be used with a wide-angle lens, the processing terminal comprising: a surface, in optical communication with the wide-angle lens, configured to receive a wide-angle image having a perspective distortion associated with the wide-angle lens; and a plurality of imaging elements, coupled to the surface, for generating an output signal representing at least a portion of a corrected wide-angle image, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image. thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 22
Dependent Claim
176 words
A processing terminal configured to be used with a wide-angle lens, the processing terminal comprising: a surface, in optical communication with the wide-angle lens, configured to receive a wide-angle image having a perspective distortion associated with the wide-angle lens; and a plurality of imaging elements, coupled to the surface, for generating an output signal representing at least a portion of a corrected wide-angle image, the plurality of imaging elements having a distribution on the surface representable by a nonlinear function, wherein the plurality of imaging elements are distributed such that the perspective distortion in the wide-angle image is substantially corrected to produce the corrected wide-angle image, at least three of the plurality of imaging elements being distributed to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along the corrected wide-angle image. thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 23
Dependent Claim
79 words
The electronic imaging system of claim 1 , further including a second curved row of imaging elements at least partially different from the first curved row of imaging elements, the second curved row of imaging elements being defined by at least three of the plurality of imaging elements, each of the imaging elements defining the second curved row corresponding to a different point on a second straight line along the corrected wide-angle image different from the first straight line.
Claim 24
Dependent Claim
77 words
The sensor of claim 11 , further including a second curved row of imaging elements at least partially different from the first curved row of imaging elements, the second curved row of imaging elements being defined by at least three of the plurality of imaging elements, each of the imaging elements defining the second curved row corresponding to a different point on a second straight line along the corrected wide-angle image different from the first straight line.
Claim 25
Dependent Claim
78 words
The processing terminal of claim 17 , further including a second curved row of imaging elements at least partially different from the first curved row of imaging elements, the second curved row of imaging elements being defined by at least three of the plurality of imaging elements, each of the imagging elements defining the second curved row corresponding to a different point on a second straight line along the corrected wide-angle image different from the first straight line.
Claim 26
Dependent Claim
78 words
The processing terminal of claim 18 , further including a second curved row of imaging elements at least partially different from the first curved row of imaging elements, the second curved row of imaging elements being defined by at least three of the plurality of imaging elements, each of the imaging elements defining the second curved row corresponding to a different point on a second straight line along the corrected wide-angle image different from the first straight line.
Claim 27
Dependent Claim
123 words
A sensor configured to optically receive a wide-angle image, the wide-angle image having a perspective distortion associated with a wide-angle lens, the sensor comprising a plurality of imaging elements nonlinearity distributed in space, at least three of the plurality of imaging elements being distributed in space so as to define a first curved row of imaging elements, each of the at least three imaging elements defining the first curved row corresponding to a different point on a first straight line along a corrected wide-angle image, the corrected wide-angle image being the wide-angle image substantially without the perspective distortion, thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 28
Dependent Claim
123 words
A sensor configured to optically receive a wide-angle image, the wide-angle image having a perspective distortion associated with a wide-angle lens, the sensor comprising a plurality of imaging elements nonlinearity distributed in space, at least three of the plurality of imaging elements being distributed in space so as to define a first curved row of imaging elements, each of the at least three imaging elements defining the first curved row corresponding to a different point on a first straight line along a corrected wide-angle image, the corrected wide-angle image being the wide-angle image substantially without the perspective distortion, thereby allowing for direct mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 29
Dependent Claim
77 words
The sensor of claim 23 , further including a second curved row of imaging elements at least partially different from the first curved row of imaging elements, the second curved row of imaging elements being defined by at least three of the plurality of imaging elements, each of the imaging elements defining the second curved row corresponding to a different point on a second straight line along the corrected wide-angle image different from the first straight line.
Claim 30
Dependent Claim
37 words
The sensor of claim 24 , wherein a set of the image elements defining the first curved row and a set of the imaging elements defining the second curved row comprise two different imaging elements in common.
Claim 31
Dependent Claim
15 words
The sensor of claim 25 , wherein the two different imaging elements are diametrically opposed.
Claim 32
Dependent Claim
18 words
The sensor of claim 23 , wherein the plurality of imaging elements are distributed as a two-dimensional array.
Claim 33
Dependent Claim
25 words
The sensor of claim 23 , wherein the sensor is configured to generate a signal representing at least a portion of the corrected wide-angle image.
Claim 34
Dependent Claim
65 words
The sensor of claim 23 , wherein sensor is configured to receive a plurality of wide-angle images over time each having the distortion, the sensor being configured to generate a signal representing at least a portion of each of a plurality of corrected wide-angle images over time, each of the corrected wide-angle images comprising one of the plurality of wide-angle images substantially without the distortion.
Claim 35
Dependent Claim
29 words
The sensor of claim 29 , wherein the signal represents the at least a portion of each of the plurality of corrected wide-angle images at a real-time video rate.
Claim 36
Dependent Claim
17 words
The sensor of claim 30 , wherein the real-time video rate is about 30 images per second.
Claim 37
Dependent Claim
30 words
The sensor of claim 23 , wherein the sensor comprises a charge-coupled device, and wherein each of the plurality of imaging elements comprises a picture element of the charge-couple device.
Claim 38
Independent Claim
134 words
A method comprising: optically receiving at a sensor a wide-angle image, the wide-angle image having a perspective distortion associated with a wide-angle lens, the sensor comprising a plurality of imaging elements nonlinearity distributed in space, at least three of the plurality of imaging elements being distributed in space so as to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along a corrected wide-angle image, the corrected wide-angle image being the wide-angle image substantially without the perspective distortion; and generating a signal representing at least a portion of the corrected wide-angle image by directly mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 39
Independent Claim
134 words
A method comprising: optically receiving at a sensor a wide-angle image, the wide-angle image having a perspective distortion associated with a wide-angle lens, the sensor comprising a plurality of imaging elements nonlinearity distributed in space, at least three of the plurality of imaging elements being distributed in space so as to define a first curved row of imaging elements, each of the imaging elements defining the first curved row corresponding to a different point on a first straight line along a corrected wide-angle image, the corrected wide-angle image being the wide-angle image substantially without the perspective distortion; and generating a signal representing at least a portion of the corrected wide-angle image by directly mapping between the at least three sensor elements and the points on the first straight line in the corrected wide-angle image.
Claim 40
Dependent Claim
106 words
The method of claim 33 , wherein the step of generating the signal comprises the steps of: scanning at least a portion of the first curved row of imaging elements; and scanning at least a portion of a second curved row of imaging elements at least partially different from the first curved row of imaging elements, the second curved row of imaging elements being defined by at least three of the plurality of imaging elements, each of the imaging elements defining the second curved row corresponding to a different point on a second straight line along the corrected wide-angle image different from the first straight line.
Claim 41
Dependent Claim
37 words
The method of claim 34 , wherein a set of the imaging elements defining the first curved row and a set of the imaging elements defining the second curved row comprise two different imaging elements in common.
Claim 42
Dependent Claim
15 words
The method of claim 35 , wherein the two different imaging elements are diametrically opposed.
References Cited (Backward Citations)
US3351763A
Cited
US3723805A
Cited
US4152724A
Cited
US4191967A
Cited
US4125862A
Cited
WO1982003712A1
Cited
US4467361A
Cited
US4463380A
Cited
US4835532A
Cited
US4549208A
Cited
US4518898A
Cited
US4670648A
Cited
US4965844A
Cited
US4661855A
Cited
US4751660A
Cited
US4772942A
Cited
US4924094A
Cited
US4858149A
Cited
US4728839A
Cited
US4858002A
Cited
US5020114A
Cited
US5048102A
Cited
US4914284A
Cited
US4945367A
Cited
US4918473A
Cited
US5005083A
Cited
JPH02127877A
Cited
US4991020A
Cited
US5067019A
Cited
US5068735A
Cited
US5023725A
Cited
US5231673A
Cited
US5200818A
Cited
US5173948A
Cited
US5185667A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2004-03-12 | 2004-09-11 | 2005-03-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2008-03-12 | 2008-09-11 | 2009-03-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2012-03-12 | 2012-09-11 | 2013-03-13 | $7700.00 | Window Closed / Lapsed |