US5691765A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image forming and processing device and method for use with no moving parts camera
Assignee: Sensormatic Electronics LLC
•
Filing: 1995-07-27
•
Granted: 1997-11-25
•
Expires: 2015-07-27
Abstract
Abstract A video surveillance system has a camera equipped with a fisheye lens having a substantially hemispheric field of view. The system implements operations equivalent to the panning, tilting and zooming of a conventional camera without the use of moving parts. The lens is mounted vertically above a plane under surveillance. The camera produces a fisheye image made up of a plurality of pixels. The fisheye image is distorted due to the properties of the fisheye lens. The system corrects the distortion by mapping the pixels of the fisheye image to coordinates produced by selecting a particular part of the fisheye image to be viewed. This allows an operator to select parts of the field of view of the fisheye lens and view them as if they had been produced by a camera having a conventional lens being panned tilted or zoomed. The fisheye image formed by the camera is split into four separate image components carried by four bundles of optical fibers. Each bundle has a CCD and associated image processing circuitry which forms an electronic representation of the image component carried by that bundle.
Inventors
- 👤 Steve W. Schieltz
- 👤 Terry Laurence Glatt
- 👤 Carl Kupersmit
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 14:19
CPC Classifications
G; G08; G08B; G08B13/00; G08B13/18; G08B13/189; G08B13/194; G08B13/196; G08B13/19617; G08B13/19619; G06; G06T; G06T3/00; G06T3/04; G06T3/047; G08B13/19626; G08B13/19628; H; H04; H04N; H04N23/00; H04N23/58; H04N5/00; H04N5/222; H04N5/262; H04N5/2628
Claims Analysis
Total Claims: 12
Claim 1
Independent Claim
305 words
A method of video surveillance comprising the steps of: providing a video camera having an image plane and a fisheye lens, the fisheye lens having a lens constant indicative of distortion caused by the fisheye lens, a primary axis and a substantially hemispheric field of view and the camera having an image plane, the image plane having a center point through which the primary axis passes; mounting the camera at a mounting point vertically above a surveillance plane such that the primary axis of the fisheye lens lies substantially perpendicular to the surveillance plane; causing the video camera to form a fisheye image, the fisheye image being distorted by the fisheye lens and comprising a plurality of pixels, each pixel having unique fisheye coordinates; generating a corrected image of sub-area in the field of view by the steps of: providing angular coordinates of an object in the field of view by simulating a hypothetical camera having a hypothetical axis and such that the hypothetical axis passes through the center point and the object in the field of view at specific pan and tilt angles; selecting an area of the fisheye image, wherein the area comprises a subset of the plurality of pixels, each pixel of the subset being displaced from the specific pan angle by an angle "a"; determining the unique fisheye coordinates of each pixel of the subset of the plurality of pixels by means of a formula comprising the lens constant, the specific tilt angle "b" and the angle "a", said formula being given by X.sub.d =f.cos.sup.-1 (cos(a).cos(b)).cos(tan.sup.-1 (tan(a)/sin(b))) Y.sub.d =f.cos.sup.-1 (cos(a).cos(b)).sin(tan.sup.-1 (tan(a)/sin(b))), where "f" is the lens constant and X d and Y d are the unique fisheye coordinates; and mapping the pixels in the subset of the plurality of pixels to normal coordinates, thereby forming the corrected image of the sub-area.
Claim 2
Independent Claim
305 words
A method of video surveillance comprising the steps of: providing a video camera having an image plane and a fisheye lens, the fisheye lens having a lens constant indicative of distortion caused by the fisheye lens, a primary axis and a substantially hemispheric field of view and the camera having an image plane, the image plane having a center point through which the primary axis passes; mounting the camera at a mounting point vertically above a surveillance plane such that the primary axis of the fisheye lens lies substantially perpendicular to the surveillance plane; causing the video camera to form a fisheye image, the fisheye image being distorted by the fisheye lens and comprising a plurality of pixels, each pixel having unique fisheye coordinates; generating a corrected image of sub-area in the field of view by the steps of: providing angular coordinates of an object in the field of view by simulating a hypothetical camera having a hypothetical axis and such that the hypothetical axis passes through the center point and the object in the field of view at specific pan and tilt angles; selecting an area of the fisheye image, wherein the area comprises a subset of the plurality of pixels, each pixel of the subset being displaced from the specific pan angle by an angle "a"; determining the unique fisheye coordinates of each pixel of the subset of the plurality of pixels by means of a formula comprising the lens constant, the specific tilt angle "b" and the angle "a", said formula being given by X.sub.d =f.cos.sup.-1 (cos(a).cos(b)).cos(tan.sup.-1 (tan(a)/sin(b))) Y.sub.d =f.cos.sup.-1 (cos(a).cos(b)).sin(tan.sup.-1 (tan(a)/sin(b))), where "f" is the lens constant and X d and Y d are the unique fisheye coordinates; and mapping the pixels in the subset of the plurality of pixels to normal coordinates, thereby forming the corrected image of the sub-area.
Claim 3
Dependent Claim
21 words
The method of claim 1 wherein the specific tilt angle is taken relative to the primary axis of the fisheye lens.
Claim 4
Dependent Claim
22 words
The method of claim 1 wherein the specific pan angle is taken relative to a prior pan angle about the primary axis.
Claim 5
Dependent Claim
97 words
The method of claim 1 wherein the step of mapping the pixels in the subset to the normal coordinates comprises the steps of: providing a lookup table containing sets of pre-calculated coordinates calculated in accordance with the formula such that for each pixel in the subset of the plurality of pixels there is a corresponding set of angular coordinates, and such that for each set of angular coordinates, there is a set of pre-calculated pixel coordinates; providing the angular coordinates to the lookup table and in response, causing the lookup table to output the pre-calculated pixel coordinates.
Claim 6
Dependent Claim
53 words
The method of claim 4 further comprising the steps of: storing the plurality of pixels in an image memory, at .addresses corresponding to the pre-calculated coordinates, providing the pre-calculated coordinates to the image memory and receiving as an output from the image memory, the pixels in the subset of the plurality of pixels.
Claim 7
Dependent Claim
31 words
The method of claim 1 wherein the step of providing the angular coordinates of the object comprises the step of receiving the specific pan and tilt angles via a user input.
Claim 8
Dependent Claim
29 words
The method of claim 1 wherein the angular coordinates are polar coordinates and further comprising the step of converting the polar coordinates into the specific pan and tilt angles.
Claim 9
Dependent Claim
45 words
The method of claim 1 wherein the step of providing the angular coordinates of the object comprises the step of selecting an area on a video display and calculating the specific pan and tilt angles of the object based on cartesian coordinates of the sub-area.
Claim 10
Dependent Claim
17 words
The method of claim 1 further comprising the step of displaying the corrected image of the sub-area.
Claim 11
Dependent Claim
14 words
The method of claim 1 further comprising the step of zooming the corrected image.
Claim 12
Dependent Claim
14 words
The method of claim 10 wherein the step of zooming comprises incrementing angle "a".
References Cited (Backward Citations)
US4984089A
Cited
US5200818A
Cited
US5319744A
Cited
US5185667A
Cited
US5359363A
Cited
US5586231A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-11-24 | 2001-05-26 | 2001-11-25 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-11-24 | 2005-05-26 | 2005-11-25 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-11-24 | 2009-05-26 | 2009-11-25 | $7700.00 | Window Closed / Lapsed |