US5438360A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Machine vision camera and video reprocessing system
Assignee: ACTIVE VISION SYSTEMS Inc
•
Filing: 1994-07-28
•
Granted: 1995-08-01
•
Expires: 2014-07-28
Abstract
Abstract An improved camera system intended for a machine vision system which produces an image output that is specially adapted to be received by a machine vision system. In one embodiment, the camera system receives components from three portions of the electromagnetic spectrum, these being infrared, visible, and ultraviolet, and then combines these three portions essentially as expanded colors in an expanded version of an RGB "red/green/blue" video system. This provides a better image in all types of weather and visibility conditions. In addition, the camera system includes dynamic range transform logic which selectively compresses the dynamic range of the respective pixel values comprising the image to extract the most useful information from the extended dynamic range of the image. This reduces the amount of information required to be processed while retaining a quality image. The camera system also includes motion compensation logic that removes the motion or jitter caused by the camera system being subject to vibration from various environmental influences. The system also optionally removes stationary background features from the output image.
Inventors
- 👤 Michael K. Edwards
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 19:30
CPC Classifications
H; H04; H04N; H04N23/00; H04N23/60; H04N23/68; H04N23/681; H04N23/6811; H04N23/682; H04N23/683; H04N25/00
Claims Analysis
Total Claims: 17
Claim 1
Independent Claim
248 words
A video preprocessing system for removing effects of camera motion, comprising: a video source for providing incoming signals representing an image; and a motion compensator coupled to said video source receiving said incoming image for adjusting said incoming image to compensate for camera motion caused by environmental influence on the camera, said motion compensator comprising: a background frame buffer for storing an accumulated background image of said image; and a comparator coupled to said background frame buffer which compares values of a plurality of incoming pixels with values of selected background pixels, wherein each of said background pixels that are compared with said incoming pixels are displaced in position from said incoming pixels by one of a plurality of predetermined relative displacements, wherein said incoming image comprises a plurality of blocks each comprising a first number of pixels, and a different predetermined relative displacement from a first number of predetermined relative displacements is used for each pixel comprising one of said blocks wherein said comparison of said incoming pixels with said background pixels generates error values; an error matrix store for storing said error values; and determining means coupled to said error matrix store for determining a total displacement that can be made to said incoming image to compensate for said camera motion, wherein said determining means uses said error values in said error matrix store in determining said total displacement; wherein said incoming image is adjusted according to said total displacement to compensate for said camera motion.
Claim 2
Dependent Claim
248 words
A video preprocessing system for removing effects of camera motion, comprising: a video source for providing incoming signals representing an image; and a motion compensator coupled to said video source receiving said incoming image for adjusting said incoming image to compensate for camera motion caused by environmental influence on the camera, said motion compensator comprising: a background frame buffer for storing an accumulated background image of said image; and a comparator coupled to said background frame buffer which compares values of a plurality of incoming pixels with values of selected background pixels, wherein each of said background pixels that are compared with said incoming pixels are displaced in position from said incoming pixels by one of a plurality of predetermined relative displacements, wherein said incoming image comprises a plurality of blocks each comprising a first number of pixels, and a different predetermined relative displacement from a first number of predetermined relative displacements is used for each pixel comprising one of said blocks wherein said comparison of said incoming pixels with said background pixels generates error values; an error matrix store for storing said error values; and determining means coupled to said error matrix store for determining a total displacement that can be made to said incoming image to compensate for said camera motion, wherein said determining means uses said error values in said error matrix store in determining said total displacement; wherein said incoming image is adjusted according to said total displacement to compensate for said camera motion.
Claim 3
Dependent Claim
40 words
The video preprocessing system of claim 1, wherein said first number of relative displacements are applied to said first number of pixels comprising each of said blocks according to a predetermined pattern, said pattern repeating for each of said blocks.
Claim 4
Dependent Claim
38 words
The video preprocessing system of claim 1, wherein said error matrix store comprises a first number of locations corresponding to said first number of relative displacements for accumulating said error values associated with each of said relative displacements.
Claim 5
Dependent Claim
36 words
The video preprocessing system of claim 3, wherein said determining means analyzes said error values in said error matrix store to determine a relative displacement that best compensates for said environmental influence on said camera system.
Claim 6
Dependent Claim
79 words
The video preprocessing system of claim 4 wherein said error matrix store comprises rows and columns of said first number of locations: wherein said determining means sums said accumulated error values in each of said rows and columns comprising said error matrix store, determines the row and column with the minimum sum of accumulated error values, and determines the location storing the minimum accumulated error value within a region surrounding an intersection of said minimum sum row and column.
Claim 7
Dependent Claim
36 words
The video preprocessing system of claim 1, wherein said predetermined relative displacements are made from an initial displacement guess; and wherein said total displacement comprises a selected relative displacement in addition to said initial displacement guess.
Claim 8
Dependent Claim
76 words
The video preprocessing system of claim 1, said motion compensator further comprising: an incoming pixel store receiving said incoming pixels comprising said incoming image from said video source; and a coordinate generator coupled to said background frame buffer for generating coordinates of displaced background pixels to be compared with said incoming pixels; wherein said comparator receives said incoming pixels and compares said incoming pixel values with said displaced background pixel values to produce said error values.
Claim 9
Dependent Claim
22 words
The video preprocessing system according to claim 1, wherein said background frame buffer stores an accumulated background image comprising historically stationary objects.
Claim 10
Dependent Claim
53 words
The video preprocessing system according to claim 8, wherein said background frame buffer stores an accumulated background image according to the equation: B.sub.new →B·(1-C)+I·C wherein B new is the new accumulated background image, B is the previous accumulated background image, I is the incoming image, and C is a value less than one.
Claim 11
Dependent Claim
52 words
The video preprocessing system according to claim 9, wherein said background frame buffer stores an accumulated background image according to the equation: B.sub.new →B·(1-C)+I·C wherein B new is tile new accumulated background image, B is the previous accumulated background image, I is the incoming image, and C is all exponential decay factor.
Claim 12
Independent Claim
220 words
A method for adjusting an image output from a video source to remove jitter caused by external influences on the video source, the method comprising the steps of: (a) receiving an incoming pixel from a video source, said incoming pixel being part of an incoming image; (b) computing coordinates of a displaced background pixel to be compared with said incoming pixel, said coordinates of said displaced background pixel being based on a relative displacement; (c) fetching said displaced background pixel; (d) computing an error value based on values of said incoming pixel and said displaced background pixel after said step of fetching; (e) accumulating said error value with prior error values computed using said relative displacement; (f) repeating steps (a) through (e) for a plurality of incoming pixels comprising said incoming image using a plurality of different relative displacements, wherein said incoming image comprises a plurality of blocks each comprising a first number of pixels and a different relative displacement chosen from a first number of relative displacements is used for each pixel comprising one of said blocks; (g) examining said accumulated error values for each of said relative displacements to determine a relative displacement that compensates for said jitter after step (f); and (h) adjusting said incoming image according to said determined relative displacement to compensate for said jitter.
Claim 13
Independent Claim
220 words
A method for adjusting an image output from a video source to remove jitter caused by external influences on the video source, the method comprising the steps of: (a) receiving an incoming pixel from a video source, said incoming pixel being part of an incoming image; (b) computing coordinates of a displaced background pixel to be compared with said incoming pixel, said coordinates of said displaced background pixel being based on a relative displacement; (c) fetching said displaced background pixel; (d) computing an error value based on values of said incoming pixel and said displaced background pixel after said step of fetching; (e) accumulating said error value with prior error values computed using said relative displacement; (f) repeating steps (a) through (e) for a plurality of incoming pixels comprising said incoming image using a plurality of different relative displacements, wherein said incoming image comprises a plurality of blocks each comprising a first number of pixels and a different relative displacement chosen from a first number of relative displacements is used for each pixel comprising one of said blocks; (g) examining said accumulated error values for each of said relative displacements to determine a relative displacement that compensates for said jitter after step (f); and (h) adjusting said incoming image according to said determined relative displacement to compensate for said jitter.
Claim 14
Dependent Claim
51 words
The method of claim 11, wherein said step of computing coordinates computes coordinates of said displaced background pixel based on one of said plurality of relative displacements and an initial displacement guess; wherein said step of adjusting adjusts said image according to said initial displacement guess and said determined relative displacement.
Claim 15
Dependent Claim
37 words
The method of claim 11, wherein said first number of relative displacements are applied to said first number of pixels comprising each of said blocks according to a pattern, said pattern repeating for each of said blocks.
Claim 16
Dependent Claim
27 words
The method of claim 11, wherein said step of accumulating comprises accumulating said error values associated with each of said relative displacements in an error matrix store.
Claim 17
Dependent Claim
40 words
The method of claim 11, wherein said step of examining includes summing said accumulated error values in respective rows and columns of said error matrix store and determining the row and column with the minimum sum of accumulated error values.
References Cited (Backward Citations)
US5012270A
Cited
US5053876A
Cited
US5184216A
Cited
US5172226A
Cited
US5212547A
Cited
US5208667A
Cited
US5161107A
Cited
US5289274A
Cited
US5321515A
Cited
US5278663A
Cited
US5313296A
Cited
JPH05334572A
Cited
US5311305A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1998-07-31 | 1999-01-30 | 1999-08-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2002-07-31 | 2003-01-30 | 2003-08-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2006-07-31 | 2007-01-30 | 2007-08-01 | $7700.00 | Window Closed / Lapsed |