US5581637A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System for registering component image tiles in a camera-based scanner device transcribing scene images
Assignee: Xerox Corp
•
Filing: 1996-04-16
•
Granted: 1996-12-03
•
Expires: 2016-04-16
Abstract
Abstract A device for registering component image tiles in a scanning system for transcribing, into electronic form, markings on a two-dimensional surface such as a whiteboard. A registration light pattern is projected onto the surface to be imaged. The pattern projected can be chosen to best suite the specific properties of the camera and imaging environment. The pattern markings are processed using perspective transformations to determine the overlap properties of the image tiles and distortion of each tile image, and the resulting data is used to combine the tiles to produce an undistorted composite image of the whiteboard.
Inventors
- 👤 Todd A. Cass
- 👤 Eric Saund
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 15:32
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/14; G06V; G06V10/00; G06V10/10; G06V10/12; G06V10/14; G06V10/147; G06V10/20; G06V10/24; G06V10/245
Claims Analysis
Total Claims: 7
Claim 1
Independent Claim
320 words
A method for providing a complete undistorted computational representation of an image on a surface, the method comprising the steps of: a) projecting a light pattern upon the image, the light pattern including a multiplicity of lightmarks, each lightmark having a neighborhood; b) capturing a multiplicity of image tiles using at least one camera subsystem, each of the image tiles including a portion of the image and at least a one of the lightmarks, each image tile having an overlapping area for each adjacent image tile overlapped by the image tile; c) converting the image tiles into a computational format; d) for each image tile, identifying the overlapping areas; e) correcting distortions of the image tiles, including perspective distortion, to produce a single undisturbed, computational representation of the image by the substeps of: 1) identifying the lightmarks within the overlapping areas; 2) performing local correlations of image patches in the neighborhoods of the lightmarks within the overlapping areas to identify locations in each image tile of the lightmarks within the overlapping areas; 3) projecting the lightmark locations into surface coordinates; 4) for each pair of overlapping, adjacent image tiles, comparing corresponding pairs of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles; 5) for each pair of lightmarks within the overlapping area common to a pair of overlapping, adjacent image tiles, choosing target coordinates at a location intermediate to the surface coordinates of each of the pair of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles; 6) computing perspective transforms for each image tile using the target coordinates for the lightmarks within the overlapping areas; 7) repeating substeps 1)-6) until convergence upon locations of lightmarks within the overlapping area of each image tile that represent a cumulative error in surface coordinates of the lightmarks within the overlapping areas of each image tile that is less than a threshold amount.
Claim 2
Independent Claim
320 words
A method for providing a complete undistorted computational representation of an image on a surface, the method comprising the steps of: a) projecting a light pattern upon the image, the light pattern including a multiplicity of lightmarks, each lightmark having a neighborhood; b) capturing a multiplicity of image tiles using at least one camera subsystem, each of the image tiles including a portion of the image and at least a one of the lightmarks, each image tile having an overlapping area for each adjacent image tile overlapped by the image tile; c) converting the image tiles into a computational format; d) for each image tile, identifying the overlapping areas; e) correcting distortions of the image tiles, including perspective distortion, to produce a single undisturbed, computational representation of the image by the substeps of: 1) identifying the lightmarks within the overlapping areas; 2) performing local correlations of image patches in the neighborhoods of the lightmarks within the overlapping areas to identify locations in each image tile of the lightmarks within the overlapping areas; 3) projecting the lightmark locations into surface coordinates; 4) for each pair of overlapping, adjacent image tiles, comparing corresponding pairs of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles; 5) for each pair of lightmarks within the overlapping area common to a pair of overlapping, adjacent image tiles, choosing target coordinates at a location intermediate to the surface coordinates of each of the pair of lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles; 6) computing perspective transforms for each image tile using the target coordinates for the lightmarks within the overlapping areas; 7) repeating substeps 1)-6) until convergence upon locations of lightmarks within the overlapping area of each image tile that represent a cumulative error in surface coordinates of the lightmarks within the overlapping areas of each image tile that is less than a threshold amount.
Claim 3
Dependent Claim
154 words
The method of claim 1 wherein step e3) comprises the steps of: for each pair of overlapping, adjacent image tiles: A) finding a first location of a first liqhtmark of the lightmarks within the overlapping area common to the pair of overlapping, adjacent image tiles, the first location being within a surface co-ordinate system and being found given a location of the first lightmark within a first co-ordinate system associated with a first tile of the pair of overlapping, adjacent image tiles; B) finding a second location of the first lightmark within the surface co-ordinate system given a location of the first lightmark within a second co-ordinate system associated with a second tile of the pair of overlapping adjacent, image tiles; and wherein step e6) comprises the step of: for each pair of overlapping adjacent image tile: using the first location and the second location of the first lightmark to compute the perspective transform.
Claim 4
Dependent Claim
61 words
The method of claim 2, wherein step e6) includes the steps of: computing a perspective transform of said first tile to obtain the first location of the first lightmark; computing a perspective transform of said second tile to obtain the second location of the first lightmark; and determining a difference between the first location and second location of said first lightmark.
Claim 5
Dependent Claim
41 words
The method of claim 2, wherein step e2) includes the steps of: for each pair of overlapping, adjacent image tiles: performing center-surround processing on said first tile to identify lightmarks; and performing center-surround processing on said second tile to identify lightmarks.
Claim 6
Dependent Claim
283 words
An automatic system for capturing in computational form an undisturbed image content of an image comprising: a) a surface upon which the image is provided; b) at least one camera subsystem for capturing the image in a matrix of image tiles, each of the image tiles including at least a portion of the image, each of the image tiles having an overlapping area that overlaps an adjacent image tile; c) a projection subsystem for projecting a registration pattern upon the image, the registration pattern including a multiplicity of lightmarks, each of the overlapping areas including at least one of the lightmarks; d) a processor combining the image tiles to create in computational form the undisturbed image content of the image corrected for perspective distortion by the step of: 1) for each pair of adjacent image tiles, identifying a first overlapping area of a first image tile of the pair of adjacent image tiles corresponding to a second overlapping area of a second image tile of the pair of adjacent image tiles; 2) identifying a first lightmark in the first overlapping area corresponding to a second lightmark in the second overlapping area; 3) finding a projection of the first liqhtmark at a first surface coordinate location in the first image tile; 4) finding a projection of the second liqhtmark at a second surface coordinate location in the second image tile; 5) correcting perspective distortion between the first surface coordinate location and the second surface coordinate location; and generating corrected surface coordinates for the first lightmark and the second lightmark; e) memory coupled to the processor, the memory storing instructions for the processor and storing in computation form the undisturbed image content of the image.
Claim 7
Dependent Claim
283 words
An automatic system for capturing in computational form an undisturbed image content of an image comprising: a) a surface upon which the image is provided; b) at least one camera subsystem for capturing the image in a matrix of image tiles, each of the image tiles including at least a portion of the image, each of the image tiles having an overlapping area that overlaps an adjacent image tile; c) a projection subsystem for projecting a registration pattern upon the image, the registration pattern including a multiplicity of lightmarks, each of the overlapping areas including at least one of the lightmarks; d) a processor combining the image tiles to create in computational form the undisturbed image content of the image corrected for perspective distortion by the step of: 1) for each pair of adjacent image tiles, identifying a first overlapping area of a first image tile of the pair of adjacent image tiles corresponding to a second overlapping area of a second image tile of the pair of adjacent image tiles; 2) identifying a first lightmark in the first overlapping area corresponding to a second lightmark in the second overlapping area; 3) finding a projection of the first liqhtmark at a first surface coordinate location in the first image tile; 4) finding a projection of the second liqhtmark at a second surface coordinate location in the second image tile; 5) correcting perspective distortion between the first surface coordinate location and the second surface coordinate location; and generating corrected surface coordinates for the first lightmark and the second lightmark; e) memory coupled to the processor, the memory storing instructions for the processor and storing in computation form the undisturbed image content of the image.
References Cited (Backward Citations)
US3943361A
Cited
US3956629A
Cited
US4878247A
Cited
US4797942A
Cited
US5063602A
Cited
US5010500A
Cited
US5140647A
Cited
US5353058A
Cited
US5298697A
Cited
US5331435A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-12-03 | 2000-06-03 | 2000-12-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-12-03 | 2004-06-03 | 2004-12-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-12-03 | 2008-06-03 | 2008-12-03 | $7700.00 | Window Closed / Lapsed |