US6763149B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for correcting crosstalk and spatial resolution for multichannel imaging
Assignee: Cytek Biosciences Inc
•
Filing: 2002-04-24
•
Granted: 2004-07-13
•
Expires: 2022-04-24
Abstract
Abstract A multichannel imaging system generates an ensemble of images for each field of view of an object. Each image in the ensemble is intended to contain information from only one source among a plurality of sources for the object. However, due to crosstalk, at least a portion of the signal from a first source appears in a channel intended for a second source. Because the accuracy of the correction will be degraded if the images in an ensemble are spatially misaligned with respect to one another, the spatial offset between images is determined and a correction is applied to substantially eliminate the offset. Then, a correction to the signals is determined to substantially reduce the contributions to the signal in a channel from the signals in other channels. The signal processing can be employed to process the output signals for each of a plurality of different disclosed imaging systems.
Inventors
- 👤 James K. Riley
- 👤 Keith L. Frost
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:16
CPC Classifications
G; G01; G01J; G01J3/00; G01J3/28; G06; G06V; G06V20/00; G06V20/60; G06V20/69; G01J3/2803; G01J3/30; G01J3/32; G01J3/36; G06T; G06T5/00; G06T5/50; G06T7/00; G06T7/30; G06T7/32; G06T7/33; G01N; G01N15/00; G01N15/10; G01N15/14; G01N15/1429; G01N15/1433; G01N15/1468; G01N15/147; G06F; G06F2218/00; G06F2218/02; G06T2207/00; G06T2207/10; G06T2207/10032; G06T2207/10036
Claims Analysis
Total Claims: 46
Claim 1
Independent Claim
79 words
A method for processing signals from different channels in a multi-channel digital imaging system, said signals comprising image signal data, comprising steps of: (a) determining spatial alignment offsets for the image signal data; (b) aligning the image signal data by applying the spatial alignment offsets to the image signal data, to produce aligned image signal data; (c) determining spectral crosstalk reduction coefficients; and (d) applying the spectral crosstalk coefficients to the aligned image signal data, for spectral correction thereof.
Claim 2
Independent Claim
79 words
A method for processing signals from different channels in a multi-channel digital imaging system, said signals comprising image signal data, comprising steps of: (a) determining spatial alignment offsets for the image signal data; (b) aligning the image signal data by applying the spatial alignment offsets to the image signal data, to produce aligned image signal data; (c) determining spectral crosstalk reduction coefficients; and (d) applying the spectral crosstalk coefficients to the aligned image signal data, for spectral correction thereof.
Claim 3
Dependent Claim
57 words
The method of claim 1 , wherein the step of determining spatial alignment offsets comprises the step of determining spatial alignment offsets to within sub-pixel resolution, and wherein the step of aligning the image signal data comprises the step of aligning the image signal data by applying the sub-pixel spatial alignment offsets to the image signal data.
Claim 4
Dependent Claim
27 words
The method of claim 1 , wherein the step of determining spatial alignment offsets is performed before sample data are captured by the multi-channel digital imaging system.
Claim 5
Dependent Claim
30 words
The method of claim 1 , wherein the step of determining spatial alignment offsets is performed concurrently with the step of capturing sample data with the multi-channel digital imaging system.
Claim 6
Dependent Claim
111 words
The method of claim 1 , wherein the step of determining spatial alignment offsets comprises the steps of: (a) selecting a first one of said different channels as a reference channel; (b) selecting a different one of said different channels as a data channel, image signal data in the data channel to be aligned with image signal data in the reference channel; (c) producing a correlogram by processing image signal data from the reference channel with image signal data from the data channel; (d) determining a peak of the correlogram; and (e) comparing the peak of correlogram with image signal data in the reference channel to determine the spatial alignment offsets.
Claim 7
Dependent Claim
37 words
The method of claim 5 , wherein the step of producing a correlogram comprises the step of processing image signal data from the reference channel with image signal data from the data channel in the frequency domain.
Claim 8
Dependent Claim
37 words
The method of claim 5 , wherein the step of producing a correlogram comprises the step of processing image signal data from the reference channel with image signal data from the data channel in the spatial domain.
Claim 9
Dependent Claim
49 words
The method of claim 5 , wherein the step of producing a correlogram comprises the step of processing a subset of image signal data from the reference channel with a subset of image signal data from the data channel, wherein the possible spatial alignment offsets correspond to the subsets.
Claim 10
Dependent Claim
36 words
The method of claim 5 , wherein the step of preparing a correlogram comprises the step of using boundary data corresponding to image signal data the reference channel and image signal data in the data channel.
Claim 11
Dependent Claim
18 words
The method of claim 9 , wherein the boundary data are generated using a two dimensional gradient operator.
Claim 12
Dependent Claim
39 words
The method of claim 1 , wherein the step of aligning the image signal data comprises the step of convolving the image signal data using an interpolation kernel to enable image signal data to be aligned with sub-pixel resolution.
Claim 13
Dependent Claim
27 words
The method of claim 11 , wherein the interpolation kernel is determined using a function approximation of the peak of a correlogram using a Taylor series expansion.
Claim 14
Dependent Claim
40 words
The method of claim 1 , wherein the step of determining spectral crosstalk reduction coefficients comprises the step of imaging a control sample, wherein said control sample comprises a source substantially limited to a single one of the different channels.
Claim 15
Dependent Claim
22 words
The method of claim 13 , wherein the control sample comprises at least one of a synthesized bead and a biological sample.
Claim 16
Dependent Claim
53 words
The method of claim 1 , wherein the step of determining spectral crosstalk reduction coefficients comprises the step of employing a theoretical model of a crosstalk spectrum and a sensitivity of a camera used to capture an image of a sample to a stimulus of a spectrum, in producing the image signal data.
Claim 17
Dependent Claim
22 words
The method of claim 1 , wherein the step of determining spectral crosstalk reduction coefficients comprises the step of solving linear equations.
Claim 18
Dependent Claim
22 words
The method of claim 16 , wherein the step of solving linear equations comprises the step of utilizing a singular value decomposition.
Claim 19
Dependent Claim
26 words
The method of claim 1 , wherein the step of applying the spectral crosstalk coefficients for spectral correction comprises the step of applying a linear equation.
Claim 20
Independent Claim
129 words
A method for correcting errors in a multichannel signal, the multichannel signal comprising an ensemble of related signals used to produce images for different channels, wherein each signal is associated with a different channel and is intended to provide information from only one source, comprising the steps of: (a) aligning the signals in the ensemble relative to each other, such that when images produced from the signals are displayed, each image produced from a signal in the ensemble is substantially aligned with images produced from other signals in the ensemble; (b) determining spectral crosstalk corrections suitable for correcting channel-to-channel crosstalk between signals of the ensemble; and (c) applying the spectral crosstalk corrections to the signals associated with the different channels, to correct for the channel-to-channel crosstalk between the signals.
Claim 21
Independent Claim
129 words
A method for correcting errors in a multichannel signal, the multichannel signal comprising an ensemble of related signals used to produce images for different channels, wherein each signal is associated with a different channel and is intended to provide information from only one source, comprising the steps of: (a) aligning the signals in the ensemble relative to each other, such that when images produced from the signals are displayed, each image produced from a signal in the ensemble is substantially aligned with images produced from other signals in the ensemble; (b) determining spectral crosstalk corrections suitable for correcting channel-to-channel crosstalk between signals of the ensemble; and (c) applying the spectral crosstalk corrections to the signals associated with the different channels, to correct for the channel-to-channel crosstalk between the signals.
Claim 22
Dependent Claim
43 words
The method of claim 19 , wherein the step of aligning comprises the step of applying: (a) horizontal and vertical spatial offsets derived from a calibration signal; and (b) constants that are accessed during the step of aligning, but which are not modified.
Claim 23
Dependent Claim
27 words
The method of claim 20 , wherein the second class of constants comprises at least one of channel start columns for each signal, and inverted source coefficients.
Claim 24
Dependent Claim
29 words
The method of claim 20 , wherein the step of applying the spectral crosstalk corrections comprises the step of employing constants that are accessed, but which are not modified.
Claim 25
Dependent Claim
22 words
The method of claim 19 , wherein the step of aligning comprises the step of applying spatial corrections at a sub-pixel resolution.
Claim 26
Dependent Claim
44 words
The method of claim 19 , further comprising the step of providing a calibration signal, wherein the step of aligning comprises the step of generating horizontal and vertical spatial offsets based upon a comparison of each signal in the ensemble with the calibration signal.
Claim 27
Dependent Claim
26 words
The method of claim 24 , wherein the step of providing a calibration signal comprises the step of imaging a control sample having a single source.
Claim 28
Dependent Claim
29 words
The method of claim 24 , wherein the step of providing a calibration signal further comprising the step of providing the calibration signal when the multichannel system is initialized.
Claim 29
Dependent Claim
31 words
The method of claim 24 , wherein the step of providing a calibration signal further comprising the step of providing the calibration signal periodically during the use of the multichannel system.
Claim 30
Dependent Claim
38 words
The method of claim 24 , wherein each signal in the ensemble comprises image data, and horizontal and vertical spatial offsets are determined for each pixel of the image data, to align the images in the different channels.
Claim 31
Dependent Claim
70 words
The method of claim 28 , wherein the step of aligning, for successive signals in the ensemble that are processed, comprises the steps of: (a) detecting a boundary of a signal currently being processed; (b) preparing a correlogram based on the boundary and a reference signal, thereby enabling location of a peak in the correlogram; (c) repositioning the signal currently being processed, to correspond to the peak of the correlogram.
Claim 32
Dependent Claim
37 words
The method of claim 29 , wherein the step of detecting a boundary of the signal currently being processed comprises the step of using a two-dimensional gradient operator to suppress flat surfaces and to enhance object boundaries.
Claim 33
Dependent Claim
32 words
The method of claim 29 , wherein the step of preparing a correlogram based on the boundary and the reference signal comprises the step of preparing a correlogram in a frequency domain.
Claim 34
Dependent Claim
85 words
The method of claim 31 , wherein the step of preparing a correlogram in the frequency domain comprises the steps of: (a) performing a Fourier Transform of boundary data for a selected signal from the ensemble and a Fourier Transform of the reference signal; (b) multiplying a result of the Fourier Transform of the boundary data for the selected signal by a result of the Fourier Transform of the reference signal to generate a product; and (c) performing an inverse Fourier Transform of the product.
Claim 35
Dependent Claim
32 words
The method of claim 29 , wherein the step of preparing a correlogram based on the boundary and the reference signal comprises the step of preparing a correlogram in the spatial domain.
Claim 36
Dependent Claim
32 words
The method of claim 33 , wherein the step of preparing a correlogram in the spatial domain comprises the steps of performing signal processing upon a subset of possible spatial alignment offsets.
Claim 37
Dependent Claim
35 words
The method of claim 29 , wherein groups of image data in each channel of the multichannel system are processed together, such that a cumulative correlogram is generated for each successive channel that is processed.
Claim 38
Dependent Claim
39 words
The method of claim 29 , wherein the step of aligning further comprises the step of reconstructing each signal in the ensemble by interpolating a position of the image produced with the signal to a fraction of a pixel.
Claim 39
Dependent Claim
21 words
The method of claim 36 , wherein the step of reconstructing each signal comprises the step of applying a two-dimensional interpolation.
Claim 40
Dependent Claim
37 words
The method of claim 37 , wherein the step of applying a two-dimensional interpolation comprises the step of computing a new amplitude value for each pixel based on a weighted sum of a group of surrounding pixels.
Claim 41
Dependent Claim
38 words
The method of claim 38 , wherein the step of computing a new amplitude value for each pixel is based on a weighted sum of a group of nine pixels, eight pixels of which surround an origin pixel.
Claim 42
Dependent Claim
45 words
The method of claim 38 , wherein the step of computing a new amplitude value for each pixel comprises the step of applying a matrix of coefficients to each pixel value, wherein a sum the of the coefficients in the matrix is equal to 1.0.
Claim 43
Dependent Claim
26 words
The method of claim 29 , further comprising the step of determining the peak of the correlogram by employing a Taylor series expansion, eigenvalues, and eigenvectors.
Claim 44
Dependent Claim
51 words
The method of claim 24 , further comprising the step of storing the signals for a period of time, wherein the step of applying spectral crosstalk corrections comprises the step of applying spectral crosstalk corrections to at least one of the signals that have been stored for the period of time.
Claim 45
Dependent Claim
21 words
The method of claim 19 , wherein the step of aligning comprises the step of aligning the signal in real time.
Claim 46
Dependent Claim
44 words
The method of claim 19 , further comprising the step of storing the signals for a period of time, wherein the step of aligning the signals in the ensemble comprises the step of aligning signals that have been stored for the period of time.
References Cited (Backward Citations)
US4581586A
Cited
US5096807A
Cited
US4770992A
Cited
US5365525A
Cited
US5473338A
Cited
US6066459A
Cited
US5613156A
Cited
US6210973B1
Cited
US5919140A
Cited
US5848123A
Cited
US6007994A
Cited
US5988862A
Cited
US5929986A
Cited
US6072765A
Cited
US6014468A
Cited
US6134283A
Cited
US6553044B1
Cited
US6522781B1
Cited
US20010006416A1
Cited
US6249341B1
Cited
US6452707B1
Cited
US6381363B1
Cited
US6433904B1
Cited
US6211955B1
Cited
US6662332B1
Cited
US20020126275A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-07-13 | 2008-01-12 | 2008-07-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-07-13 | 2012-01-12 | 2012-07-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-07-13 | 2016-01-12 | 2016-07-13 | $7700.00 | Window Closed / Lapsed |