Patent US5990950A successfully refreshed from Google Patents.
US5990950A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and system for color filter array multifactor interpolation
Assignee: Mediabin Inc
•
Filing: 1998-02-11
•
Granted: 1999-11-23
•
Expires: 2018-02-11
Abstract
Abstract Missing intensity values for color values for a color component array derived from a color filter array are predicted using the system and method of the present invention. The method uses predictor sets for each missing intensity value to select a best value for each missing intensity value. The predictor sets include a luminance predictor set, a first chrominance predictor set and a second chrominance predictor set. The member predictors of the luminance predictor set are selected in response to a comparison between a variance between neighboring luminance values and a predetermined threshold. The first chrominance set is used to predict chrominance values of a color type at locations where a chrominance value of another color type was originally stored. The second chrominance set is used to predict chrominance values of a color type at locations where a luminance value was originally stored. Preferably, the member elements of the predictor sets are ranked and the median values selected as the missing intensity value.
Inventors
- 👤 Stephen B. Addison
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-23 17:16
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4015; H; H04; H04N; H04N23/00; H04N23/80; H04N23/84; H04N23/843; H04N25/00; H04N25/10; H04N25/11; H04N25/13; H04N25/134; H04N2209/00; H04N2209/04; H04N2209/041; H04N2209/042; H04N2209/045; H04N2209/046
Claims Analysis
Total Claims: 18
Claim 1
Independent Claim
253 words
A method for predicting missing color component values in a partially populated array of luminance and chrominance values, the method comprising the steps of: predicting missing luminance values in a partially populated array of luminance and chrominance values from predictors of a luminance predictor set for each array location missing a luminance value, at least one of said predictors in said luminance predictor set having a value derived from chrominance values in said array; predicting missing chrominance values of a first color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a second color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; predicting missing chrominance values of a second color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a first color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; predicting missing chrominance values of said first color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored; and predicting missing chrominance values of said second color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored.
Claim 2
Independent Claim
253 words
A method for predicting missing color component values in a partially populated array of luminance and chrominance values, the method comprising the steps of: predicting missing luminance values in a partially populated array of luminance and chrominance values from predictors of a luminance predictor set for each array location missing a luminance value, at least one of said predictors in said luminance predictor set having a value derived from chrominance values in said array; predicting missing chrominance values of a first color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a second color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; predicting missing chrominance values of a second color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a first color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; predicting missing chrominance values of said first color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored; and predicting missing chrominance values of said second color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored.
Claim 3
Dependent Claim
86 words
The method of claim 1, said predicting missing luminance values step further comprising the steps of: computing a variance from a plurality of neighboring luminance values; comparing said computed variance to a predictor threshold; selecting said predictors of said luminance predictor set to include luminance only and luminance/chrominance predictors in response to said variance being below said threshold; and selecting said predictors of said luminance predictor set to include only luminance/chrominance predictors in response to said variance being equal to or greater than said predictor threshold.
Claim 4
Dependent Claim
123 words
The method of claim 1 further comprising the steps of: ranking said predictors for each luminance predictor set; selecting the median of said ranked predictors for each luminance predictor set as the predicted luminance value for each array location at which a luminance value was not originally stored; ranking said predictors for each first chrominance predictor set; selecting the median of said ranked predictors for each first chrominance predictor set as the predicted chrominance value for each array location where a chrominance value was originally stored; ranking said predictors for each second chrominance set; and selecting the median of said ranked predictors for each second chrominance predictor set as the chrominance value for each array location where a luminance value was originally stored.
Claim 5
Dependent Claim
129 words
The method of claim 2 wherein said predictors selected for said luminance predictor set in response to said variance being below said threshold are: G 1 , G 2 , G 3 , G 4 , G 1 +C 0 -C 5 , G 2 +C 0 -C 6 , G 3 +C 0 -C 7 , and G 4 +C 0 -C 8 where C 0 is the chrominance value for the chrominance color type stored at the array location for which the luminance value is being predicted and C 5 , C 6 , C 7 , and C 8 are neighboring values for the chrominance color type of C 0 and where G 1 , G 2 , G 3 , G 4 are luminance values.
Claim 6
Dependent Claim
75 words
The method of claim 4 wherein said predictors of said luminance predictor set selected in response to said variance being equal to or greater than said threshold are: G.sub.1 +C.sub.0 -C.sub.5 ; G.sub.2 +C.sub.0 -C.sub.6 ; G.sub.3 +C.sub.0 -C.sub.7 ; G.sub.4 +C.sub.0 -C.sub.8 ; G'.sub.5 +C.sub.0 -C.sub.5 ; G'.sub.8 +C.sub.0 -C.sub.8 ; where G' 5 and G' 8 are previously predicted luminance values neighboring the array location for which the luminance value is being predicted.
Claim 7
Dependent Claim
119 words
The method of claim 5 wherein said predictors for said first chrominance predictor set are: G'.sub.0 +(C.sub.9 -G'.sub.9); G'.sub.0 +(C.sub.10 -G'.sub.10); G'.sub.0 +(C.sub.11 -G'.sub.11); G'.sub.0 +(C.sub.12 -G'.sub.12); where G' 0 is a previously predicted luminance values at the array location for which the luminance value is being predicted and G' 9 , G' 10 , G' 11 , and G' 12 are previously predicted luminance values neighboring the array location for which the luminance value is being predicted and C 9 , C 10 , C 11 , and C 12 are chrominance values neighboring the array location for which the luminance value is being predicted that are of the same color type as the color type being predicted.
Claim 8
Dependent Claim
116 words
The method of claim 6 wherein said predictors for said second chrominance predictor set are: G.sub.0 +(C.sub.1 -G'.sub.1); G.sub.0 +(C.sub.2 -G'.sub.2); G.sub.0 +(C.sub.3 -G'.sub.3); G.sub.0 +(C.sub.4 -G'.sub.4); where G 0 is the luminance value originally stored at the array location for which the chrominance value is being predicted, G' 1 , G' 2 , G' 3 , and G' 4 are previously predicted luminance values neighboring the array location for which the chrominance value is being predicted and C 1 , C 2 , C 3 , and C 4 are chrominance values neighboring the array location for which the chrominance value is being predicted of the same color type as the chrominance value being predicted.
Claim 9
Dependent Claim
30 words
The method of claim 1 further comprising the step of: computing a mean of said predictors of said first and said second chrominance predictor sets as the predicted chrominance values.
Claim 10
Independent Claim
258 words
A system for predicting missing color component values in a partially populated array of luminance and chrominance values comprising: means for predicting missing luminance values in a partially populated array of luminance and chrominance values from predictors of a luminance predictor set for each array location missing a luminance value, at least one of said predictors in said luminance predictor set having a value derived from chrominance values in said array; means for predicting missing chrominance values of a first color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a second color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; means for predicting missing chrominance values of a second color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a first color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; means for predicting missing chrominance values of said first color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored; and means for predicting missing chrominance values of said second color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored.
Claim 11
Independent Claim
258 words
A system for predicting missing color component values in a partially populated array of luminance and chrominance values comprising: means for predicting missing luminance values in a partially populated array of luminance and chrominance values from predictors of a luminance predictor set for each array location missing a luminance value, at least one of said predictors in said luminance predictor set having a value derived from chrominance values in said array; means for predicting missing chrominance values of a first color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a second color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; means for predicting missing chrominance values of a second color type in said array from predictors of a first chrominance predictor set for each array location at which a chrominance value of a first color type was originally stored, some of said predictors of said first chrominance predictor set having a value derived from previously predicted luminance values; means for predicting missing chrominance values of said first color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored; and means for predicting missing chrominance values of said second color type in said array by ranking predictors of a second chrominance predictor set for each array location at which a luminance value was originally stored.
Claim 12
Dependent Claim
85 words
The system of claim 9, further comprising: means for computing a variance from a plurality of neighboring luminance values; means for comparing said computed variance to a predetermined threshold; means for selecting said predictors of said luminance predictor set to include luminance only and luminance/chrominance predictors in response to said variance being below said threshold; and means for selecting said predictors of said luminance predictor set to include only luminance/chrominance predictors in response to said variance being equal to or greater than said predictor threshold.
Claim 13
Dependent Claim
132 words
The system of claim 9 further comprising: means for ranking said predictors for each luminance predictor set; means for selecting the median of said ranked predictors for each luminance predictor set as the predicted luminance value for each array location at which a luminance value was not originally stored; means for ranking said predictors for each first chrominance predictor set; mean for selecting the median of said ranked predictors for each first chrominance predictor set as the predicted chrominance value for each array location where a chrominance value was originally stored; means for ranking said predictors for each second chrominance set; and means for selecting the median of said ranked predictors for each second chrominance predictor set as the chrominance value for each array location where a luminance value was originally stored.
Claim 14
Dependent Claim
131 words
The system of claim 10 wherein said means for selecting said predictors for said luminance predictor set in response to said variance being below said threshold selects: G 1 , G 2 , G 3 , G 4 , G 1 +C 0 -C 5 , G 2 +C 0 -C 6 , G 3 +C 0 -C 7 , and G 4 +C 0 -C 8 where C 0 is the chrominance value for the chrominance color type stored at the array location for which the luminance value is being predicted and C 5 , C 6 , C 7 , and C 8 are neighboring values for the chrominance color type of C 0 and where G 1 , G 2 G 3 and G 4 are luminance values.
Claim 15
Dependent Claim
79 words
The system of claim 12 wherein said means for selecting said predictors of said luminance predictor set selected in response to said variance being equal to or greater than said threshold selects: G.sub.1 +C.sub.0 -C.sub.5 ; G.sub.2 +C.sub.0 -C.sub.6 ; G.sub.3 +C.sub.0 -C.sub.7 ; G.sub.4 +C.sub.0 -C.sub.8 ; G'.sub.5 +C.sub.0 -C.sub.5 ; G'.sub.8 +C.sub.0 -C.sub.8 ; where G' 5 and G' 8 are previously predicted luminance values neighboring the array location for which the luminance value is being predicted.
Claim 16
Dependent Claim
123 words
The system of claim 13 wherein said means for selecting said predictors for said first chrominance predictor set selects: G'.sub.0 +(C.sub.9 -G'.sub.9); G'.sub.0 +(C.sub.10 -G'.sub.10); G'.sub.0 +(C.sub.11 -G'.sub.11); G'.sub.0 +(C.sub.12 -G'.sub.12); where G' 0 is a previously predicted luminance values at the array location for which the luminance value is being predicted and G' 9 , G' 10 , G' 11 , and G' 12 are previously predicted luminance values neighboring the array location for which the luminance value is being predicted and C 9 , C 10 , C 11 , and C 12 are chrominance values neighboring the array location for which the luminance value is being predicted that are of the same color type as the color type being predicted.
Claim 17
Dependent Claim
120 words
The system of claim 14 wherein said means for selecting said predictors for said second chrominance predictor set selects: G.sub.0 +(C.sub.1 -G'.sub.1); G.sub.0 +(C.sub.2 -G'.sub.2); G.sub.0 +(C.sub.3 -G'.sub.3); G.sub.0 +(C.sub.4 -G'.sub.4); where G 0 is the luminance value originally stored at the array location for which the chrominance value is being predicted, G' 1 , G' 2 , G' 3 , and G' 4 are previously predicted luminance values neighboring the array location for which the chrominance value is being predicted and C 1 , C 2 , C 3 , and C 4 are chrominance values neighboring the array location for which the chrominance value is being predicted of the same color type as the chrominance value being predicted.
Claim 18
Dependent Claim
29 words
The method of claim 9 further comprises: means for computing a mean of said predictors of said first and said second chrominance predictor sets as the predicted chrominance values.
References Cited (Backward Citations)
US4125856A
Cited
US4605956A
Cited
US4630307A
Cited
US4642678A
Cited
US4716455A
Cited
US5382976A
Cited
US5764804A
Cited
US5742348A
Cited
US5596367A
Cited
US5652621A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-11-22 | 2003-05-24 | 2003-11-23 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-11-22 | 2007-05-24 | 2007-11-23 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-11-22 | 2011-05-24 | 2011-11-23 | $7700.00 | Window Closed / Lapsed |