US6909806B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image background replacement method
Assignee: Rakuten Group Inc
•
Filing: 2004-10-20
•
Granted: 2005-06-21
•
Expires: 2024-10-20
Abstract
Abstract An image's pixels are initially segmented into pixels of the image foreground and background by comparing the pixels of the image to updated models of background reference pixels. Pixel structures are identified in the image. The probability that a pixel is in the background or foreground is refined by considering the initial segmentation of the pixel's neighbors and the pixel's membership in a pixel structure. If a pixel is identified as a background pixel it is replaced by a pixel of a new background.
Inventors
- 👤 Baoxin Li
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:27
CPC Classifications
G; G06; G06T; G06T11/00; H; H04; H04N; H04N1/00; H04N1/387; H04N1/3871
Claims Analysis
Total Claims: 35
Claim 1
Independent Claim
106 words
A method of segmenting an image, said method comprising the steps of: (a) capturing said image comprising a plurality of input pixels representing a background and a foreground of a scene; (b) capturing a background reference image comprising a plurality of background reference pixels representing said background of said scene; (c) classifying an input pixel as one a pixel of said background and said foreground according to a relationship of said input pixel to a background reference pixel; (d) identifying a structure in said input image; and (e) revising said classification of said input pixel according to a membership of said input pixel in said structure.
Claim 2
Independent Claim
106 words
A method of segmenting an image, said method comprising the steps of: (a) capturing said image comprising a plurality of input pixels representing a background and a foreground of a scene; (b) capturing a background reference image comprising a plurality of background reference pixels representing said background of said scene; (c) classifying an input pixel as one a pixel of said background and said foreground according to a relationship of said input pixel to a background reference pixel; (d) identifying a structure in said input image; and (e) revising said classification of said input pixel according to a membership of said input pixel in said structure.
Claim 3
Dependent Claim
116 words
The method claim 1 wherein the step of classifying an input pixel as one of a background and a foreground pixel according to a relationship of said input pixel to a background reference pixel comprises the steps of: (a) determining a first probability that said input pixel is a pixel of one of said background and said foreground if a relationship of said input pixel and said background reference pixel at least equals a threshold; and (b) determining a second probability that said input pixel is a pixel of one of said background and said foreground if said relationship of said input pixel and said background reference pixel does not at least equal to said threshold.
Claim 4
Dependent Claim
31 words
The method of claim 2 wherein at least one of said first and said second probabilities is a function of a difference between said input pixel and said background reference pixel.
Claim 5
Dependent Claim
37 words
The method of claim 3 wherein said difference between said input pixel and said background reference pixel comprises a difference between a chromatic value of said input pixel and a chromatic value of said background reference pixel.
Claim 6
Dependent Claim
34 words
The method of claim 4 wherein at least one of said chromatic values of said input pixel and said background reference pixel comprises a sum of a plurality of chromatic components of said pixel.
Claim 7
Dependent Claim
37 words
The method of claim 2 wherein said relationship of said input pixel and said background reference pixel comprises a difference between a chromatic value of said input pixel and a chromatic value of said background reference pixel.
Claim 8
Dependent Claim
34 words
The method of claim 6 wherein at least of one said chromatic values of said input pixel and said background reference pixel comprises a sum of a plurality of chromatic components of said pixel.
Claim 9
Dependent Claim
35 words
The method of claim 6 wherein said chromatic value of said background reference pixel comprises a mean of a plurality of chromatic values for a plurality of background pixels included in a plurality of images.
Claim 10
Dependent Claim
40 words
The method of claim 2 wherein said function of said chromatic value of said background reference pixel comprises a function of a standard deviation of a chromatic value of a plurality of background pixels included in a plurality of images.
Claim 11
Dependent Claim
37 words
The method of claim 1 wherein the step of identifying a structure in said image comprises the step of filtering said image with a morphological filter to identify a plurality of connected input pixels in said image.
Claim 12
Dependent Claim
85 words
The method of claim 1 wherein the step of revising said classification of said input pixel according to a membership of said input pixel in said structure comprises the steps of: (a) revising one of said first and said second probabilities according to a first relationship if said input pixel is a pixel included in said structure; and (b) revising one of said first and said second probabilities according to a second relationship if said input pixel is not a pixel included in said structure.
Claim 13
Dependent Claim
37 words
The method of claim 11 wherein at least one of said first and said second relationships comprises a probability that a pixel neighboring said input pixel is a pixel of one of said background and said foreground.
Claim 14
Dependent Claim
28 words
The method of claim 11 wherein said first relationship comprises a minimum probability that one of a plurality of pixels neighboring said input pixel is a background pixel.
Claim 15
Dependent Claim
28 words
The method of claim 11 wherein said second relationship comprises a maximum probability that one of a plurality of pixels neighboring said input pixel is a background pixel.
Claim 16
Dependent Claim
28 words
The method of claim 1 further comprising the step of revising a background reference pixel according to a relationship of said background reference pixel and an input pixel.
Claim 17
Dependent Claim
63 words
The method of claim 15 wherein the step of revising said background reference pixel according to a relationship of said background reference pixel and an input pixel comprises the step of determining a mean of a chromatic value of said background reference pixel and a chromatic value of said input pixel if said input pixel is classified as a pixel of said background.
Claim 18
Dependent Claim
40 words
The method of claim 15 wherein said relationship for said chromatic value of said background reference pixel comprises a function of a standard deviation of a chromatic value for a plurality of background pixels included in a plurality of images.
Claim 19
Independent Claim
156 words
A method of segmenting an image comprising the steps of: (a) capturing said image comprising a plurality of input pixels representing a background and a foreground of a scene; (b) capturing a background reference image comprising a plurality of background reference pixels representing a background of said scene; (c) determining a probability that an input pixel is a pixel of one of said background and said foreground according to a relationship of a value measuring said input pixel and a value measuring a background reference pixel; (d) identifying a pixel structure in said image; (f) revising said probability for said input pixel according to a membership of said input pixel in said pixel structure and a probability that a neighboring pixel is a pixel of one of said background and said foreground; and (g) revising said value measuring said a background reference pixel according to a relationship of said background reference pixel and said input pixel.
Claim 20
Independent Claim
156 words
A method of segmenting an image comprising the steps of: (a) capturing said image comprising a plurality of input pixels representing a background and a foreground of a scene; (b) capturing a background reference image comprising a plurality of background reference pixels representing a background of said scene; (c) determining a probability that an input pixel is a pixel of one of said background and said foreground according to a relationship of a value measuring said input pixel and a value measuring a background reference pixel; (d) identifying a pixel structure in said image; (f) revising said probability for said input pixel according to a membership of said input pixel in said pixel structure and a probability that a neighboring pixel is a pixel of one of said background and said foreground; and (g) revising said value measuring said a background reference pixel according to a relationship of said background reference pixel and said input pixel.
Claim 21
Dependent Claim
132 words
The method claim 18 wherein the step of determining a probability that an input pixel is a pixel of one said background and said foreground according to a relationship of a value measuring said input pixel and a value measuring a background reference pixel comprises the steps of: (a) determining a first probability that said input pixel is a pixel of one of said background and said foreground if a relationship of said values measuring said input pixel and said background reference pixel at least equals a threshold; and (b) determining a second probability that said input pixel is a pixel of one of said background and said foreground if said relationship of said values measuring said input pixel and said background reference pixel does not at least equal to said threshold.
Claim 22
Dependent Claim
34 words
The method of claim 19 wherein at least one of said first and said second probabilities is a function of a difference between said values measuring said input pixel and said background reference pixel.
Claim 23
Dependent Claim
40 words
The method of claim 20 wherein said difference between said values measuring said input pixel and said background reference pixel comprises a difference between a chromatic value of said input pixel and a chromatic value of said background reference pixel.
Claim 24
Dependent Claim
34 words
The method of claim 21 wherein at least of one said chromatic values of said input pixel and said background reference pixel comprises a sum of a plurality of chromatic components for said pixel.
Claim 25
Dependent Claim
40 words
The method of claim 19 wherein said relationship of said values measuring said input pixel and said background reference pixel comprises a difference between a chromatic value of said input pixel and a chromatic value of said background reference pixel.
Claim 26
Dependent Claim
33 words
The method of claim 23 wherein at least one said chromatic values of said input pixel and said background reference pixel comprises a sum of a plurality of chromatic components for said pixel.
Claim 27
Dependent Claim
33 words
The method of claim 23 wherein said chromatic value of said background reference pixel comprises a mean of a chromatic value for a plurality of background pixels included in a plurality of images.
Claim 28
Dependent Claim
20 words
The method of claim 19 wherein said threshold comprises a relationship for a chromatic value for said background reference pixel.
Claim 29
Dependent Claim
38 words
The method of claim 18 wherein the step of identifying a pixel structure in said image comprises the step of filtering said image with a morphological filter to identify a plurality of connected input pixels in said image.
Claim 30
Dependent Claim
94 words
The method of claim 18 wherein the step of revising said probability for said input pixel according to a membership of said input pixel in said pixel structure and a probability that a neighboring pixel is a pixel of one of said background and said foreground comprises the steps of: (a) assigning a first probability value to said input pixel if said input pixel is a pixel included in said structure; and (b) assigning a second probability value to said input pixel if said input pixel is not a pixel included in said structure.
Claim 31
Dependent Claim
39 words
The method of claim 28 wherein at least one of said first and said second probability values comprises a probability that one of a plurality of neighboring pixels is a pixel of one of said foreground and said background.
Claim 32
Dependent Claim
44 words
The method of claim 28 wherein at least one of said first and said second probability values comprises one of a minimum and a maximum probability that one of a plurality of neighboring pixels a pixel of one of said foreground and said background.
Claim 33
Dependent Claim
63 words
The method of claim 18 wherein the step of revising said value measuring said a background reference pixel according to a relationship of said background reference pixel and said input pixel comprises the step of determining a mean of said value measuring said background reference pixel and said value measuring said input pixel if said input pixel is a pixel of said background.
Claim 34
Dependent Claim
28 words
The method of claim 31 wherein at least one of said values measuring said input pixel and said background reference pixel comprises a chromatic value for said pixel.
Claim 35
Dependent Claim
33 words
The method of claim 32 wherein at least one said chromatic value of said input pixel and said background reference pixel comprises a sum of a plurality of chromatic components for said pixel.
References Cited (Backward Citations)
US5781198A
Cited
US5852673A
Cited
US5764803A
Cited
US6301385B1
Cited
US6249613B1
Cited
US6707939B1
Cited
US6819796B2
Cited
US6707940B1
Cited
US6697072B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-06-20 | 2008-12-20 | 2009-06-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-06-20 | 2012-12-20 | 2013-06-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-06-20 | 2016-12-20 | 2017-06-21 | $7700.00 | Window Closed / Lapsed |