US5684890A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Three-dimensional reference image segmenting method and apparatus
Assignee: NEC Corp
•
Filing: 1995-02-24
•
Granted: 1997-11-04
•
Expires: 2015-02-24
Abstract
Abstract The images of an object equivalent to those obtained when as object is viewed respectively by the right and left eyes are subdivided into small areas with overlaps allowed therebetween and are Fourier transformed to achieve a local Fourier transform for the images. Phase difference of Fourier transforms is obtained according to the right and left local Fourier transform images of a reference image which is stored beforehand in a storage memory. Alternatively, a Fourier transform power spectrum is obtained. Disparity is represented in terms of a phase difference or in the form of a Fourier transform power spectral pattern. According to either one of the above results, and on the basis of a local Fourier transform of an input image including the reference image, an identical object image is estimated. For the image, a local inverse Fourier transform is effected such that geometric mean values are attained between the right and left images so as to segment an image matching the reference image and, also, with respect to disparity.
Inventors
- 👤 Masanobu Miyashita
- 👤 Kenji Okajima
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-05 22:20
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/10; G06T7/168; G06T7/11; G06T7/50; G06T7/55; G06T7/593; G06T7/70; G06T2200/00; G06T2200/04; G06T2207/00; G06T2207/10; G06T2207/10004; G06T2207/10012; G06T2207/20; G06T2207/20021; G06T2207/20048; G06T2207/20056
Claims Analysis
Total Claims: 20
Claim 1
Independent Claim
288 words
A three-dimensional reference image segmenting apparatus, comprising: means for inputting an image of an object, the image having a left image and a right image, respectively equivalent to those obtained when the object is viewed by a right eye and a left eye, respectively; means for subdividing the right and left input images of the image into predetermined areas, calculating a Fourier transform for each of the areas; means for representing a disparity between respective local areas of said left and right image in terms of a phase difference between their respective local Fourier transforms; means for obtaining a maximum power spectral pattern by computing a sum of a right power spectrum and a left power spectrum when the phases of the local Fourier transform of said left and right images match each other for each spatial frequency; storage means for storing a maximum power spectral pattern of a reference image; means for estimating, according to the local Fourier transforms of the input images, the maximum power spectral pattern of the input image, and the maximum power spectral pattern of the reference image, a local Fourier transform of an image existing in the input image and having a power spectral pattern analogous to that of the reference image, thereby obtaining a local Fourier transform of an identical object image identical to the reference image; and means for computing a local inverse Fourier transform according to the local Fourier transform estimated by the estimating means, thereby segmenting the reference image from the input image even when the object of the reference image is included in the input image and a positional difference exists in a depth direction between the reference image and the object included in the input image.
Claim 2
Dependent Claim
288 words
A three-dimensional reference image segmenting apparatus, comprising: means for inputting an image of an object, the image having a left image and a right image, respectively equivalent to those obtained when the object is viewed by a right eye and a left eye, respectively; means for subdividing the right and left input images of the image into predetermined areas, calculating a Fourier transform for each of the areas; means for representing a disparity between respective local areas of said left and right image in terms of a phase difference between their respective local Fourier transforms; means for obtaining a maximum power spectral pattern by computing a sum of a right power spectrum and a left power spectrum when the phases of the local Fourier transform of said left and right images match each other for each spatial frequency; storage means for storing a maximum power spectral pattern of a reference image; means for estimating, according to the local Fourier transforms of the input images, the maximum power spectral pattern of the input image, and the maximum power spectral pattern of the reference image, a local Fourier transform of an image existing in the input image and having a power spectral pattern analogous to that of the reference image, thereby obtaining a local Fourier transform of an identical object image identical to the reference image; and means for computing a local inverse Fourier transform according to the local Fourier transform estimated by the estimating means, thereby segmenting the reference image from the input image even when the object of the reference image is included in the input image and a positional difference exists in a depth direction between the reference image and the object included in the input image.
Claim 3
Dependent Claim
212 words
A three-dimensional reference image segmenting method, comprising the steps of: inputting a pixel image including right pixel image and a left pixel image, equivalent to images obtained when an object is viewed by a right eye and a left eye, respectively; dividing the input right pixel and left pixel images each into a plurality of areas, each represented as f.sub.μ (x), where f.sub.μ (x) is a value of a pixel at a position identified by a space vector x, and μ is a parameter having a value of "L" and "R", respectively, to represent the right and the left images; calculating, for each f.sub.μ (x) area of the right input pixel image and the left input pixel image, a local Fourier transform F.sub.μ (k,X), where X is a space vector pointing to a center of a corresponding area f.sub.μ (x), and k is a space frequency; and segmenting a right and a left target image corresponding to the object from the input images in accordance with the local Fourier transform F.sub.μ (k,X) and a prior stored local Fourier transform F.sub.μ (k,X) of each of the areas in each of a right and left reference image of the object, and such a phase difference δφ 1 satisfying a relation that: F.sub.R (k,X)⃡F.sub.L (k,X)exp(-iδφ.sub.1).
Claim 4
Dependent Claim
212 words
A three-dimensional reference image segmenting method, comprising the steps of: inputting a pixel image including right pixel image and a left pixel image, equivalent to images obtained when an object is viewed by a right eye and a left eye, respectively; dividing the input right pixel and left pixel images each into a plurality of areas, each represented as f.sub.μ (x), where f.sub.μ (x) is a value of a pixel at a position identified by a space vector x, and μ is a parameter having a value of "L" and "R", respectively, to represent the right and the left images; calculating, for each f.sub.μ (x) area of the right input pixel image and the left input pixel image, a local Fourier transform F.sub.μ (k,X), where X is a space vector pointing to a center of a corresponding area f.sub.μ (x), and k is a space frequency; and segmenting a right and a left target image corresponding to the object from the input images in accordance with the local Fourier transform F.sub.μ (k,X) and a prior stored local Fourier transform F.sub.μ (k,X) of each of the areas in each of a right and left reference image of the object, and such a phase difference δφ 1 satisfying a relation that: F.sub.R (k,X)⃡F.sub.L (k,X)exp(-iδφ.sub.1).
Claim 5
Dependent Claim
154 words
A method according to claim 2, wherein said step of segmenting a right and a left target image comprises the steps of: calculating, for each of the areas in each of the left input pixel images and right input pixel images, a local Fourier transform equivalent F'.sub.μ (k,X) from the prior stored local Fourier transform F.sub.μ (k,X) and said phase difference on the basis of a local disparity between the input images f R (x) and f L (x) being expressed as the phase difference; calculating an inverse Fourier transform image f'μ(x), corresponding to the left input pixel images and right input pixel images, from the local Fourier transform equivalents F'μ(k,X); and finding a geometric mean fμ(x) between each fμ(x) of the left input pixel images and right input pixel images and the corresponding inverse Fourier transform image f'μ(x), where fμ(x) is an image which only contains an objective image corresponding to the object.
Claim 6
Dependent Claim
39 words
A method according to claim 3, wherein the step of calculating a local Fourier transform equivalent F'μ(k,X) comprises the step of: calculating a local Fourier transform equivalent according to the following equations: F.sub.R '(k,X)=F.sub.R (k,X)exp(-iδφ.sub.1), and F.sub.L '(k,X)=F.sub.L (k,X)exp(-iδφ.sub.1).
Claim 7
Dependent Claim
46 words
A method according to claim 3, wherein the step of calculating a local Fourier transform equivalent F'μ(k,X) comprises the step of: calculating a local Fourier transform equivalent according to the following equations: F.sub.R '(k,X)=|F.sub.R (k,X)|w(F.sub.L,F.sub.R)exp(-iδφ.sub.1), and F.sub.L '(k,X)=|F.sub.L (k,X)|w(F.sub.R,F.sub.L)exp(iδφ.sub.1), where w(Z.sub.1,Z.sub.2)=Z.sub.1 /|Z.sub.1 |:ε<|Z.sub.1 |,ε<|Z.sub.2 |=0; otherwise.
Claim 8
Dependent Claim
60 words
A method according to claim 3, wherein the step of calculating a local Fourier transform equivalent F'μ(k,X) comprises the step of: obtaining the local Fourier transform equivalent F'μ(k,X) from the following equations: E.sub.R Σ.sub.δφ (|F.sub.L (k,X)+F.sub.R '(k,X)exp(iδφ)|-λ.sub.R P.sub.B (k,X,δφ)).sup.2, and E.sub.L =Σ.sub.δφ (|F.sub.L '(k,X)+F.sub.R( k,X)exp(iδφ)|-λ.sub.L P.sub.B (k,X,δφ).sup.2, where P.sub.B (k,X,δφ)=|F.sub.L (k,X)+F.sub.L (k,X)exp(iδφ)|.sup.2 and λ.sub.R and λ.sub.L are positive auxiliary functions.
Claim 9
Dependent Claim
32 words
A method according to claim 2, wherein said step of dividing each of the left input pixel image and right input pixel image into predetermined areas provides overlaps between said predetermined areas.
Claim 10
Dependent Claim
52 words
A method according to claim 2, wherein said step of segmenting a right and a left target image corresponding to the object comprises the step of: compensating a positional difference in depth direction between the reference image and the target image in the left input pixel image and right input pixel image.
Claim 11
Dependent Claim
61 words
A method according to claim 8, wherein said step of compensating a positional difference comprises the steps of: obtaining an apparent disparity d caused by the positional difference in depth direction between the reference image and the target image in the left input pixel image and right input pixel image; and replacing the phase difference δφ 1 with δφ 1 +kd.
Claim 12
Dependent Claim
214 words
A three-dimensional reference image segmenting apparatus comprising: means for inputting a right pixel image and a left pixel image equivalent to images obtained when an object is viewed by a right eye and a left eye, respectively; means for dividing the input right pixel and left pixel images each into a plurality of predetermined areas, each represented as f.sub.μ (x) where f.sub.μ (x) is a value of a pixel at a position identified by a space vector x, and μ is a parameter having a value of "L" and "R", respectively, to represent the right and the left images; means for calculating, for each f.sub.μ (x) area of the right input pixel image and the left input pixel image, a local Fourier transform F.sub.μ (k,X), where X is a space vector pointing to a center of a corresponding area f.sub.μ (x), and k is a space frequency; and means for segmenting a right and a left target image corresponding to the object from the input pixel image by using the local Fourier transform fμ(k,X), a prior stored local Fourier transform Fμ(k,X) of each of the predetermined areas in each of a right and a left reference image of the object, and such a phase difference δφ 1 satisfying a relation that: F.sub.R (k,X)⃡F.sub.L (k,X)exp(-iδφ.sub.1).
Claim 13
Dependent Claim
214 words
A three-dimensional reference image segmenting apparatus comprising: means for inputting a right pixel image and a left pixel image equivalent to images obtained when an object is viewed by a right eye and a left eye, respectively; means for dividing the input right pixel and left pixel images each into a plurality of predetermined areas, each represented as f.sub.μ (x) where f.sub.μ (x) is a value of a pixel at a position identified by a space vector x, and μ is a parameter having a value of "L" and "R", respectively, to represent the right and the left images; means for calculating, for each f.sub.μ (x) area of the right input pixel image and the left input pixel image, a local Fourier transform F.sub.μ (k,X), where X is a space vector pointing to a center of a corresponding area f.sub.μ (x), and k is a space frequency; and means for segmenting a right and a left target image corresponding to the object from the input pixel image by using the local Fourier transform fμ(k,X), a prior stored local Fourier transform Fμ(k,X) of each of the predetermined areas in each of a right and a left reference image of the object, and such a phase difference δφ 1 satisfying a relation that: F.sub.R (k,X)⃡F.sub.L (k,X)exp(-iδφ.sub.1).
Claim 14
Dependent Claim
142 words
An apparatus according to claim 10, wherein the means for segmenting a right and a left target image comprises: means for calculating, for each of the areas in each of the input pixel image, a local Fourier transform equivalent F'μ(k,X) from the local Fourier transform Fμ(k,X), the prior stored local Fourier transform and the phase difference on the basis of a local disparity between the input images f R (x) and f L (X) being expressed as the phase difference; means for calculating, for each of the input images, an inverse Fourier transform image fμ(x) from all the local Fourier transform equivalents F'μ(k,X); and means for finding a geometric mean fμ(x) between each fμ(x) of the input pixel image and the corresponding inverse Fourier transform image f'μ(x), where fμ(x) is an image which only contains an objective image corresponding to the object.
Claim 15
Dependent Claim
30 words
An apparatus according to claim 11, wherein the means for calculating a local Fourier transform equivalent F'μ(k,X) comprises: means for calculating the following equations: F'.sub.R (k,X)=F.sub.R (k,X)exp(-iδφ.sub.1), and F'.sub.L (k,X)exp(-iδφ.sub.1).
Claim 16
Dependent Claim
47 words
An apparatus according to claim 11, wherein the means for calculating a local Fourier transform equivalent F'μ(k,X) comprises: means for calculating the following equations: F' R (k,X)=|F R (k,X)|w(F L ,F R )exp(-iδφ 1 ), and F'.sub.L (k,X)=|F.sub.L (k,X)|w(F.sub.R, F.sub.L)exp(-δφ.sub.1), where w(Z.sub.1,Z.sub.2)=Z.sub.1 /|Z.sub.1 |:ε<|Z.sub.1 |,ε<|Z.sub.2 |=0; otherwise.
Claim 17
Dependent Claim
60 words
An apparatus according to claim 11, wherein the means for calculating a local Fourier transform equivalent Fμ(k,X) comprises: means for obtaining such the local Fourier transform equivalents F'μ(k,X) as minimizes the following equations: E.sub.R =Σ.sub.δφ (|F.sub.L (k,X)+F'.sub.R (k,X)exp(iδφ)|-λ.sub.R P.sub.B (k,X,δφ)).sup.2), E.sub.L =Σ.sub.δφ (|F.sub.L '(k,X)+F.sub.R (k,X)exp(iδφ)|-λ.sub.L P.sub.B (k,X,δφ)).sup.2, and P.sub.B (k,X,δφ)=|F.sub.L (k,X)+F.sub.L (k,X)exp(iδφ)|.sup.2, where λ.sub.R and λ.sub.L are positive auxiliary functions.
Claim 18
Dependent Claim
27 words
An apparatus according to claim 10, wherein the means for dividing the input pixel image into predetermined areas comprises means for providing overlaps between said predetermined areas.
Claim 19
Dependent Claim
45 words
An apparatus according to claim 10, wherein the means for segmenting a right and a left target image corresponding to the object comprises: means for compensating a positional difference in depth direction between the reference image and the target image in the input pixel image.
Claim 20
Dependent Claim
56 words
An apparatus according to claim 16, wherein the means for compensating a positional difference comprises: means for obtaining an apparent disparity d caused by the positional difference in depth direction between the reference image and the target image in the input pixel image; and means for replacing the phase difference δφ 1 with δφ 1 +kd.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-11-03 | 2001-05-05 | 2001-11-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-11-03 | 2005-05-05 | 2005-11-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-11-03 | 2009-05-05 | 2009-11-04 | $7700.00 | Window Closed / Lapsed |