Patent US6508553B2 successfully refreshed from Google Patents.
US6508553B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Interactive eyewear selection system
Assignee: Virtual Visual Devices LLC
•
Filing: 2001-05-14
•
Granted: 2003-01-21
•
Expires: 2021-05-14
Abstract
Abstract A method of determining eyeglass frame parameters from a digital image of the person's face and a digital image of an eyeglass frame. The method comprises the steps of: (a) providing a digital image of the person's face; (b) determining a physical scale of the face using a scaling factor; (c) locating center points P 1 , P 2 of the left and right irises in the face image, and determining a pupil midpoint P c ; (d) providing a digital image of an eyeglass frame; (e) adjusting, if necessary, the size of the frame to the physical scale of the face; (f) combining the frame and face images such that the frame is superimposed on the face; (g) aligning the frame and face in accordance with the frame center point f c and the pupil midpoint P c ; and (h) determining the frame parameters.
Inventors
- 👤 Feng Gao
- 👤 Wei Li
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:03
CPC Classifications
G; G02; G02C; G02C13/00; G02C13/003; G02C13/005
Claims Analysis
Total Claims: 42
Claim 1
Independent Claim
231 words
A method of automatically determining eyeglass frame parameters from digital image of a person's face and a digital image of an eyeglass frame, said method comprising the steps of: (a) providing a digital image of the person's face, the face depicted in the face image containing left and right eyes with left and right irises, respectively; (b) determining a physical scale of the face in the face image; (c) locating a center point P 1 of the left iris of the face image, locating a center point P 2 of the right iris of the face image, and determining a pupil midpoint P c between the center points P 1 and P 2 ; (d) providing a digital image of an eyeglass frame, the frame depicted in the digital image having left and right frame rims; (e) adjusting, if necessary, the size of the frame of the frame image to the physical scale of the face of the face image; (f) combining the frame image with the face image to create a combined image, the combined image depicting the frame of the frame image superimposed on the face of the face image; (g) aligning the frame relative to the face in the combined image; and (h) determining the left and the right monocular PDs from the center points P 1 and P 2 and from the pupil midpoint P c .
Claim 2
Independent Claim
231 words
A method of automatically determining eyeglass frame parameters from digital image of a person's face and a digital image of an eyeglass frame, said method comprising the steps of: (a) providing a digital image of the person's face, the face depicted in the face image containing left and right eyes with left and right irises, respectively; (b) determining a physical scale of the face in the face image; (c) locating a center point P 1 of the left iris of the face image, locating a center point P 2 of the right iris of the face image, and determining a pupil midpoint P c between the center points P 1 and P 2 ; (d) providing a digital image of an eyeglass frame, the frame depicted in the digital image having left and right frame rims; (e) adjusting, if necessary, the size of the frame of the frame image to the physical scale of the face of the face image; (f) combining the frame image with the face image to create a combined image, the combined image depicting the frame of the frame image superimposed on the face of the face image; (g) aligning the frame relative to the face in the combined image; and (h) determining the left and the right monocular PDs from the center points P 1 and P 2 and from the pupil midpoint P c .
Claim 3
Dependent Claim
42 words
The method of claim 1 , wherein the frame of the frame image imcludes a frame reference point located between the frame rims, and wherein said step (g) includes aligning the frame with the face in accordance with the frame reference point.
Claim 4
Dependent Claim
46 words
The method of claim 2 , wherein the frame reference point is the midpoint f c between the frame rims, and wherein said step (g) includes aligning the frame with the face in accordance with the midpoint f c and the pupil midpoint P c .
Claim 5
Dependent Claim
105 words
The method of claim 1 , wherein the left and the right frame rims of the frame image contain first and second points, respectively, and wherein a first frame parameter d 1 is defined as the distance from the first point to the bottom of the left frame rim and wherein a second frame parameter d 2 is defined as the distance from the second point to the bottom of the right frame rim, said method further comprising the steps of: (i) determining the left and the right ocular centers from the first and the second frame parameters, d 1 and d 2 , respectively.
Claim 6
Dependent Claim
24 words
The method of claim 4 , wherein the first and the second points are the centroids of the left and the right rims, respectively.
Claim 7
Dependent Claim
62 words
The method of claim 4 , further comprising the steps of: (j) determining the radii of the left and the right irises of the face image; and (k) determining the left and the right seg-heights from the radii of the left and the right irises, respectively, and from the first and the second frame parameters, d 1 and d 2 , respectively.
Claim 8
Dependent Claim
48 words
The method of claim 6 , further comprising the steps of: (l) adjusting the position of the frame relative to the position of the face in the combined image by an adjustment factor, the monocular PDs, ocular centers, and seg-heights being adjusted in accordance with the adjustment factor.
Claim 9
Dependent Claim
25 words
The method of claim 7 , wherein said step (1) includes automatically adjusting the position of the frame relative to the position of the face.
Claim 10
Dependent Claim
25 words
The method of claim 7 , wherein said step (1) includes manually adjusting the position of the frame relative to the position of the face.
Claim 11
Independent Claim
226 words
A method of processing a digital eyeglass frame image which depicts an eyeglass frame having a nosepad, said method comprising the steps of: (a) providing a first digital color image depicting the eyeglass frame in front of a first background; (b) providing a second digital color image, the second image depicting a second background without the eyeglass frame; (c) generating first and second gray level images from the first and the second digital color images, respectively, the first and the second gray level images each containing gray level pixel data, the pixel data of the first gray level image including eyeglass frame data and background data, the eyeglass frame data including nosepad data; (d) determining the locations of the eyeglass frame data in the first gray level image by determining the difference between the pixel data of the first gray level image and the pixel data of the second gray level image and comparing the difference with a first threshold value; (e) determining the locations of the nosepad data in the first gray level image by comparing the eyeglass frame data of the first gray level image to a second threshold value; and (f) modifying the first digital color image by assigning a pre-determined color N to locations of the first color image that correspond to the locations of the nosepad data determined in said step.
Claim 12
Independent Claim
226 words
A method of processing a digital eyeglass frame image which depicts an eyeglass frame having a nosepad, said method comprising the steps of: (a) providing a first digital color image depicting the eyeglass frame in front of a first background; (b) providing a second digital color image, the second image depicting a second background without the eyeglass frame; (c) generating first and second gray level images from the first and the second digital color images, respectively, the first and the second gray level images each containing gray level pixel data, the pixel data of the first gray level image including eyeglass frame data and background data, the eyeglass frame data including nosepad data; (d) determining the locations of the eyeglass frame data in the first gray level image by determining the difference between the pixel data of the first gray level image and the pixel data of the second gray level image and comparing the difference with a first threshold value; (e) determining the locations of the nosepad data in the first gray level image by comparing the eyeglass frame data of the first gray level image to a second threshold value; and (f) modifying the first digital color image by assigning a pre-determined color N to locations of the first color image that correspond to the locations of the nosepad data determined in said step.
Claim 13
Dependent Claim
18 words
The method of claim 10 , wherein the first and the second backgrounds are the same pre-set background.
Claim 14
Dependent Claim
26 words
The method of claim 10 , wherein the first gray level image is a sub-image of a gray level image of the first digital color image.
Claim 15
Dependent Claim
40 words
The method of claim 10 , wherein the locations of the eyeglass frame data are those locations wherein the difference between the pixel data of the first and the second gray level images is greater than the first threshold value.
Claim 16
Dependent Claim
13 words
The method of claim 13 , wherein the first threshold value is 20.
Claim 17
Dependent Claim
28 words
The method of claim 10 , wherein the locations of the nosepad data are those locations where the eyeglass frame data is greater than the second thershold value.
Claim 18
Dependent Claim
13 words
The method of claim 15 , wherein the second threshold value is 190.
Claim 19
Dependent Claim
101 words
The method of claim 10 , further comprising the steps of: (g) providing a third digital color image, the third image depicting a person's face; (h) combining the first digital color image, as modified in said step (f), with the third image to create a combined color image, the combined image depicting the eyeglass frame superimposed naturally on the person's face; and (i) mixing the pre-determined color N with the color of the person's face in the combined image where the nosepad of the eyeglass frame is depicted, such that the nosepad in the combined image appears at least partially transparent.
Claim 20
Dependent Claim
26 words
The method of claim 17 , wherein the pre-determined color N is mixed with color of the face in accordance with the equation: nosepad=0.8·face color +0.2·N.
Claim 21
Independent Claim
155 words
A method of producing a blending coefficient for representing the degree of transparency in a transparent or semi-transparent eyeglass frame depicted in a digital image, said method comprising the steps of: (a) providing a first digital color image, the first image depicting the eyeglass frame in front of a first background; (b) providing a second digital color image, the second image depicting a second background without the eyeglass frame; (c) generating first and second gray level images from the first and the second digital color images, respectively, the first and the second gray level images each containing gray level pixel data, the pixel data of the first gray level image including eyeglass frame data and background data; (d) determining the difference between the pixel data of the first gray level image and the pixel data of the second gray level image; and (e) determining the blending coefficient from the difference determined in said step (d).
Claim 22
Independent Claim
155 words
A method of producing a blending coefficient for representing the degree of transparency in a transparent or semi-transparent eyeglass frame depicted in a digital image, said method comprising the steps of: (a) providing a first digital color image, the first image depicting the eyeglass frame in front of a first background; (b) providing a second digital color image, the second image depicting a second background without the eyeglass frame; (c) generating first and second gray level images from the first and the second digital color images, respectively, the first and the second gray level images each containing gray level pixel data, the pixel data of the first gray level image including eyeglass frame data and background data; (d) determining the difference between the pixel data of the first gray level image and the pixel data of the second gray level image; and (e) determining the blending coefficient from the difference determined in said step (d).
Claim 23
Dependent Claim
49 words
The method of claim 19 , wherein said step (d) includes determining the standard deviation between the pixel data of the first gray level image and the pixel data of the second gray level image; and wherein said step (e) includes determining the blending coefficient from said standard deviation.
Claim 24
Dependent Claim
26 words
The method of claim 19 , further comprising the step of: (f) smoothing the second digital color image before generating the second gray level image therefrom.
Claim 25
Dependent Claim
16 words
The method of claim 19 , further comprising the step of: (f) normalizing the blending coefficient.
Claim 26
Dependent Claim
25 words
The method of claim 22 , further comprising the step of: (g) storing the normalized blending coefficient in association with the first digital color image.
Claim 27
Independent Claim
121 words
A method of producing a composite digital color image of a transparent or semi-transparent eyeglass frame superimposed on a person's face, using a blending coefficient, said method comprising the steps of: (a) providing a first digital color image, the first image depicting a transparent or semi-transparent eyeglass frame; (b) providing a blending coefficient associated with the first image; (c) providing a second digital color image, the second image depicting a person's face; (d) combining the first image with the second image to create a composite digital color image, the composite image depicting the eyeglass frame superimposed naturally on the person's face; and (e) in the composite image, blending the person's face with the eyeglass frame in accordance with the blending coefficient.
Claim 28
Independent Claim
121 words
A method of producing a composite digital color image of a transparent or semi-transparent eyeglass frame superimposed on a person's face, using a blending coefficient, said method comprising the steps of: (a) providing a first digital color image, the first image depicting a transparent or semi-transparent eyeglass frame; (b) providing a blending coefficient associated with the first image; (c) providing a second digital color image, the second image depicting a person's face; (d) combining the first image with the second image to create a composite digital color image, the composite image depicting the eyeglass frame superimposed naturally on the person's face; and (e) in the composite image, blending the person's face with the eyeglass frame in accordance with the blending coefficient.
Claim 29
Dependent Claim
12 words
The method of claim 24 , wherein the blending coefficient is normalized.
Claim 30
Dependent Claim
52 words
The method of claim 25 , wherein said steps (d) and (e) are performed in accordance with the following equation: C(x,y)=[{overscore (c(x,y))}/255]·face (x,y) +]1−{overscore (c(x,y))}/255]·frame (x,y), where C(x,y) represents the composite image, {overscore (c(x,y))} represents the normalized blending coefficient, face (x,y) represents the second image, and frame (x,y) represents the first image.
Claim 31
Independent Claim
137 words
A method of re-sizing an eyeglass frame depicted in a digital eyeglass frame image, said method comprising the steps of: (a) providing a digital image of an eyeglass frame, the frame having a pair of rims and a bridge, the frame having a size Q2-Q1 and the bridge having a size B2-B1; (b) employing a rim scaling factor which is a function of (i) the frame size Q2-Q1; (ii) a selected rim size EYE, and (iii) a selected bridge size DBL; (c) employing a bridge scaling factor which is a function of the bridge size B2-B1 and the selected bridge size DBL; and (d) changing the size of the frame of the digital image by scaling the pair of rims and the bridge of the frame separately, if necessary, using the rim and the bridge scaling factors.
Claim 32
Independent Claim
137 words
A method of re-sizing an eyeglass frame depicted in a digital eyeglass frame image, said method comprising the steps of: (a) providing a digital image of an eyeglass frame, the frame having a pair of rims and a bridge, the frame having a size Q2-Q1 and the bridge having a size B2-B1; (b) employing a rim scaling factor which is a function of (i) the frame size Q2-Q1; (ii) a selected rim size EYE, and (iii) a selected bridge size DBL; (c) employing a bridge scaling factor which is a function of the bridge size B2-B1 and the selected bridge size DBL; and (d) changing the size of the frame of the digital image by scaling the pair of rims and the bridge of the frame separately, if necessary, using the rim and the bridge scaling factors.
Claim 33
Dependent Claim
30 words
The method of claim 27 , wherein the rim scaling factor is determined by the following equation: (Q2-Q1)/(2·EYE+DBL), and the bridge scaling factor is determined by the following equation: (B2-B1)/DBL.
Claim 34
Independent Claim
197 words
A method of stimulating color contact lenses on the eyes of a person depicted in a digital color image, said method comprising the steps of: (a) providing a digital color image of a person's face, the face having a pair of eyes each containing an iris and a pupil; (b) defining an outside area on each of the pair of eyes, the outside area surrounding the iris and having a boundary; (c) defining an inside area on each of the pair of eyes, the inside area being located inside the outside area and having a boundary which substantially bounds the pupil; (d) selecting a contact lens color; and (e) creating a composite digital color image of the person's face and the contact lens color, by mixing the contact lens color with the person's face within the boundary of the outside area, the proportion of the contact lens color to the person's face varying from a higher number at the boundary of the inside area to a lower number at the boundary of the outside area, whereby the contact lens color in the composite image simulates color contact lenses being worn naturally on the eyes of the person.
Claim 35
Independent Claim
197 words
A method of stimulating color contact lenses on the eyes of a person depicted in a digital color image, said method comprising the steps of: (a) providing a digital color image of a person's face, the face having a pair of eyes each containing an iris and a pupil; (b) defining an outside area on each of the pair of eyes, the outside area surrounding the iris and having a boundary; (c) defining an inside area on each of the pair of eyes, the inside area being located inside the outside area and having a boundary which substantially bounds the pupil; (d) selecting a contact lens color; and (e) creating a composite digital color image of the person's face and the contact lens color, by mixing the contact lens color with the person's face within the boundary of the outside area, the proportion of the contact lens color to the person's face varying from a higher number at the boundary of the inside area to a lower number at the boundary of the outside area, whereby the contact lens color in the composite image simulates color contact lenses being worn naturally on the eyes of the person.
Claim 36
Dependent Claim
28 words
The method of claim 29 , wherein the proportion of the contact lens color to the person's face is substantially constant within the boundary of the inside area.
Claim 37
Dependent Claim
25 words
The method of claim 29 , wherein the composite image is created by the following equation: Composite Image=Coef·face+(1-Coef)·lens color, where Coef is a mixing coefficient.
Claim 38
Dependent Claim
54 words
The method of claim 31 , wherein the outside area has a radius r 2 and the inside area has a radius r 1 , and wherein the mixing coefficient Coef is defined by the following equation: Coef=0.9; r<r 1 Coef=0.2(r−r 1 )/(r 2 −r 1 )+0.8; r 1 ≦r≦r 2 Coef=1; r 2<r.
Claim 39
Dependent Claim
37 words
The method of claim 29 , wherein the outside area on each eye is elliptically shaped and has a major radius r 2 kand a minor radius that is substantially equal to the radius of the iris.
Claim 40
Dependent Claim
26 words
The method of claim 33 , wherein the major radius of the outside area on each eye is about 1.4 times the radius of the iris.
Claim 41
Dependent Claim
29 words
The method of claim 34 , wherein the inside area on each eye is circular shaped and has a radius of about 0.4 times the radius of the iris.
Claim 42
Dependent Claim
142 words
The method of claim 29 , further comprising the steps of: (f) detecting the centers of the irises of the pair of eyes, the outside and the inside areas on one of the pair of eyes is substantially centered at the center of the iris of the one eye, and the outside and the inside areas of the other one of the pair of eyes is substantially centered at the center of the iris of the other eye; and (g) determining the radii of the irises of the one and the other eyes, the outside and the inside areas on the one eye having radii that are a function of the iris radius of the one eye, and the outside and the inside areas of the other eye having radii that are a function of the iris radius of the other eye.
References Cited (Backward Citations)
US4539585A
Cited
US4730260A
Cited
US4823285A
Cited
US4845641A
Cited
US4852184A
Cited
US4991005A
Cited
US5280570A
Cited
US5717454A
Cited
US5576778A
Cited
US5617155A
Cited
US5598223A
Cited
US5585874A
Cited
US5592248A
Cited
US5875017A
Cited
US5983201A
Cited
US6088470A
Cited
US6142628A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2006-01-20 | 2006-07-22 | 2007-01-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2010-01-20 | 2010-07-22 | 2011-01-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2014-01-20 | 2014-07-22 | 2015-01-21 | $7700.00 | Window Closed / Lapsed |