US6856705B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Image blending by guided interpolation
Assignee: Microsoft Technology Licensing LLC
•
Filing: 2003-04-16
•
Granted: 2005-02-15
•
Expires: 2023-04-16
Abstract
Abstract A blended result image is computed using guided interpolation to alter image data within a destination domain. The destination domain may be altered based on a guided interpolator that is either dependent or not dependent upon a source image. When blending a source region into a destination region of an image, guided interpolation eliminates or minimizes apparent seams between the inserted region and the rest of the image. A variety of interpolation guides may be used to yield different effects in the blended results image. Such interpolation guides may include without limitation an identity guide, a smooth guide, a filtering guide, a transparent guide, a masking guide, and a weighted average combination of various guides.
Inventors
- 👤 Patrick Perez
- 👤 Michel Gangnet
- 👤 Andrew Blake
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:26
CPC Classifications
G; G06; G06T; G06T5/00; G06T5/20; G06T11/00; G06T11/10; G06T11/60
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
90 words
A method of computing a blended result image from a destination image, the method comprising: defining a destination domain having a boundary in the destination image, providing a guided interpolator including an interpolation guide and a boundary condition associated with the boundary of the destination domain; and computing the blended result image based on the guided interpolator to satisfy the boundary condition at the boundary of the destination domain and to minimize a difference across the destination domain between the interpolation guide and a gradient of the blended result image.
Claim 2
Independent Claim
90 words
A method of computing a blended result image from a destination image, the method comprising: defining a destination domain having a boundary in the destination image, providing a guided interpolator including an interpolation guide and a boundary condition associated with the boundary of the destination domain; and computing the blended result image based on the guided interpolator to satisfy the boundary condition at the boundary of the destination domain and to minimize a difference across the destination domain between the interpolation guide and a gradient of the blended result image.
Claim 3
Dependent Claim
45 words
The method of claim 1 wherein the providing operation comprises: providing a masking interpolation guide as the interpolation guide, the masking interpolation guide including a gradient of the destination image within the destination domain where the gradient of the destination image satisfies a predetermined criterion.
Claim 4
Dependent Claim
36 words
The method of claim 1 wherein at least a portion of a source image is blended into the destination image to generate the blended result image, the interpolation guide being a function of the source image.
Claim 5
Dependent Claim
40 words
The method of claim 1 wherein at least a portion of a source image is blended into the destination image to generate the blended result image and further comprising: defining a source domain having a boundary in the source image.
Claim 6
Dependent Claim
34 words
The method of claim 4 wherein the providing operation comprises: providing a filtering interpolation guide as the interpolation guide, the filtering interpolation guide including a gradient of the source image within the source domain.
Claim 7
Dependent Claim
48 words
The method of claim 4 wherein the providing operation comprises: providing a transparent interpolation guide as the interpolation guide, the transparent interpolation guide including a greater of a gradient of the source image within the source domain and a gradient of the destination image within the destination domain.
Claim 8
Dependent Claim
42 words
The method of claim 1 wherein the boundary condition requires each value of image data in the blended result image at the boundary of the destination domain to equal each corresponding value of image data in the destination image at the boundary.
Claim 9
Dependent Claim
58 words
The method of claim 1 wherein the guided interpolator is represented by a functional minimization min ƒ ∫∫ Ω |∇ƒ−v| 2 , having the boundary condition ƒ| ∂Ω =ƒ*| ∂Ω , where v represents an interpolation guide, ƒ represents the blended result image within the destination domain, and ƒ* represents the blended result image outside the destination domain.
Claim 10
Dependent Claim
106 words
A computer program product encoding a computer program for executing on a computer system a computer process for computing a blended result image from a destination image, the computer process comprising: defining a destination domain having a boundary in the destination image, providing a guided interpolator including an interpolation guide and a boundary condition associated with the boundary of the destination domain; and computing the blended result image based on the guided interpolator to satisfy the boundary condition at the boundary of the destination domain and to minimize a difference across the destination domain between the interpolation guide and a gradient of the blended result image.
Claim 11
Dependent Claim
106 words
A computer program product encoding a computer program for executing on a computer system a computer process for computing a blended result image from a destination image, the computer process comprising: defining a destination domain having a boundary in the destination image, providing a guided interpolator including an interpolation guide and a boundary condition associated with the boundary of the destination domain; and computing the blended result image based on the guided interpolator to satisfy the boundary condition at the boundary of the destination domain and to minimize a difference across the destination domain between the interpolation guide and a gradient of the blended result image.
Claim 12
Dependent Claim
47 words
The computer program product of claim 9 wherein the providing operation comprises: providing a masking interpolation guide as the interpolation guide, the masking interpolation guide including a gradient of the destination image within the destination domain where the gradient of the destination image satisfies a predetermined criterion.
Claim 13
Dependent Claim
38 words
The computer program product of claim 9 wherein at least a portion of a source image is blended into the destination image to generate the blended result image, the interpolation guide being a function of the source image.
Claim 14
Dependent Claim
42 words
The computer program product of claim 9 , wherein at least a portion of a source image is blended into the destination image to generate the blended result image, further comprising: defining a source domain having a boundary in the source image.
Claim 15
Dependent Claim
36 words
The computer program product of claim 12 wherein the providing operation comprises: providing a filtering interpolation guide as the interpolation guide, the filtering interpolation guide including a gradient of the source image within the source domain.
Claim 16
Dependent Claim
50 words
The computer program product of claim 12 wherein the providing operation comprises: providing a transparent interpolation guide as the interpolation guide, the transparent interpolation guide including a greater of a gradient of the source image within the source domain and a gradient of the destination image within the destination domain.
Claim 17
Dependent Claim
44 words
The computer program product of claim 9 wherein the boundary condition requires each value of image data in the blended result image at the boundary of the destination domain to equal each corresponding value of image data in the destination image at the boundary.
Claim 18
Dependent Claim
60 words
The computer program product of claim 9 wherein the guided interpolator is represented by a functional minimization min ƒ ∫∫ Ω |∇ƒ−v| 2 , having the boundary condition ƒ| ∂Ω =ƒ*| ∂Ω , where v represents an interpolation guide, ƒ represents the blended result image within the destination domain, and ƒ* represents the blended result image outside the destination domain.
Claim 19
Independent Claim
102 words
A system for computing a blended result image from a destination image, the system comprising: a domain definition module defining a destination domain having a boundary in the destination image, an interpolation guide datastore storing a guided interpolator including an interpolation guide and a boundary condition associated with the boundary of the destination domain; and a blending computation module computing the blended result image based on the guided interpolator to satisfy the boundary condition at the boundary of the destination domain and to minimize a difference across the destination domain between the interpolation guide and a gradient of the blended result image.
Claim 20
Independent Claim
102 words
A system for computing a blended result image from a destination image, the system comprising: a domain definition module defining a destination domain having a boundary in the destination image, an interpolation guide datastore storing a guided interpolator including an interpolation guide and a boundary condition associated with the boundary of the destination domain; and a blending computation module computing the blended result image based on the guided interpolator to satisfy the boundary condition at the boundary of the destination domain and to minimize a difference across the destination domain between the interpolation guide and a gradient of the blended result image.
Claim 21
Dependent Claim
20 words
The system of claim 17 wherein the interpolation guide includes a gradient of the destination image within the destination region.
Claim 22
Dependent Claim
11 words
The system of claim 17 wherein the interpolation guide equals zero.
Claim 23
Dependent Claim
31 words
The system of claim 17 wherein the interpolation guide includes a gradient of the destination image within the destination domain where the gradient of the destination image satisfies a predetermined criterion.
Claim 24
Dependent Claim
36 words
The system of claim 17 wherein at least a portion of a source image is blended into the destination image to generate the blended result image, the interpolation guide being a function of the source image.
Claim 25
Dependent Claim
40 words
The system of claim 17 , wherein at least a portion of a source image is blended into the destination image to generate the blended result image, further comprising: defining a source domain having a boundary in the source image.
Claim 26
Dependent Claim
20 words
The system of claim 22 wherein the interpolation guide includes a gradient of the source image within the source domain.
Claim 27
Dependent Claim
34 words
The system of claim 22 wherein the interpolation guide includes a greater of a gradient of the source image within the source domain and a gradient of the destination image within the destination domain.
Claim 28
Dependent Claim
42 words
The system of claim 17 wherein the boundary condition requires each value of image data in the blended result image at the boundary of the destination domain to equal each corresponding value of image data in the destination image at the boundary.
Claim 29
Dependent Claim
58 words
The system of claim 17 wherein the guided interpolator is represented by a functional minimization min ƒ ∫∫ Ω |∇ƒ−v| 2 , having the boundary condition ƒ| ∂Ω =ƒ*| ∂Ω , where v represents an interpolation guide, ƒ represents the blended result image within the destination domain, and ƒ* represents the blended result image outside the destination domain.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2008-02-15 | 2008-08-16 | 2009-02-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2012-02-15 | 2012-08-16 | 2013-02-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2016-02-15 | 2016-08-16 | 2017-02-15 | $7700.00 | Window Closed / Lapsed |