US8319797B2
Active / In Force
US
⏱️ 5.2 years remaining
Method and apparatus for background replacement in still photographs
Assignee: Shutterfly LLC
•
Filing: 2012-01-26
•
Granted: 2012-11-27
•
Expires: 2032-01-26
Abstract
Abstract A first digital image is acquired of a framed area while illuminating the background and foreground object under a first lighting condition. A second digital image is then acquired of the same framed area while illuminating the background and foreground object under a second lighting condition. Preferably, the first lighting condition illuminates the background without illuminating the foreground object so that a silhouette of the foreground object is acquired in the first image. The second lighting condition illuminates the foreground object (e.g., with frontal lights). Due to the difference in the illumination between the background and silhouette in the first image, an alpha mask can be created from the first acquired image. Using the mask, the background from the second image can be removed and replaced by virtually any other desired background image.
Inventors
- 👤 Richard Lee Swanson
- 👤 Earl John Adolphi
- 👤 Michael John Surma
- 👤 John Robert Reinert Nash
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:01
CPC Classifications
H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/272; H04N23/00; H04N23/56
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
97 words
An imaging system for photographing a subject, the system comprising: a foreground light source arranged and configured to illuminate the subject; a background light source arranged and configured to illuminate a background; a digital camera configured to capture still photographs of a subject arranged between the digital camera and the background; and a controller configured to: synchronize illumination of the background light source with a capture of a background illuminated image taken by the digital camera; and synchronize illumination of the foreground light source with a capture of a foreground illuminated image taken by the digital camera.
Claim 2
Dependent Claim
97 words
An imaging system for photographing a subject, the system comprising: a foreground light source arranged and configured to illuminate the subject; a background light source arranged and configured to illuminate a background; a digital camera configured to capture still photographs of a subject arranged between the digital camera and the background; and a controller configured to: synchronize illumination of the background light source with a capture of a background illuminated image taken by the digital camera; and synchronize illumination of the foreground light source with a capture of a foreground illuminated image taken by the digital camera.
Claim 3
Dependent Claim
33 words
The imaging system of claim 1 , wherein the controller is arranged and configured to capture the foreground illuminated image before complete decay of light from the illumination of the background light source.
Claim 4
Dependent Claim
19 words
The imaging system of claim 1 , wherein the digital camera is arranged and configured to capture color photographs.
Claim 5
Dependent Claim
50 words
The imaging system of claim 1 , wherein the digital camera is arranged and configured to detect visible light from the foreground light source and the background light source, and wherein the foreground light source and the background light source are positioned to provide visible light to the digital camera.
Claim 6
Dependent Claim
21 words
The imaging system of claim 1 , wherein the digital camera comprises a lens, a mechanical shutter, and a charge-coupled device.
Claim 7
Dependent Claim
33 words
The imaging system of claim 5 , wherein the mechanical shutter is synchronized to close after illumination of the foreground light source and during the digital camera's capture of the foreground illuminated image.
Claim 8
Dependent Claim
16 words
The imaging system of claim 5 , wherein the charge-coupled device is an interline-transfer charge-coupled device.
Claim 9
Dependent Claim
45 words
The imaging system of claim 7 , wherein the interline-transfer charge-coupled device includes photodiodes and shift registers, wherein the photodiodes are configured to transfer electrons associated with the background illuminated image to the shift registers prior to capturing the foreground illuminated image using the photodiodes.
Claim 10
Dependent Claim
28 words
The imaging system of claim 1 , further comprising a memory storage device, wherein the memory storage device stores the background illuminated image and the foreground illuminated image.
Claim 11
Independent Claim
74 words
A method of photographing a subject arranged in front of a background, the method comprising: synchronizing a flash of a background light source to occur while capturing a background illuminated image with a digital camera, the digital camera configured to capture still photographs, and the background light source positioned to illuminate the background; and synchronizing a flash of a foreground light source to occur while capturing a foreground illuminated image with the digital camera.
Claim 12
Independent Claim
74 words
A method of photographing a subject arranged in front of a background, the method comprising: synchronizing a flash of a background light source to occur while capturing a background illuminated image with a digital camera, the digital camera configured to capture still photographs, and the background light source positioned to illuminate the background; and synchronizing a flash of a foreground light source to occur while capturing a foreground illuminated image with the digital camera.
Claim 13
Dependent Claim
29 words
The method of claim 10 , wherein the flash of the foreground light source is timed to occur before complete decay of the flash of the background light source.
Claim 14
Dependent Claim
19 words
The method of claim 10 , wherein the background illuminated image and the foreground illuminated image are color images.
Claim 15
Dependent Claim
133 words
The method of claim 10 , further comprising timing the flash of the foreground light source to occur within a time interval of the flash of the background light source, wherein the time interval is computed according to the formula: t=w s d t /( w c v t ) where v t is a tolerated speed of a foreground object, w s is a width of the foreground illuminated image at the foreground object, d t is the number of pixels by which the background illuminated and the foreground illuminated images are permitted to be offset from each other, w c is the width (in pixels) of the background illuminated and the foreground illuminated images, and t is the time to capture both of the background illuminated and the foreground illuminated images.
Claim 16
Dependent Claim
71 words
The method of claim 10 , further comprising timing the flash of the foreground light source to occur within a time interval of the flash of the background light source, wherein the time interval is computed based on a number of pixels by which the background illuminated and the foreground illuminated images are permitted to be offset from each other, wherein the offset is less than a fraction of a pixel.
Claim 17
Dependent Claim
39 words
The method of claim 10 , wherein the digital camera comprises a lens, a mechanical shutter, and a charge-coupled device, and further comprising closing the mechanical shutter during the capturing of the foreground illuminated image with the digital camera.
Claim 18
Dependent Claim
97 words
An imaging system for photographing a subject, the system comprising: a background; a foreground light source arranged and configured to illuminate the subject; a background light source arranged and configured to illuminate the background; a digital camera configured to capture still photographs of a subject arranged between the digital camera and the background; and a controller configured to: synchronize illumination of the foreground light source with a capture of a foreground illuminated image with the digital camera; and synchronize illumination of the background light source with a capture of a background illuminated image with the digital camera.
Claim 19
Dependent Claim
97 words
An imaging system for photographing a subject, the system comprising: a background; a foreground light source arranged and configured to illuminate the subject; a background light source arranged and configured to illuminate the background; a digital camera configured to capture still photographs of a subject arranged between the digital camera and the background; and a controller configured to: synchronize illumination of the foreground light source with a capture of a foreground illuminated image with the digital camera; and synchronize illumination of the background light source with a capture of a background illuminated image with the digital camera.
Claim 20
Dependent Claim
49 words
The imaging system of claim 16 , wherein the controller generates a single trigger pulse, wherein a rising edge of the single trigger pulse triggers the illumination of the background light source and a falling edge of the single trigger pulse triggers the illumination of the foreground illuminated image.
Claim 21
Dependent Claim
25 words
The imaging system of claim 16 , wherein the foreground light source and the background light source are flash light sources that generate visible light.
Claim 22
Dependent Claim
20 words
The imaging system of claim 16 , wherein the foreground illuminated image and the background illuminated image are color images.
Claim 23
Dependent Claim
25 words
The imaging system of claim 16 , wherein the digital camera outputs the foreground illuminated image and the background illuminated image as digital image files.
References Cited (Backward Citations)
US1673019A
Cited
US2323754A
Cited
US2580422A
Cited
US2663217A
Cited
US3322487A
Cited
US4067026A
Cited
US4457599A
Cited
JPS59121029A
Cited
US5426317A
Cited
EP0512839A2
Cited
US5577179A
Cited
WO1994026057A1
Cited
US5631976A
Cited
US5831685A
Cited
US5574511A
Cited
US5923380A
Cited
US5781198A
Cited
WO1997033437A1
Cited
US6445814B2
Cited
JPH10124704A
Cited
US5870103A
Cited
US6288385B1
Cited
US5764306A
Cited
JPH1173491A
Cited
US5946500A
Cited
US6490006B1
Cited
US20030133044A1
Cited
JP2000224410A
Cited
US6950130B1
Cited
US6798897B1
Cited
US6819796B2
Cited
US7065242B2
Cited
US6707940B1
Cited
US6792140B2
Cited
US6885767B1
Cited
US6909806B2
Cited
US6912313B2
Cited
US20030035061A1
Cited
JP2003058873A
Cited
US20030058939A1
Cited
US7081898B2
Cited
US7084879B2
Cited
US6856705B2
Cited
JP2005215958A
Cited
US20070200938A1
Cited
JP2006279206A
Cited
US20070263119A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2015-11-27 | 2016-05-28 | 2016-11-27 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2019-11-27 | 2020-05-28 | 2020-11-27 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2023-11-27 | 2024-05-28 | 2024-11-27 | $7700.00 | Window Closed / Lapsed |