US9286707B1
Active / In Force
US
⏱️ 7.4 years remaining
Removing transient objects to synthesize an unobstructed image
Assignee: Google LLC
•
Filing: 2014-04-04
•
Granted: 2016-03-15
•
Expires: 2034-04-04
Abstract
Abstract In one aspect, the present subject matter is directed to a computer-implemented method for removing transient objects to synthesize an unobstructed image. The method includes receiving a plurality of images from a user. A most common value at a same pixel of each image is determined to infer pixels associated with a background of the images. A composition is generated from the received images, wherein the composition includes one of the pixels associated with the background of the images in place of a pixel associated with a foreground of at least one of the images.
Inventors
- 👤 Daniel Jules Switkin
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:03
CPC Classifications
G; G06; G06T; G06T11/00; G06T11/60; G06K9/4652
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
222 words
A computer-implemented method for removing transient objects to synthesize an unobstructed image comprising: receiving, by one or more computing devices, a plurality of images from a user, wherein the plurality of images comprise one or more transient objects; determining, by the one or more computing devices, a most common value at a same pixel of each image to infer pixels associated with a background of the images; determining, by the one or more computing devices, a most common value at a same pixel of each image to infer pixels associated with a foreground of at least one of the images wherein at least one of the pixels associated with the foreground of the at least one of the images are located in the same portion of the images as at least one of the pixels associated with a background of the images; and generating, by the one or more computing devices, a composition from the received images, wherein the composition comprises one of the pixels associated with the background of the images based on the determined most common value at a same pixel of each image as a replacement for a pixel associated with the foreground of at least one of the images based on the determined most common value at a same pixel of each image to synthesize an unobstructed image.
Claim 2
Dependent Claim
222 words
A computer-implemented method for removing transient objects to synthesize an unobstructed image comprising: receiving, by one or more computing devices, a plurality of images from a user, wherein the plurality of images comprise one or more transient objects; determining, by the one or more computing devices, a most common value at a same pixel of each image to infer pixels associated with a background of the images; determining, by the one or more computing devices, a most common value at a same pixel of each image to infer pixels associated with a foreground of at least one of the images wherein at least one of the pixels associated with the foreground of the at least one of the images are located in the same portion of the images as at least one of the pixels associated with a background of the images; and generating, by the one or more computing devices, a composition from the received images, wherein the composition comprises one of the pixels associated with the background of the images based on the determined most common value at a same pixel of each image as a replacement for a pixel associated with the foreground of at least one of the images based on the determined most common value at a same pixel of each image to synthesize an unobstructed image.
Claim 3
Dependent Claim
29 words
The computer-implemented method of claim 1 , wherein the most common value at the same pixel of each image is not present in a majority of the same pixels.
Claim 4
Dependent Claim
19 words
The computer-implemented method of claim 1 , wherein the most common value comprises luminance, hue, saturation, or combinations thereof.
Claim 5
Dependent Claim
25 words
The computer-implemented method of claim 1 , wherein the most common value is determined by calculating a median value of each pixel of each image.
Claim 6
Dependent Claim
23 words
The computer-implemented method of claim 1 , further comprising preprocessing one or more of the images prior to determining the most common value.
Claim 7
Dependent Claim
19 words
The computer-implemented method of claim 5 , wherein preprocessing comprises determining sharpness of one or more of the images.
Claim 8
Dependent Claim
15 words
The computer-implemented method of claim 1 , further comprising providing the composition to the user.
Claim 9
Dependent Claim
21 words
The computer-implemented method of claim 1 , further comprising: aligning one or more of the images used in each generated composition.
Claim 10
Dependent Claim
21 words
The computer-implemented method of claim 1 , further comprising: normalizing one or more of the images used in each generated composition.
Claim 11
Dependent Claim
21 words
The computer-implemented method of claim 1 , further comprising: smoothing one or more of the images used in each generated composition.
Claim 12
Independent Claim
230 words
A system for removing transient objects to synthesize an unobstructed image, the system comprising: one or more computing devices including one or more processors and associated memory, the memory storing instructions that, when executed by the one or more processors, configure the one or more computing devices to: receive a plurality of images from a user, wherein the plurality of images comprise one or more transient objects; determine a most common value at a same pixel of each image to infer pixels associated with a background of the images; determine a most common value at a same pixel of each image to infer pixels associated with a foreground of at least one of the images wherein at least one of the pixels associated with the foreground of the at least one of the images are located in the same portion of the images as at least one of the pixels associated with a background of the images; and generate a composition from the received images, wherein the composition comprises one of the pixels associated with the background of the images based on the determined most common value at a same pixel of each image as a replacement for a pixel associated with the foreground of at least one of the images based on the determined most common value at a same pixel of each image to synthesize an unobstructed image.
Claim 13
Independent Claim
230 words
A system for removing transient objects to synthesize an unobstructed image, the system comprising: one or more computing devices including one or more processors and associated memory, the memory storing instructions that, when executed by the one or more processors, configure the one or more computing devices to: receive a plurality of images from a user, wherein the plurality of images comprise one or more transient objects; determine a most common value at a same pixel of each image to infer pixels associated with a background of the images; determine a most common value at a same pixel of each image to infer pixels associated with a foreground of at least one of the images wherein at least one of the pixels associated with the foreground of the at least one of the images are located in the same portion of the images as at least one of the pixels associated with a background of the images; and generate a composition from the received images, wherein the composition comprises one of the pixels associated with the background of the images based on the determined most common value at a same pixel of each image as a replacement for a pixel associated with the foreground of at least one of the images based on the determined most common value at a same pixel of each image to synthesize an unobstructed image.
Claim 14
Dependent Claim
28 words
The system of claim 11 , wherein the most common value at the same pixel of each image is not present in a majority of the same pixels.
Claim 15
Dependent Claim
18 words
The system of claim 11 , wherein the most common value comprises luminance, hue, saturation, or combinations thereof.
Claim 16
Dependent Claim
24 words
The system of claim 11 , wherein the most common value is determined by calculating a median value of each pixel of each image.
Claim 17
Dependent Claim
14 words
The system of claim 11 , further comprising providing the composition to the user.
Claim 18
Dependent Claim
215 words
A tangible, non-transitory computer-readable medium comprising: computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations, comprising: receiving a plurality of images from a user, wherein the plurality of images comprise one or more transient objects; determining a most common value at a same pixel of each image to infer pixels associated with a background of the images; determining, by the one or more computing devices, a most common value at a same pixel of each image to infer pixels associated with a foreground of at least one of the images wherein at least one of the pixels associated with the foreground of the at least one of the images are located in the same portion of the images as at least one of the pixels associated with a background of the images; and generating, a composition from the received images, wherein the composition comprises one of the pixels associated with the background of the images based on the determined most common value at a same pixel of each image as a replacement for a pixel associated with the foreground of at least one of the images based on the determined most common value at a same pixel of each image to synthesize an unobstructed image.
Claim 19
Dependent Claim
215 words
A tangible, non-transitory computer-readable medium comprising: computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations, comprising: receiving a plurality of images from a user, wherein the plurality of images comprise one or more transient objects; determining a most common value at a same pixel of each image to infer pixels associated with a background of the images; determining, by the one or more computing devices, a most common value at a same pixel of each image to infer pixels associated with a foreground of at least one of the images wherein at least one of the pixels associated with the foreground of the at least one of the images are located in the same portion of the images as at least one of the pixels associated with a background of the images; and generating, a composition from the received images, wherein the composition comprises one of the pixels associated with the background of the images based on the determined most common value at a same pixel of each image as a replacement for a pixel associated with the foreground of at least one of the images based on the determined most common value at a same pixel of each image to synthesize an unobstructed image.
Claim 20
Dependent Claim
30 words
The computer readable medium of claim 16 , wherein the most common value at the same pixel of each image is not present in a majority of the same pixels.
Claim 21
Dependent Claim
20 words
The computer readable medium of claim 16 , wherein the most common value comprises luminance, hue, saturation, or combinations thereof.
Claim 22
Dependent Claim
26 words
The computer readable medium of claim 16 , wherein the most common value is determined by calculating a median value of each pixel of each image.
References Cited (Backward Citations)
US7142697B2
Cited
US20030215143A1
Cited
US20110293190A1
Cited
US20110103644A1
Cited
US20150117794A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2019-03-15 | 2019-09-14 | 2020-03-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2023-03-15 | 2023-09-14 | 2024-03-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2027-03-15 | 2027-09-14 | 2028-03-15 | $7700.00 | Pending Window |