← Back to Patent Explorer
US8768070B2 Active / In Force US ⏱️ 1.6 years remaining

Method, apparatus and computer program product for providing image modification

Assignee: Nokia Technologies Oy
•
Filing: 2008-06-27
•
Granted: 2014-07-01
•
Expires: 2028-06-27
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method for providing image modification may include searching an image gallery based on a characteristic of a captured image, determining a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic, and enabling modification of the captured image based on features associated with the similar image that are not visible in the captured image. An apparatus and computer program product corresponding to the method are also provided.

Inventors

  • 👤 Natasha Gelfand
  • 👤 Wei-Chao Chen
  • 👤 Kari Antero Pulli

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 10:03
CPC Classifications
G; G06; G06T; G06T11/00; G06T11/60; G06F; G06F16/00; G06F16/50; G06F16/58; G06F16/587

Claims Analysis

Total Claims: 48
Claim 1
Independent Claim 159 words
A method comprising: detecting at least one erasable feature in a foreground of a captured image; searching an image gallery based on a characteristic of the captured image, wherein the image gallery comprises a plurality of images; determining, using a processor, a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; causing the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and causing a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 2
Independent Claim 159 words
A method comprising: detecting at least one erasable feature in a foreground of a captured image; searching an image gallery based on a characteristic of the captured image, wherein the image gallery comprises a plurality of images; determining, using a processor, a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; causing the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and causing a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 3
Dependent Claim 22 words
The method of claim 1 , further comprising causing an indication of an erasable feature to be displayed in the captured image.
Claim 4
Dependent Claim 27 words
The method of claim 2 , further comprising causing the erasable feature to be displayed in a distinctive manner relative to other features of the captured image.
Claim 5
Dependent Claim 44 words
The method of claim 1 , further comprising causing an indication of an additional feature that is configured to be added to the captured image to be displayed based on data shown in the similar image that is not included in the captured image.
Claim 6
Dependent Claim 27 words
The method of claim 1 , further comprising receiving an indication of search criteria defining a basis on which to select an image as the similar image.
Claim 7
Dependent Claim 28 words
The method of claim 1 , further comprising receiving search criteria defining an allowable source associated with the image gallery from which to search for the similar image.
Claim 8
Dependent Claim 42 words
The method of claim 1 , further comprising receiving an indication of a selection of an option for automatic updating of modification of the captured image in response to a future addition of an image sharing the characteristic to the image gallery.
Claim 9
Dependent Claim 19 words
The method of claim 1 , wherein determining the correlation comprises aligning the similar image and the captured image.
Claim 10
Dependent Claim 31 words
The method of claim 1 , wherein searching the image gallery based on the characteristic comprises searching the image gallery based on metadata indicative of a subject of the captured image.
Claim 11
Dependent Claim 31 words
The method of claim 1 , wherein searching the image gallery based on the characteristic comprises searching the image gallery based on information indicative of a location of the captured image.
Claim 12
Dependent Claim 20 words
The method of claim 1 , further comprising causing an indication of availability of the similar image to be provided.
Claim 13
Independent Claim 183 words
An apparatus comprising: a processor; and a memory including computer program code, the memory and the computer program code configured to, with the processor, cause the apparatus to at least: detect at least one erasable feature in a foreground of a captured image; search an image gallery based on a characteristic of a captured image, wherein the image gallery comprises a plurality of images; determine a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; cause the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and cause a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 14
Independent Claim 183 words
An apparatus comprising: a processor; and a memory including computer program code, the memory and the computer program code configured to, with the processor, cause the apparatus to at least: detect at least one erasable feature in a foreground of a captured image; search an image gallery based on a characteristic of a captured image, wherein the image gallery comprises a plurality of images; determine a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; cause the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and cause a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 15
Dependent Claim 39 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to cause an indication of an erasable feature to be displayed in the captured image.
Claim 16
Dependent Claim 44 words
The apparatus of claim 13 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to cause the erasable feature to be displayed in a distinctive manner relative to other features of the captured image.
Claim 17
Dependent Claim 59 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to cause an indication of an additional feature to be displayed that may be added to the captured image based on data shown in the similar image that is not included in the captured image.
Claim 18
Dependent Claim 45 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to receive an indication of search criteria that defines a basis on which to select an image as the similar image.
Claim 19
Dependent Claim 45 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to receive search criteria defining an allowable source associated with the image gallery from which to search for the similar image.
Claim 20
Dependent Claim 59 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to receive an indication of a selection of an option for automatic updating of modification of the captured image in response to a future addition of an image sharing the characteristic to the image gallery.
Claim 21
Dependent Claim 37 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to determine the correlation by aligning the similar image and the captured image.
Claim 22
Dependent Claim 49 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to search the image gallery based on the characteristic by searching the image gallery based on metadata indicative of a subject of the captured image.
Claim 23
Dependent Claim 49 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to search the image gallery based on the characteristic by searching the image gallery based on information indicative of a location of the captured image.
Claim 24
Dependent Claim 37 words
The apparatus of claim 12 , wherein the memory including the computer program code is further configured to, with the processor, cause the apparatus to cause an indication of availability of the similar image to be displayed.
Claim 25
Dependent Claim 203 words
A computer program product comprising at least one computer-readable non-transitory storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising: first program code instructions for detecting at least one erasable feature in a foreground of a captured image; second program code instructions for searching an image gallery based on a characteristic of a captured image, wherein the image gallery comprises a plurality of images; third program code instructions for determining a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; fourth program code instructions for causing the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and fifth program code instructions for causing a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 26
Dependent Claim 203 words
A computer program product comprising at least one computer-readable non-transitory storage medium having computer-executable program code instructions stored therein, the computer-executable program code instructions comprising: first program code instructions for detecting at least one erasable feature in a foreground of a captured image; second program code instructions for searching an image gallery based on a characteristic of a captured image, wherein the image gallery comprises a plurality of images; third program code instructions for determining a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; fourth program code instructions for causing the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and fifth program code instructions for causing a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 27
Dependent Claim 30 words
The computer program product of claim 23 , wherein the fourth program instructions include instructions for causing an indication of an erasable feature to be displayed in the captured image.
Claim 28
Dependent Claim 35 words
The computer program product of claim 24 , wherein the fourth program instructions include instructions for causing the erasable feature to be displayed in a distinctive manner relative to other features of the captured image.
Claim 29
Dependent Claim 50 words
The computer program product of claim 23 , wherein the fourth program instructions include instructions for causing an indication of an additional feature to be displayed that may be added to the captured image based on data shown in the similar image that is not included in the captured image.
Claim 30
Dependent Claim 48 words
The computer program product of claim 23 , further comprising sixth program code instructions for causing a dialog box to be displayed; and receiving search criteria defining a basis on which to select an image as the similar image based on a user interaction with the dialog box.
Claim 31
Dependent Claim 47 words
The computer program product of claim 23 , wherein the fourth program instructions include instructions for causing an option for automatic updating of modification of the captured image to be displayed in response to a future addition of an image sharing the characteristic to the image gallery.
Claim 32
Dependent Claim 24 words
The computer program product of claim 23 , wherein the third program instructions include instructions for aligning the similar image and the captured image.
Claim 33
Dependent Claim 27 words
The computer program product of claim 23 , further comprising sixth program code instructions for causing an indication of availability of the similar image to be displayed.
Claim 34
Independent Claim 166 words
An apparatus comprising: means for detecting at least one erasable feature in a foreground of a captured image; means for searching an image gallery based on a characteristic of a captured image, wherein the image gallery comprises a plurality of images; means for determining a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; means for causing the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and means for causing a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 35
Independent Claim 166 words
An apparatus comprising: means for detecting at least one erasable feature in a foreground of a captured image; means for searching an image gallery based on a characteristic of a captured image, wherein the image gallery comprises a plurality of images; means for determining a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; means for causing the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and means for causing a composite image to be displayed, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 36
Dependent Claim 13 words
The apparatus of claim 21 , further comprising means for receiving search criteria.
Claim 37
Independent Claim 239 words
A system comprising: a mobile terminal configured to cause the transmission of one or more captured images and cause a composite image to be displayed; and a network device configured to receive the one or more captured images and generate the composite image, the network device comprising a processor and a memory including computer program code, the memory and the computer program code configured to, with the processor, cause the network device to at least: detect at least one erasable feature in a foreground of a captured image of the one or more captured images; search an image gallery based on a characteristic of the captured image, wherein the image gallery comprises a plurality of images; determine a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; cause the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and generate the composite image that is displayable on the mobile terminal, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 38
Independent Claim 239 words
A system comprising: a mobile terminal configured to cause the transmission of one or more captured images and cause a composite image to be displayed; and a network device configured to receive the one or more captured images and generate the composite image, the network device comprising a processor and a memory including computer program code, the memory and the computer program code configured to, with the processor, cause the network device to at least: detect at least one erasable feature in a foreground of a captured image of the one or more captured images; search an image gallery based on a characteristic of the captured image, wherein the image gallery comprises a plurality of images; determine a correlation between the captured image and a similar image from the image gallery, the similar image sharing the characteristic; cause the captured image to be modified by erasing the at least one erasable feature associated with the captured image, wherein the at least one erasable feature is not visible in the similar image; and generate the composite image that is displayable on the mobile terminal, the composite image comprising the captured image having the erased feature in the foreground replaced with pixels from a corresponding location in the similar image, wherein the pixels from the corresponding location in the similar image are background pixels that were blocked in the captured image by the at least one erasable feature in the foreground.
Claim 39
Dependent Claim 51 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least identify an erasable feature in the captured image and cause an indication of the erasable feature to be displayed on the mobile terminal.
Claim 40
Dependent Claim 17 words
The system of claim 33 , wherein the image gallery comprises the one or more captured images.
Claim 41
Dependent Claim 72 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least identify an additional feature that is to be added to the captured image based on data shown in the similar image that is not included in the captured image and cause an indication of the erasable feature to be displayed on the mobile terminal.
Claim 42
Dependent Claim 22 words
The system of claim 33 , wherein the mobile terminal is further configured to receive a request to generate the composite image.
Claim 43
Dependent Claim 54 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least receive search criteria from the mobile terminal defining one or more allowable sources associated with the image gallery from which to search for the similar image.
Claim 44
Dependent Claim 66 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least receive an indication from the mobile terminal of a selection of an option for automatic updating of modification of the captured image in response to a future addition of an image sharing the characteristic to the image gallery.
Claim 45
Dependent Claim 40 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least align the similar image and the captured image to determine the correlation.
Claim 46
Dependent Claim 43 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least search the image gallery based on metadata indicative of a subject of the captured image.
Claim 47
Dependent Claim 53 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least search the image gallery based on the characteristic that comprises searching the image gallery based on information indicative of a location of the captured image.
Claim 48
Dependent Claim 56 words
The system of claim 33 , wherein the memory and the computer program code is further configured to, with the processor, cause the network device to at least identify an availability of the similar image to be provided and cause an indication of the availability of the similar image to be displayed on the mobile terminal.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2017-06-30 2017-12-30 2018-07-01 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2021-06-30 2021-12-30 2022-07-01 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2025-06-30 2025-12-30 2026-07-01 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag