← Back to Patent Explorer
US9602691B2 Active / In Force US ⏱️ 8.8 years remaining

Image processing apparatus that determines code corresponding to a digital watermark embedded in an image

Assignee: Canon Inc
•
Filing: 2015-08-25
•
Granted: 2017-03-21
•
Expires: 2035-08-25
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Upon capturing a digital watermark-embedded print product by an image capturing device held by the hand of a user and extracting embedded information, the relative speed between the hand-held image capturing device and the print product changes, failing in extracting the embedded additional information. In an embodiment, the image capturing device performs continuous shooting for every small area to read the print product. A shoot image is analyzed to calculate the feature amount of the image. Information about an image capturing quality characteristic generated at the time of capturing the print product is estimated, and a change of the feature amount accompanying the image capturing quality characteristic is predicted based on the estimation result. A code indicated by the watermark is determined based on the calculation result and the prediction result.

Inventors

  • 👤 Nobutaka Miyake
  • 👤 Yuki Ishida
  • 👤 Wei Song
  • 👤 Ryosuke Iguchi

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 09:36
CPC Classifications
H; H04; H04N; H04N1/00; H04N1/32; H04N1/32101; H04N1/32144; H04N1/32352; G; G06; G06T; G06T1/00; G06T1/0021; G06T1/005; H04N1/00127; H04N1/00278; H04N1/00281; H04N1/00307; H04N1/00795; H04N1/00827; G06T2201/00; G06T2201/005; G06T2201/0051; G06T2201/0065; H04N2201/00; H04N2201/0077; H04N2201/0081; H04N2201/32; H04N2201/3201; H04N2201/3269; H04N2201/327; H04N2201/3271

Claims Analysis

Total Claims: 33
Claim 1
Independent Claim 166 words
An image processing apparatus comprising: an input unit configured to input an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; an obtaining unit configured to obtain information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product; and a determination unit configured to, based on the information obtained by said obtaining unit or frequency characteristics in a partial area of the image input by said input unit, determine a code corresponding to the digital watermark embedded in the partial area, wherein, in a case where the partial area contains a frequency component higher than a predetermined frequency, said determination unit determines a code based on the frequency component, and in a case where the partial area does not contain a frequency component higher than the predetermined frequency, said determination unit determines a code based on the information obtained by said obtaining unit.
Claim 2
Dependent Claim 166 words
An image processing apparatus comprising: an input unit configured to input an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; an obtaining unit configured to obtain information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product; and a determination unit configured to, based on the information obtained by said obtaining unit or frequency characteristics in a partial area of the image input by said input unit, determine a code corresponding to the digital watermark embedded in the partial area, wherein, in a case where the partial area contains a frequency component higher than a predetermined frequency, said determination unit determines a code based on the frequency component, and in a case where the partial area does not contain a frequency component higher than the predetermined frequency, said determination unit determines a code based on the information obtained by said obtaining unit.
Claim 3
Dependent Claim 48 words
The apparatus according to claim 1 , wherein said input unit inputs a plurality of images obtained by performing a continuous shooting of different areas on the print product, and said determination unit determines a code corresponding to a partial area in each of the plurality of images.
Claim 4
Dependent Claim 35 words
The apparatus according to claim 1 , wherein said obtaining unit obtains information about the moving direction of the image capturing device based on a detection result of a sensor of the image capturing device.
Claim 5
Dependent Claim 27 words
The apparatus according to claim 1 , wherein information is embedded in the digital watermark on the print product by modulating the frequency characteristics of the image.
Claim 6
Dependent Claim 29 words
The apparatus according to claim 4 , wherein the information is embedded in the digital watermark by associating a difference in a band of the modulation with a code.
Claim 7
Dependent Claim 40 words
The apparatus according to claim 1 , further comprising a detection unit configured to detect a geometric shift between the print product included in the image input by said input unit and the image captured by the image capturing device.
Claim 8
Dependent Claim 31 words
The apparatus according to claim 1 , wherein said determination unit obtains the frequency characteristics by applying a filter regarding the frequency characteristics to an image input by said input unit.
Claim 9
Dependent Claim 19 words
The apparatus according to claim 1 , wherein said obtaining unit obtains information about a blur of the image.
Claim 10
Dependent Claim 36 words
The apparatus according to claim 1 , wherein said determination unit determines the code based on the information obtained by said obtaining unit, the frequency characteristics, and an image capturing condition of the image capturing device.
Claim 11
Dependent Claim 31 words
The apparatus according to claim 1 , wherein said determination unit uses information about power in each specific band as the frequency characteristic, and determines the code based on the information.
Claim 12
Dependent Claim 22 words
The apparatus according to claim 10 , wherein the information is information associated with deviation of power in said each specific band.
Claim 13
Dependent Claim 22 words
The apparatus according to claim 10 , wherein the information is information associated with attenuation of power in said each specific band.
Claim 14
Dependent Claim 19 words
The apparatus according to claim 1 , wherein the image capturing device is integrated in the image processing apparatus.
Claim 15
Dependent Claim 229 words
An image processing apparatus comprising: an input unit configured to input an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; an obtaining unit configured to obtain information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product; a detection unit configured to detect a geometric shift between the print product included in the image input by said input unit and the image captured by the image capturing device; and a determination unit configured to, based on the information obtained by said obtaining unit or frequency characteristics in a partial area of the image input by said input unit, determine a code corresponding to the digital watermark embedded in the partial area, wherein said obtaining unit obtains information about the moving direction of the image capturing device based on a detection result of a sensor that is integrated in the image capturing device, said determination unit predicts, as a change of an image capturing quality characteristic, a change of the frequency characteristics of the image input by said input unit based on the geometric shift detected by said detection unit and the information from the sensor, and detects a motion of the image capturing device, and said determination unit determines the code based on the prediction.
Claim 16
Dependent Claim 229 words
An image processing apparatus comprising: an input unit configured to input an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; an obtaining unit configured to obtain information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product; a detection unit configured to detect a geometric shift between the print product included in the image input by said input unit and the image captured by the image capturing device; and a determination unit configured to, based on the information obtained by said obtaining unit or frequency characteristics in a partial area of the image input by said input unit, determine a code corresponding to the digital watermark embedded in the partial area, wherein said obtaining unit obtains information about the moving direction of the image capturing device based on a detection result of a sensor that is integrated in the image capturing device, said determination unit predicts, as a change of an image capturing quality characteristic, a change of the frequency characteristics of the image input by said input unit based on the geometric shift detected by said detection unit and the information from the sensor, and detects a motion of the image capturing device, and said determination unit determines the code based on the prediction.
Claim 17
Dependent Claim 136 words
An image processing method comprising: inputting an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; and based on information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product or frequency characteristics in a partial area of the input image, determining a code corresponding to the digital watermark embedded in the partial area, wherein, in a case where the partial area contains a frequency component higher than a predetermined frequency, a code is determined in the determining, based on the frequency component, and in a case where the partial area does not contain a frequency component higher than the predetermined frequency, a code is determined in the determining, based on the information.
Claim 18
Dependent Claim 136 words
An image processing method comprising: inputting an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; and based on information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product or frequency characteristics in a partial area of the input image, determining a code corresponding to the digital watermark embedded in the partial area, wherein, in a case where the partial area contains a frequency component higher than a predetermined frequency, a code is determined in the determining, based on the frequency component, and in a case where the partial area does not contain a frequency component higher than the predetermined frequency, a code is determined in the determining, based on the information.
Claim 19
Dependent Claim 50 words
The method according to claim 15 , wherein a plurality of images obtained by performing a continuous shooting of different areas on the print product are input in the inputting, and a code corresponding to a partial area in each of the plurality of images is determined in the determining.
Claim 20
Dependent Claim 34 words
The method according to claim 15 , wherein the information about the moving direction of the image capturing device is obtained based on a detection result of a sensor of the image capturing device.
Claim 21
Dependent Claim 28 words
The method according to claim 15 , wherein the information is embedded in the digital watermark on the print product by modulating the frequency characteristics of the image.
Claim 22
Dependent Claim 29 words
The method according to claim 18 , wherein the information is embedded in the digital watermark by associating a difference in a band of the modulation with a code.
Claim 23
Dependent Claim 31 words
The method according to claim 15 , further comprising detecting a geometric shift between the print product included in the input image and the image captured by the image capturing device.
Claim 24
Dependent Claim 70 words
The method according to claim 20 , wherein in the determining, a change of the frequency characteristics of the input image is predicted as a change of an image capturing quality characteristic, based on the detected geometric shift, and information from a sensor that is integrated in the image capturing device and a motion of the image capturing device is detected, and the code is determined based on the prediction.
Claim 25
Dependent Claim 28 words
The method according to claim 15 , wherein in the determining, the frequency characteristics are obtained by applying a filter regarding the frequency characteristics to an input image.
Claim 26
Dependent Claim 17 words
The method according to claim 15 , wherein information about a blur of the image is obtained.
Claim 27
Dependent Claim 32 words
The method according to claim 15 , wherein the code is determined in the determining based on the information, the frequency characteristics, and an image capturing condition of the image capturing device.
Claim 28
Dependent Claim 33 words
The method according to claim 15 , wherein in the determining, information about power in each specific band is used as the frequency characteristic, and the code is determined based on the information.
Claim 29
Dependent Claim 22 words
The method according to claim 25 , wherein the information is information associated with deviation of power in said each specific band.
Claim 30
Dependent Claim 22 words
The method according to claim 25 , wherein the information is information associated with attenuation of power in said each specific band.
Claim 31
Dependent Claim 25 words
The method according to claim 15 , wherein the image capturing device is integrated in an image processing apparatus which executes the image processing method.
Claim 32
Dependent Claim 156 words
A non-transitory computer readable storage medium which stores a computer program to be executed in a processor of an image processing apparatus, the program comprising: inputting an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; and based on information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product or frequency characteristics in a partial area of the input image, determining a code corresponding to the digital watermark embedded in the partial area, wherein, in a case where the partial area contains a frequency component higher than a predetermined frequency, a code is determined in the determining, based on the frequency component, and in a case where the partial area does not contain a frequency component higher than the predetermined frequency, a code is determined in the determining, based on the information.
Claim 33
Dependent Claim 156 words
A non-transitory computer readable storage medium which stores a computer program to be executed in a processor of an image processing apparatus, the program comprising: inputting an image obtained by capturing, by an image capturing device, a print product in which a digital watermark is embedded; and based on information about a moving direction of the image capturing device with respect to the print product in the image capturing of the print product or frequency characteristics in a partial area of the input image, determining a code corresponding to the digital watermark embedded in the partial area, wherein, in a case where the partial area contains a frequency component higher than a predetermined frequency, a code is determined in the determining, based on the frequency component, and in a case where the partial area does not contain a frequency component higher than the predetermined frequency, a code is determined in the determining, based on the information.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2020-03-20 2020-09-19 2021-03-21 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2024-03-20 2024-09-19 2025-03-21 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2028-03-20 2028-09-19 2029-03-21 $7700.00 Pending Window

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag