US7050603B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Watermark encoded video, and related methods
Assignee: Digimarc Corp
•
Filing: 2001-12-13
•
Granted: 2006-05-23
•
Expires: 2021-12-13
Abstract
Abstract Watermarks in video signals or the accompanying audio track are used to associate video objects in a video sequence with object specific actions or information. A video object refers to a spatial and temporal portion of a video signal that depicts a recognizable object, such as a character, prop, graphic, etc. Each frame of a video signal may have one or more video objects. The auxiliary information is embedded in video or audio signals using "steganographic" methods, such as digital watermarks. By encoding object specific information into video or an accompanying audio track, the watermarks transform video objects into "watermark enabled" video objects that provide information, actions or links to additional information or actions during playback of a video or audio-visual program. A similar concept may be applied to audio objects, i.e. portions of audio that are attributable to a particular speaker, character, instrument, artist, etc.
Inventors
- 👤 Geoffrey B. Rhoads
- 👤 Kenneth L. Levy
- 👤 Tyler J. McKinley
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:35
CPC Classifications
G; G06; G06K; G06K19/00; G06K19/06; G06K19/06009; G06K19/06037; B; B42; B42D; B42D25/00; B42D25/30; B42D25/333; G06F; G06F16/00; G06F16/90; G06F16/95; G06F16/955; G06F21/00; G06F21/10; G06F21/16; G06K19/06046; G06K19/08; G06K19/10; G06K19/14; G06K19/18; G06K7/00; G06K7/10; G06K7/14; G06K7/1404; G06K7/1408; G06K7/1417; G06K7/1439; G06K7/1447; G06Q; G06Q20/00; G06Q20/30; G06Q20/34; G06Q20/341; G06Q20/38; G06Q20/40; G06Q20/401; G06Q20/4014; G06Q20/40145; G06T; G06T1/00; G06T1/0021; G06T1/0028; G07; G07C; G07C9/00; G07C9/20; G07C9/22; G07C9/25; G07C9/253; G07D; G07D7/00; G07D7/003; G07D7/0034; G07D7/004; G07F; G07F17/00; G07F17/26; G07F7/00; G07F7/08; G07F7/086; G07F7/10; G07F7/1008; G10; G10L; G10L19/00; G10L19/018; G11; G11B; G11B20/00; G11B20/00086; G11B20/00884; G11B20/00891; H; H04; H04N; H04N1/00; H04N1/32; H04N1/32101; H04N1/32144; H04N1/32149; H04N1/32154; H04N1/3216; H04N1/32203; H04N1/32208; H04N1/32251; H04N1/32288; H04N1/32352; H04N19/00; H04N19/20; H04N19/46; H04N19/467; H04N21/00; H04N21/20; H04N21/23; H04N21/238; H04N21/2389; H04N21/23892; H04N21/80; H04N21/83; H04N21/835; H04N21/8358; H04N5/00; H04N5/76; H04N5/91; H04N5/913; H04N7/00; H04N7/16; H04N7/167; H04N7/1675; B42D25/20; B42D25/21; G06K2019/06215; G06K2019/06253; G06T2201/00; G06T2201/005; G06T2201/0053; H04N1/32106; H04N1/32122; H04N2005/91307; H04N2005/91335; H04N2201/00; H04N2201/32; H04N2201/3201; H04N2201/3225; H04N2201/3226; H04N2201/3233; H04N2201/3246; H04N2201/3249; H04N2201/3269; H04N2201/327; H04N2201/3271; H04N2201/3274; H04N9/00; H04N9/79; H04N9/80; H04N9/82; H04N9/8205
Claims Analysis
Total Claims: 37
Claim 1
Independent Claim
103 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the video signal is steganographically encoded with at least two identifiers, each identifier corresponding to distinct video objects in frames of the video signal, and each identifier being associated with actions relating to the corresponding video objects.
Claim 2
Independent Claim
103 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the video signal is steganographically encoded with at least two identifiers, each identifier corresponding to distinct video objects in frames of the video signal, and each identifier being associated with actions relating to the corresponding video objects.
Claim 3
Independent Claim
95 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the object information is encoded in a watermark signal that covers a portion of a screen area of frames in the video signal where the video object is located.
Claim 4
Independent Claim
95 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the object information is encoded in a watermark signal that covers a portion of a screen area of frames in the video signal where the video object is located.
Claim 5
Independent Claim
98 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein object information for at least two different video objects in the video signal is steganographically encoded in different portions of frames of the video signals where the corresponding video objects are located.
Claim 6
Independent Claim
98 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein object information for at least two different video objects in the video signal is steganographically encoded in different portions of frames of the video signals where the corresponding video objects are located.
Claim 7
Independent Claim
84 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the object information includes screen location information indicating where the video object is located in the video signal.
Claim 8
Independent Claim
84 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the object information includes screen location information indicating where the video object is located in the video signal.
Claim 9
Dependent Claim
39 words
The method of claim 4 wherein object information is encoded for at least two different video objects in the video signal, and the object information includes location information indicating where the video objects are located in the video signal.
Claim 10
Independent Claim
83 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the object information is encoded in a pre-recorded video object, which forms part of the video signal.
Claim 11
Independent Claim
83 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the object information is encoded in a pre-recorded video object, which forms part of the video signal.
Claim 12
Dependent Claim
20 words
The method of claim 6 wherein the pre-recorded video object is composited with video frames to form the video signal.
Claim 13
Dependent Claim
36 words
The method of claim 6 wherein the pre-recorded video object is composited with at least one other video object to form the video signal, where the video objects are each steganographically encoded with object specific information.
Claim 14
Independent Claim
102 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the video object is encoded with the object information as part of a process of capturing the video signal of physical objects, and the object information pertains to the physical objects captured in the video signal.
Claim 15
Independent Claim
102 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein the video object is encoded with the object information as part of a process of capturing the video signal of physical objects, and the object information pertains to the physical objects captured in the video signal.
Claim 16
Dependent Claim
31 words
The method of claim 9 wherein the object information is encoded as part of a process of capturing the video signal during a live broadcast or transmission of the video signal.
Claim 17
Dependent Claim
24 words
The method of claim 9 wherein object information is encoded for at least two different video objects depicted in frames of the video signal.
Claim 18
Independent Claim
95 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein object information is encoded for at least two different video objects such that the object information is synchronized with corresponding video objects depicted in the video signal during playback.
Claim 19
Independent Claim
95 words
A method of encoding substantially imperceptible auxiliary information into a video signal including at least one video object, the method comprising: steganographically encoding object information about the video object into the video signal; and associating the object information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing, wherein object information is encoded for at least two different video objects such that the object information is synchronized with corresponding video objects depicted in the video signal during playback.
Claim 20
Independent Claim
89 words
A method for using a watermark encoded into a video signal or in an audio track accompanying the video signal, where the watermark comprises information regarding a video object in the video signal, the method comprising: decoding the watermark information; receiving a user selection of the video object; and executing an action associated with the video object information, wherein the video signal includes watermark information for at least two different video objects in the video signal, and the watermark information associates the video objects with object actions or information.
Claim 21
Independent Claim
89 words
A method for using a watermark encoded into a video signal or in an audio track accompanying the video signal, where the watermark comprises information regarding a video object in the video signal, the method comprising: decoding the watermark information; receiving a user selection of the video object; and executing an action associated with the video object information, wherein the video signal includes watermark information for at least two different video objects in the video signal, and the watermark information associates the video objects with object actions or information.
Claim 22
Dependent Claim
42 words
The method of claim 13 wherein the audio track includes watermark information for at least two different video objects appearing in the same frames of the video signal, and the watermark information associates the video objects with object specific actions or information.
Claim 23
Independent Claim
71 words
A method for encoding substantially imperceptible auxiliary information into an audio track of a video signal including at least one video object, the method comprising: steganographically encoding object specific information about the video object into the audio track; and associating the object specific information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing.
Claim 24
Independent Claim
71 words
A method for encoding substantially imperceptible auxiliary information into an audio track of a video signal including at least one video object, the method comprising: steganographically encoding object specific information about the video object into the audio track; and associating the object specific information with an action, where the action is performed in response to user selection of the video object through a user interface while the video signal is playing.
Claim 25
Dependent Claim
20 words
The method of claim 15 wherein the object specific information includes an identifier and screen location of the video object.
Claim 26
Dependent Claim
19 words
The method of claim 15 wherein the object specific information includes information for at least two different video objects.
Claim 27
Independent Claim
46 words
A method of processing video content comprising: receiving video content, said video content including picture element data and non-picture element data; reading certain of said non-picture element data; checking information steganographically embedded in the picture data that is related to said read data, for expected correspondence.
Claim 28
Independent Claim
46 words
A method of processing video content comprising: receiving video content, said video content including picture element data and non-picture element data; reading certain of said non-picture element data; checking information steganographically embedded in the picture data that is related to said read data, for expected correspondence.
Claim 29
Dependent Claim
18 words
The method of claim 18 that further includes controlling use of the video content based on the foregoing.
Claim 30
Independent Claim
49 words
A method of controlling use of video content comprising: receiving video comprising picture portions; detecting a steganographically embedded signal in at least some of the picture portions of the video; checking out of band data associated with the vides; and controlling use of the video based on the foregoing.
Claim 31
Independent Claim
49 words
A method of controlling use of video content comprising: receiving video comprising picture portions; detecting a steganographically embedded signal in at least some of the picture portions of the video; checking out of band data associated with the vides; and controlling use of the video based on the foregoing.
Claim 32
Dependent Claim
13 words
The method of claim 20 wherein the steganographically embedded signal comprises digital watermarking.
Claim 33
Dependent Claim
51 words
In a consumer electronic apparatus that processes video, the video comprising picture data, an improvement comprising a processor for detecting information steganographically embed in said picture data of the video, and for checking said detected information for expeced correspondence with associated informative conveyed with said video but not representing visual information.
Claim 34
Dependent Claim
51 words
In a consumer electronic apparatus that processes video, the video comprising picture data, an improvement comprising a processor for detecting information steganographically embed in said picture data of the video, and for checking said detected information for expeced correspondence with associated informative conveyed with said video but not representing visual information.
Claim 35
Independent Claim
49 words
A method to control use of video comprising: obtaining video comprising picture data; checking for at least some non picture data conveyed with the video; cheking for a steganographically embedded signal in at least some of the picture data; and controlling use of the video based on the foregoing.
Claim 36
Independent Claim
49 words
A method to control use of video comprising: obtaining video comprising picture data; checking for at least some non picture data conveyed with the video; cheking for a steganographically embedded signal in at least some of the picture data; and controlling use of the video based on the foregoing.
Claim 37
Dependent Claim
13 words
The method of claim 23 wherein the steganographically embedded signal comprises digital watermarking.
References Cited (Backward Citations)
US5299019A
Cited
JPH05242217A
Cited
US5446273A
Cited
US5295203A
Cited
US5422995A
Cited
US5262860A
Cited
US5325167A
Cited
US5408542A
Cited
US5524933A
Cited
US5259025A
Cited
EP0581317A3
Cited
US5721788A
Cited
US5586216A
Cited
US5739814A
Cited
US5659164A
Cited
US5337358A
Cited
US5298731A
Cited
US5809317A
Cited
US5379345A
Cited
EP0629972A3
Cited
US5428731A
Cited
WO1994027228A1
Cited
US5351302A
Cited
US5413486A
Cited
US5857038A
Cited
US5432870A
Cited
US5545883A
Cited
US5496071A
Cited
US5437552A
Cited
US5652626A
Cited
WO1995010835A1
Cited
US5422963A
Cited
EP0650146A1
Cited
US5657462A
Cited
WO1995014289A3
Cited
US5841978A
Cited
US5862260A
Cited
US5499294A
Cited
US5463209A
Cited
US5515081A
Cited
US5428607A
Cited
US5495411A
Cited
US5548645A
Cited
US5461711A
Cited
WO1995020291A1
Cited
US5553143A
Cited
US5466158A
Cited
US5385371A
Cited
US5872589A
Cited
US5537336A
Cited
US5450490A
Cited
US5473631A
Cited
US5404377A
Cited
US5636276A
Cited
US5932863A
Cited
US5493677A
Cited
US5862321A
Cited
US5469506A
Cited
US5604516A
Cited
US5597307A
Cited
WO1996001464A1
Cited
US5624265A
Cited
WO1996003736A1
Cited
US5640193A
Cited
US5869819A
Cited
US5606609A
Cited
EP0705025B1
Cited
US5652714A
Cited
US5801687A
Cited
US5579479A
Cited
US5646999A
Cited
US5663766A
Cited
US5629980A
Cited
US5715403A
Cited
US5634012A
Cited
US5638443A
Cited
US5525798A
Cited
US5693693A
Cited
US5646997A
Cited
WO1996019795A1
Cited
WO1996019821A1
Cited
US5530852A
Cited
US5848413A
Cited
US5845281A
Cited
US5729251A
Cited
WO1996027259A1
Cited
US5774452A
Cited
WO1996029749A1
Cited
US5569549A
Cited
US5974141A
Cited
WO1996036163A3
Cited
US5778102A
Cited
US5613004A
Cited
US6269394B1
Cited
US5818441A
Cited
US5587784A
Cited
WO1997001137A1
Cited
WO1997002552A1
Cited
US6411725B1
Cited
US5765152A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-05-22 | 2009-11-21 | 2010-05-23 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-05-22 | 2013-11-21 | 2014-05-23 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-05-22 | 2017-11-21 | 2018-05-23 | $7700.00 | Window Closed / Lapsed |