Patent US5960081A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5960081A Expired / Lapsed US ⏱️ 0.0 years remaining

Embedding a digital signature in a video sequence

Assignee: RPX Corp
•
Filing: 1997-06-05
•
Granted: 1999-09-28
•
Expires: 2017-06-05
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Method and apparatus for watermarking digital video material by embedding a digital signature. One embodiment of the system integrates the embedding procedure into a block-based compression scheme. In one embodiment, a 32-bit digital signature is embedded into the x- and y-coordinates of motion vectors. Since not all motion vectors are suitable for coding (with regard to objectionable visible artifacts), three hybrid selection criteria have been developed for determining whether or not to code a motion vector. A probabilistic coding procedure has also been developed to avoid problems that arise when fewer than 16 blocks and/or vectors (where 16 vectors correspond to 32 bits) can be coded in a frame. One such procedure makes use of binary random sequences to virtually code the signature into the motion vectors. The system has been implemented on a CRAY T3D massively parallel supercomputer, where a near-real-time (5 frames per second) embedding of the signature is obtainable. The results show that it is possible to embed and retrieve a 32-bit signature if enough blocks over time are selected.

Inventors

  • 👤 Thorbjorn Vynne
  • 👤 Frederic Jordan

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-04 18:02
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/80; H04N21/83; H04N21/835; H04N21/8358; G; G06; G06T; G06T1/00; G06T1/0021; G06T1/0085; H04N19/00; H04N19/46; H04N19/467; H04N19/50; H04N19/503; H04N19/51; H04N19/513; H04N19/517; H04N19/60; H04N19/61; H04N21/20; H04N21/23; H04N21/238; H04N21/2389; H04N21/23892; H04N5/00; H04N5/76; H04N5/91; H04N5/913; H04N7/00; H04N7/24; G06T2201/00; G06T2201/005; G06T2201/0053; H04N2005/91307; H04N2005/91335

Claims Analysis

Total Claims: 46
Claim 1
Independent Claim 123 words
A method for embedding and retrieving information in a video signal, the method comprising the steps of: selecting a first subset and a second subset of the video signal; determining a relationship between the first subset and the second subset of the video signal; changing the relationship between the first subset and the second subset of the video signal, wherein the step of changing includes encoding the information into the video signal to produce a changed video signal having a changed relationship; and detecting the changed relationship from the changed video signal and, from the detected changed relationship, retrieving the encoded information; wherein the first subset belongs to one frame and the second subset belongs to a different frame of the video signal.
Claim 2
Independent Claim 123 words
A method for embedding and retrieving information in a video signal, the method comprising the steps of: selecting a first subset and a second subset of the video signal; determining a relationship between the first subset and the second subset of the video signal; changing the relationship between the first subset and the second subset of the video signal, wherein the step of changing includes encoding the information into the video signal to produce a changed video signal having a changed relationship; and detecting the changed relationship from the changed video signal and, from the detected changed relationship, retrieving the encoded information; wherein the first subset belongs to one frame and the second subset belongs to a different frame of the video signal.
Claim 3
Dependent Claim 23 words
The method according to claim 1, wherein the step of selecting includes selecting image element subsets using one or more visual perception criteria.
Claim 4
Dependent Claim 23 words
The method according to claim 1, wherein the first and second subsets each represent rectangular blocks in the frames of the video signal.
Claim 5
Dependent Claim 16 words
The method according to claim 1, wherein the step of selecting includes selecting visually similar subsets.
Claim 6
Dependent Claim 15 words
The method according to claim 4, wherein the relationship is a motion between selected subsets.
Claim 7
Dependent Claim 32 words
The method according to claim 5, wherein the steps of selecting, or changing the relationship, or both, include using a key to encrypt the encoding of the information into the changed relationship.
Claim 8
Independent Claim 121 words
A system for embedding digital information into a video signal such that the digital information can later be retrieved, the digital information including a plurality of bits, the system comprising: a selector that selects a first subset and a second subset of the video signal; a comparator that determines a relationship between the first subset and the second subset of the video signal; and a changer that changes the relationship between the first subset and the second subset of the video signal by encoding the information into the video signal to produce a changed video signal having a changed relationship; wherein the first subset belongs to one frame and the second subset belongs to a different frame of the video signal.
Claim 9
Independent Claim 121 words
A system for embedding digital information into a video signal such that the digital information can later be retrieved, the digital information including a plurality of bits, the system comprising: a selector that selects a first subset and a second subset of the video signal; a comparator that determines a relationship between the first subset and the second subset of the video signal; and a changer that changes the relationship between the first subset and the second subset of the video signal by encoding the information into the video signal to produce a changed video signal having a changed relationship; wherein the first subset belongs to one frame and the second subset belongs to a different frame of the video signal.
Claim 10
Dependent Claim 20 words
The system according to claim 7, wherein the selector selects image element subsets using one or more visual perception criteria.
Claim 11
Dependent Claim 23 words
The system according to claim 7, wherein the first and second subsets each represent rectangular blocks in the frames of the video signal.
Claim 12
Dependent Claim 16 words
The system according to claim 7, wherein the step of selecting includes selecting visually similar subsets.
Claim 13
Dependent Claim 15 words
The system according to claim 10, wherein the relationship is a motion between selected subsets.
Claim 14
Dependent Claim 17 words
The system according to claim 11, wherein the changer uses an encryption key to encrypt the information.
Claim 15
Dependent Claim 25 words
The system according to claim 11, wherein the selector uses an encryption key to select subsets in order to encrypt a location of the information.
Claim 16
Dependent Claim 28 words
The system according to claim 11, wherein the selector and/or changer use an encryption key in order to encrypt the encoding of the information into the changed relationship.
Claim 17
Independent Claim 61 words
A method for embedding a retrievable watermark into a video signal, the video signal providing a series of video frames including a first frame and a second frame, the method comprising the steps of: detecting a change between the first frame and the second frame; producing change information based on the change; and encoding the retrievable watermark into the change information.
Claim 18
Independent Claim 61 words
A method for embedding a retrievable watermark into a video signal, the video signal providing a series of video frames including a first frame and a second frame, the method comprising the steps of: detecting a change between the first frame and the second frame; producing change information based on the change; and encoding the retrievable watermark into the change information.
Claim 19
Independent Claim 73 words
A method for embedding a retrievable watermark into a video signal, the video signal providing a series of video frames including a first frame and a second frame, the method comprising the steps of: detecting a change between the first frame and the second frame; producing change information based on the change; and encoding the watermark into the change information; wherein the step of encoding modifies a motion vector based on the watermark.
Claim 20
Independent Claim 73 words
A method for embedding a retrievable watermark into a video signal, the video signal providing a series of video frames including a first frame and a second frame, the method comprising the steps of: detecting a change between the first frame and the second frame; producing change information based on the change; and encoding the watermark into the change information; wherein the step of encoding modifies a motion vector based on the watermark.
Claim 21
Dependent Claim 27 words
The method according to claim 16, wherein the step of encoding includes using a encryption key to encrypt the encoding of the watermark into the change information.
Claim 22
Dependent Claim 82 words
The method according to claim 16, further comprising the step of: obtaining a set of motion vectors V(n)={v 1 , v 2 , . . . v n }, where V i =(x i , y i ), i=1, 2, . . . , m, and m is the number of blocks in each frame, on basis of frame(n-1) by a minimum mean-square-error fit of each block in frame(n), and wherein the step of encoding uses the set of obtained motion vectors.
Claim 23
Dependent Claim 40 words
The method according to claim 16, further comprising the step of: selecting the subset of blocks based on criteria that are met by blocks in frame d (n-1), and wherein the step of encoding uses the selected subset of blocks.
Claim 24
Dependent Claim 105 words
The method according to claim 16, further comprising the step of: selecting the subset of blocks based on criteria that include a threshold value C hist : max (|x m -x i |)<C hist , I=1, 2, . . . , M where x m is the median value, M is the number of pixels in the block and C hist (histogram criterion) is the maximum-allowed distance to the median value, wherein the difference in pixel intensity from the median intensity for surrounding pixels is smaller than the threshold value C hist , and wherein the step of encoding uses the selected subset of blocks.
Claim 25
Dependent Claim 90 words
The method according to claim 16, further comprising the step of: selecting the subset of blocks based on criteria that include a threshold value C.sub.σ, wherein a block is selected if σ<C.sub.σ where C.sub.σ (standard deviation criterion) is a threshold value determining the visible limit, and wherein a standard deviation σ is calculated for the block b(k) using a definition ##EQU16## where ##EQU17## x is the gray-level value, and M is the number of pixels in the image, and wherein the step of encoding uses the selected subset of blocks.
Claim 26
Dependent Claim 122 words
The method according to claim 16, further comprising the step of: selecting the subset of blocks based on criteria that include a threshold value C.sub.σ, and a block is selected if, a standard deviation (σ xy of the pixel gray-level values inside a block plus a band around the block) is less or equal to a given threshold value C.sub.σ : σ xy ≦C.sub.σ where C.sub.σ (standard deviation criterion) is a threshold value determining the visible limit, and wherein a standard deviation σ is calculated for the block b(k) using a definition ##EQU18## where ##EQU19## x is the gray-level value, and M is the number of pixels in the image, and wherein the step of encoding uses the selected subset of blocks.
Claim 27
Dependent Claim 82 words
The method according to claim 16, further comprising the step of: selecting the subset of blocks based on criteria that include a threshold value C size , wherein a magnitude of a motion vector v is larger than or equal to a given threshold value C size : |v|≧C size where v is the motion vector and C size (motion-vector size criterion) is the minimum size of the motion vector, and wherein the step of encoding uses the selected subset of blocks.
Claim 28
Dependent Claim 97 words
The method according to claim 16, further comprising the step of: selecting the subset of blocks based on criteria that include: a first hybrid criterion including a first criterion for standard deviation combined with a criterion for maximum distance to the median; a second hybrid criterion including a second criterion for standard deviation combined with a criterion for a shape of the frequency plot; and a third hybrid criterion including a third criterion for standard deviation combined with a criterion for size of the motion vectors, and wherein the step of encoding uses the subset of blocks.
Claim 29
Independent Claim 131 words
A method for embedding digital information into a video signal such that the digital information can later be retrieved; the digital information including a plurality of bits, the video signal providing a series of video frames including a first frame and a subsequent second frame, the first frame being subdivided into a plurality of blocks, the method comprising the steps of: obtaining a motion vector for each one of a subset of the blocks in the first frame, each motion vector representative of a displacement between a block in the first frame and a corresponding block in the second frame; and modifying one or more of said motion vectors based on a value of one or more bits of said digital information such that the digital information can later be retrieved.
Claim 30
Independent Claim 131 words
A method for embedding digital information into a video signal such that the digital information can later be retrieved; the digital information including a plurality of bits, the video signal providing a series of video frames including a first frame and a subsequent second frame, the first frame being subdivided into a plurality of blocks, the method comprising the steps of: obtaining a motion vector for each one of a subset of the blocks in the first frame, each motion vector representative of a displacement between a block in the first frame and a corresponding block in the second frame; and modifying one or more of said motion vectors based on a value of one or more bits of said digital information such that the digital information can later be retrieved.
Claim 31
Dependent Claim 28 words
The method according to claim 25, further comprising the step of: selecting the subset of blocks based on criteria that are met by blocks in frame d (n-1).
Claim 32
Independent Claim 174 words
A method for embedding digital information into a video signal such that the digital information can later be retrieved; the digital information including a plurality of bits, the video signal providing a series of video frames including a first frame and a subsequent second frame, the first frame being subdivided into a plurality of blocks, the method comprising the steps of: obtaining a motion vector for each one of a subset of the blocks in the first frame, each motion vector representative of a displacement between a block in the first frame and a corresponding block in the second frame; and modifying one or more of said motion vectors based on a value of one or more bits of said digital information; wherein the digital information includes a signature having a predefined bitset S(I), I=1, 2, . . . , L, where L is the number of bits in the signature, and wherein the step of modifying modifies a component of the motion vector based on one or more bits of said digital information.
Claim 33
Independent Claim 174 words
A method for embedding digital information into a video signal such that the digital information can later be retrieved; the digital information including a plurality of bits, the video signal providing a series of video frames including a first frame and a subsequent second frame, the first frame being subdivided into a plurality of blocks, the method comprising the steps of: obtaining a motion vector for each one of a subset of the blocks in the first frame, each motion vector representative of a displacement between a block in the first frame and a corresponding block in the second frame; and modifying one or more of said motion vectors based on a value of one or more bits of said digital information; wherein the digital information includes a signature having a predefined bitset S(I), I=1, 2, . . . , L, where L is the number of bits in the signature, and wherein the step of modifying modifies a component of the motion vector based on one or more bits of said digital information.
Claim 34
Independent Claim 90 words
A method for embedding digital information into a video signal, the video signal providing a series of video frames including a first frame and a subsequent second frame, the method comprising the steps of: detecting a motion between the first frame and the second frame; producing a motion vector set based on the motion; selecting change information that includes a suitable subset of the motion vector set that is suitable for coding; and encoding the digital information into the change information such that the digital information can later be retrieved.
Claim 35
Independent Claim 90 words
A method for embedding digital information into a video signal, the video signal providing a series of video frames including a first frame and a subsequent second frame, the method comprising the steps of: detecting a motion between the first frame and the second frame; producing a motion vector set based on the motion; selecting change information that includes a suitable subset of the motion vector set that is suitable for coding; and encoding the digital information into the change information such that the digital information can later be retrieved.
Claim 36
Dependent Claim 26 words
The method according to claim 28, wherein the step of encoding includes using a key to encrypt the encoding of the information into the change information.
Claim 37
Dependent Claim 143 words
A watermarking system for embedding digital information into a video signal such that the digital information can later be retrieved; the digital information including a plurality of bits, the video signal providing a series of video frames including a first frame and a subsequent second frame, the first frame being subdivided into a plurality of blocks, the watermarking system comprising: a block-based motion-estimation (BBME) coder, and wherein the BBME coder generates a motion vector for each one of a subset of the blocks in the first frame, each motion vector representative of a displacement between a block in the first frame and a corresponding block in the second frame; and a motion-vector modifier coupled to an output of the BBME coder that modifies one or more of said motion vectors based on a value of one or more bits of said digital information.
Claim 38
Dependent Claim 143 words
A watermarking system for embedding digital information into a video signal such that the digital information can later be retrieved; the digital information including a plurality of bits, the video signal providing a series of video frames including a first frame and a subsequent second frame, the first frame being subdivided into a plurality of blocks, the watermarking system comprising: a block-based motion-estimation (BBME) coder, and wherein the BBME coder generates a motion vector for each one of a subset of the blocks in the first frame, each motion vector representative of a displacement between a block in the first frame and a corresponding block in the second frame; and a motion-vector modifier coupled to an output of the BBME coder that modifies one or more of said motion vectors based on a value of one or more bits of said digital information.
Claim 39
Dependent Claim 84 words
The watermarking system according to claim 30, wherein the subset of blocks is selected based on criteria that include: a first hybrid criterion including a first criterion for standard deviation combined with a criterion for maximum distance to the median; a second hybrid criterion including a second criterion for standard deviation combined with a criterion for a shape of the frequency plot; or a third hybrid criterion including a third criterion for standard deviation combined with a criterion for size of the motion vectors.
Claim 40
Dependent Claim 122 words
A storage medium having a computer program stored thereon for causing a suitably programmed system to embed information in a video signal by performing the following steps when such program is executed on the system: selecting a first subset and a second subset of the video signal; determining a relationship between the first subset and the second subset of the video signal; and changing the relationship between the first subset and the second subset of the video signal, wherein the step of changing includes encoding the information into the video signal to produce a changed video signal having a changed relationship; wherein the first subset belongs to one frame and the second subset belongs to a different frame of the video signal.
Claim 41
Dependent Claim 122 words
A storage medium having a computer program stored thereon for causing a suitably programmed system to embed information in a video signal by performing the following steps when such program is executed on the system: selecting a first subset and a second subset of the video signal; determining a relationship between the first subset and the second subset of the video signal; and changing the relationship between the first subset and the second subset of the video signal, wherein the step of changing includes encoding the information into the video signal to produce a changed video signal having a changed relationship; wherein the first subset belongs to one frame and the second subset belongs to a different frame of the video signal.
Claim 42
Dependent Claim 50 words
The storage medium of claim 32, wherein the computer program comprises programming for further causing the system, when such program is executed on the system, to perform the following additional step: detecting the changed relationship from the changed video signal and, from the detected changed relationship, retrieving the encoded information.
Claim 43
Dependent Claim 22 words
The storage medium of claim 32, wherein in the step of determining a relationship, the relationship is a motion between selected subsets.
Claim 44
Dependent Claim 32 words
The storage medium of claim 32, wherein the steps of selecting, or changing the relationship, or both, include using a key to encrypt the encoding of the information into the changed relationship.
Claim 45
Dependent Claim 120 words
A data structure for holding video information, the video information having embedded digital information such that the digital information can be retrieved from the video information, the digital information including a plurality of bits, the data structure comprising: a plurality of video frames, each frame being subdivided into a plurality of blocks; and a plurality of motion vectors, each one of said motion vectors associated with one block of a selected subset of the plurality of blocks, each motion vector representative of a displacement between a block in one frame and a corresponding block in a different frame, wherein the plurality of motion vectors has been modified based on a value of one or more bits of said digital information.
Claim 46
Dependent Claim 120 words
A data structure for holding video information, the video information having embedded digital information such that the digital information can be retrieved from the video information, the digital information including a plurality of bits, the data structure comprising: a plurality of video frames, each frame being subdivided into a plurality of blocks; and a plurality of motion vectors, each one of said motion vectors associated with one block of a selected subset of the plurality of blocks, each motion vector representative of a displacement between a block in one frame and a corresponding block in a different frame, wherein the plurality of motion vectors has been modified based on a value of one or more bits of said digital information.

References Cited (Backward Citations)

US4901349A Cited
US5034981A Cited
US5208857A Cited
US5206906A Cited
US5398068A Cited
US5434995A Cited
US5650829A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2002-09-27 2003-03-29 2003-09-28 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2006-09-27 2007-03-29 2007-09-28 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2010-09-27 2011-03-29 2011-09-28 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag