US7003039B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Dictionary generation method for video and image compression
Assignee: S Aqua Semiconductor LLC
•
Filing: 2001-07-18
•
Granted: 2006-02-21
•
Expires: 2021-07-18
Abstract
Abstract This invention relates to the creation of dictionary functions for the encoding of video signals using matching pursuit compression techniques. After an initial set of reference dictionary images is chosen, training video sequences are selected, and motion residuals are calculated. High energy portions of the residual images are extracted and stored when they match selection criteria with the reference dictionary. An energy threshold is used to limit the number of video signal “atoms” encoded for each frame, thus avoiding the encoding of noise. A new dictionary is then synthesized from the stored portions of the image residuals and the original reference dictionary. The process can then be repeated using the synthesized dictionary as the new reference dictionary. This achieves low bit rate signals with a higher signal-to-noise ratio than have been previously achieved.
Inventors
- 👤 Avideh Zakhor
- 👤 Philippe Schmid
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 11:14
CPC Classifications
H; H04; H04N; H04N19/00; H04N19/90; H04N19/94; H04N19/10; H04N19/189; H04N19/192; H04N19/30; H04N19/50; H04N19/503; H04N19/51; H04N19/97
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
168 words
A method for creating a dictionary for video compression, comprising (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesizing the dictionary from the stored high energy portion of the residual image, in which the step of synthesizing comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 2
Independent Claim
168 words
A method for creating a dictionary for video compression, comprising (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesizing the dictionary from the stored high energy portion of the residual image, in which the step of synthesizing comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 3
Dependent Claim
84 words
The method of claim 1 , in which the step of calculating comprises x ^ j , n + 1 = ∑ x i ∈ S j , n ( + ) ω i x i ∑ x i ∈ S j , n ( + ) ω i - ∑ x i ∈ S j , n ( - ) ω i x i ∑ x i ∈ S j , n ( - ) ω i
Claim 4
Dependent Claim
42 words
The method of claim 1 , further comprising the steps of (k) revising the residual image, and (l) repeating steps (f)-(i) for at least a second high energy portion of the residual image, after said first high energy portion has been extracted.
Claim 5
Dependent Claim
167 words
A dictionary for use in video compression, said dictionary generated by (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesis from the stored high energy portion of the residual image, in which the step of synthesis comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 6
Dependent Claim
167 words
A dictionary for use in video compression, said dictionary generated by (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesis from the stored high energy portion of the residual image, in which the step of synthesis comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 7
Dependent Claim
84 words
The method of claim 4 , in which the step of calculating comprises x ^ j , n + 1 = ∑ x i ∈ S j , n ( + ) ω i x i ∑ x i ∈ S j , n ( + ) ω i - ∑ x i ∈ S j , n ( - ) ω i x i ∑ x i ∈ S j , n ( - ) ω i
Claim 8
Dependent Claim
42 words
The method of claim 4 , further comprising the steps of (k) revising the residual image, and (l) repeating steps (f)-(i) for at least a second high energy portion of the residual image, after said first high energy portion has been extracted.
Claim 9
Dependent Claim
165 words
A video encoding system containing a dictionary generated by (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesis from the stored high energy portion of the residual image, in which the step of synthesis comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 10
Dependent Claim
165 words
A video encoding system containing a dictionary generated by (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesis from the stored high energy portion of the residual image, in which the step of synthesis comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 11
Dependent Claim
84 words
The method of claim 7 , in which the step of calculating comprises x ^ j , n + 1 = ∑ x i ∈ S j , n ( + ) ω i x i ∑ x i ∈ S j , n ( + ) ω i - ∑ x i ∈ S j , n ( - ) ω i x i ∑ x i ∈ S j , n ( - ) ω i
Claim 12
Dependent Claim
42 words
The method of claim 7 , further comprising the steps of (k) revising the residual image, and (l) repeating steps (f)-(i) for at least a second high energy portion of the residual image, after said first high energy portion has been extracted.
Claim 13
Dependent Claim
179 words
A machine readable medium, upon which are stored instructions to generate a dictionary for video compression according to the method comprising steps of (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesis from the stored high energy portion of the residual image, in which the step of synthesis comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 14
Dependent Claim
179 words
A machine readable medium, upon which are stored instructions to generate a dictionary for video compression according to the method comprising steps of (a) designating an initial reference dictionary of functions, (b) designating a set of video sequences to be used as training sequences, (c) calculating the motion residual image for at least one of the frames of a video sequence from the set of video sequences, (d) determining an energy threshold for evaluating the residual image, (e) evaluating the residual image for portions above the energy threshold (f) comparing a first high energy portion of the residual image to at least one function in the reference dictionary, (g) extracting the first high energy portion of the residual image, (i) storing the extracted high energy portion of the residual image, (j) synthesis from the stored high energy portion of the residual image, in which the step of synthesis comprises dividing the extracted high energy portions into at least two subsets based on an inner product calculation, and calculating an updated dictionary pattern from the elements in the two subsets.
Claim 15
Dependent Claim
84 words
The method of claim 10 , in which the step of calculating comprises x ^ j , n + 1 = ∑ x i ∈ S j , n ( + ) ω i x i ∑ x i ∈ S j , n ( + ) ω i - ∑ x i ∈ S j , n ( - ) ω i x i ∑ x i ∈ S j , n ( - ) ω i
Claim 16
Dependent Claim
42 words
The method of claim 10 , further comprising the steps of (k) revising the residual image, and (l) repeating steps (f)-(i) for at least a second high energy portion of the residual image, after said first high energy portion has been extracted.
References Cited (Backward Citations)
US5255342A
Cited
US5444488A
Cited
US5457495A
Cited
US5699121A
Cited
US5764921A
Cited
US20010028683A1
Cited
US6754624B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2009-02-20 | 2009-08-22 | 2010-02-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2013-02-20 | 2013-08-22 | 2014-02-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2017-02-20 | 2017-08-22 | 2018-02-21 | $7700.00 | Window Closed / Lapsed |