US6038256A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Statistical multiplexed video encoding using pre-encoding a priori statistics and a priori and a posteriori statistics
Assignee: LSI Corp
•
Filing: 1996-12-31
•
Granted: 2000-03-14
•
Expires: 2016-12-31
Abstract
Abstract A statistical multiplexing apparatus and method for generating and combining a plurality of encoded video bit streams. A storage device contains pre-stored a priori statistics indicative of the encoding complexity of the video signals from which the encoded video bit streams will be generated. The pre-stored a priori statistics may include inter-pixel differences in the same picture or between multiple pictures or pre-encoding a priori statistics generated during a preliminary encoding of the video signals. Examples of pre-encoding a priori statistics include the number of bits per picture at a given quantization level, an average quantization level, picture types, scene change locations and repeat field for one or more of the video bit streams. The video signals are applied to encoders which compress the signals in accordance with bit allocation decisions generated by a statistics computer. The statistics computer uses only pre-encoding a priori statistics from the storage device to generate bit allocation decisions. Alternatively, the statistics computer may use any type of a priori statistics in conjunction with a posteriori statistics received from the encoders in allocating bits. The resulting compressed video bit streams are applied to a multiplexer and combined into a single multiplexed bit stream for transmission on a single channel. The statistics computer thus has access to additional information regarding the encoding complexity of the video bit streams to be encoded and combined, and can therefore generate more accurate bit allocations and better maintain consistent video quality across multiple encoded bit streams.
Inventors
- 👤 Elliot N. Linzer
- 👤 Aaron Wells
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 04:32
CPC Classifications
H; H04; H04H; H04H20/00; H04H20/42; H04H20/28; H04H20/30; H04N; H04N19/00; H04N19/10; H04N19/102; H04N19/115; H04N19/134; H04N19/136; H04N19/14; H04N19/142; H04N19/146; H04N19/149; H04N19/169; H04N19/17; H04N19/172; H04N19/179; H04N19/40; H04N19/60; H04N19/61; H04N19/85; H04N19/87; H04N21/00; H04N21/20; H04N21/23; H04N21/236; H04N21/2365; H04N21/23655; H04N21/40; H04N21/43; H04N21/434; H04N21/4347
Claims Analysis
Total Claims: 46
Claim 1
Independent Claim
164 words
A method for multiplexing at least two bit streams, each comprising encoded video signals, into a single multiplexed bit stream, comprising the steps of: (a) pre-encoding a plural of to-be-encoded pictures of each of said video signals, in each of said at least two bit streams, having mutually independent timing, wherein said pre-encoding includes motion compensation between I, P and B pictures of said to-be-encoded pictures, (b) during said step (a), generating pre-encoding a priori statistics indicative of a complexity involved in pre-encoding each of said video signals, (c) statistically allocating a bit rate to each of said video signals, in each corresponding bit stream, based on said pre-encoding a priori statistics generated in said step (b), (d) independently re-encoding each of said video signals, in each corresponding bit stream, to produce a corresponding compressed video bit stream depending on said bit rate allocated in said step (c), and (e) combining each of said compressed video bit streams into a single multiplexed bit stream.
Claim 2
Independent Claim
164 words
A method for multiplexing at least two bit streams, each comprising encoded video signals, into a single multiplexed bit stream, comprising the steps of: (a) pre-encoding a plural of to-be-encoded pictures of each of said video signals, in each of said at least two bit streams, having mutually independent timing, wherein said pre-encoding includes motion compensation between I, P and B pictures of said to-be-encoded pictures, (b) during said step (a), generating pre-encoding a priori statistics indicative of a complexity involved in pre-encoding each of said video signals, (c) statistically allocating a bit rate to each of said video signals, in each corresponding bit stream, based on said pre-encoding a priori statistics generated in said step (b), (d) independently re-encoding each of said video signals, in each corresponding bit stream, to produce a corresponding compressed video bit stream depending on said bit rate allocated in said step (c), and (e) combining each of said compressed video bit streams into a single multiplexed bit stream.
Claim 3
Dependent Claim
63 words
The method of claim 1 further comprising the steps of: (f) during said step of pre-encoding, generating a pre-encoded compressed video bit stream for each of said video signals, and (g) prior to said step (d), decoding each of said pre-compressed video bit stream to reproduce said video signal and performing said step (d) on said video signals reproduced in said step (g).
Claim 4
Dependent Claim
27 words
The method of claim 1 further comprising the step of: (f) performing said step (d) on said same video signals on which said step (a) is performed.
Claim 5
Dependent Claim
51 words
The method of claim 1 further comprising the steps of: (f) during said step (a), generating pre-encoding results utilized in generating a pre-compressed video signal for each of said video signals, and (g) during said step (d), utilizing said pre-encoding results generated during said step (a) in compressing said video signals.
Claim 6
Dependent Claim
95 words
The method of claim 1 further comprising the steps of: (f) generating said pre-encoding a priori statistics for a plurality of pictures of each of said video signals, (g) for each video signal, adding up said pre-encoding a priori statistics for a plurality of said pictures of said video signal to produce a first sum, (h) for each video signal, allocating a number of bits for encoding one of said pictures of said plurality in proportion to said first sum relative to sums produced for each video signal to be combined in said step (e).
Claim 7
Dependent Claim
97 words
The method of claim 5 further comprising the steps of, for each video signal: (i) generating pre-encoding a priori statistics for a first sequence of pictures of a first predetermined length from a first one of said plurality of pictures to be encoded, (j) adding up said pre-encoding a priori statistics for a second sequence of pictures of a second predetermined length from said first picture, and (k) if said second predetermined length exceeds said first predetermined length, for each picture in said second sequence but not in said first sequence, estimating said pre-encoding a priori statistics.
Claim 8
Dependent Claim
34 words
The method of claim 1 wherein said bit rate allocated to at least one of said video signals depends on statistics gathered for at least two pictures of said at least one video signal.
Claim 9
Dependent Claim
28 words
The method of claim 1 wherein said pre-encoding a priori statistics measure a number of bits generated in encoding each of said video signals in said step (b).
Claim 10
Dependent Claim
26 words
The method of claim 1 wherein said pre-encoding a priori statistics measure an average quantization level used in encoding said video signals in said step (a).
Claim 11
Dependent Claim
25 words
The method of claim 1 wherein said pre-encoding a priori statistics include scene change locations identified in encoding said video signals in said step (a).
Claim 12
Dependent Claim
25 words
The method of claim 1 wherein said pre-encoding a priori statistics include repeat field patterns produced while encoding said video signals in said step (a).
Claim 13
Dependent Claim
208 words
A statistical multiplexer for multiplexing at least two bit streams, each comprising encoded video signals into a single multiplexed bit stream, comprising: a source of said at least two bit streams, each having plural video signals, a statistics gatherer receiving said video signals from said video source, for pre-encoding a plural of to-be-encoded pictures of each of said video signals, in each of said bit streams, having mutually independent timing, and for generating pre-encoding a priori statistics indicative of a complexity involved in pre-encoding each of said video signals, wherein said pre-encoding includes motion compensation between I, P and B pictures of said to-be-encoded pictures, a statistics computer connected to statistics gatherer for statistically allocating a bit rate to each of said video signals, in each corresponding bit stream, based on said pre-encoding a priori statistics generated in said statistics gatherer, one or more encoders connected to said statistics computer for independently re-encoding each of said video signals, in each corresponding bit stream, to produce a corresponding compressed video bit stream depending on said bit rate allocated in said statistics computer, and a multiplexer for combining each of said compressed video bit streams with at least one other compressed video bit stream into a single multiplexed bit stream.
Claim 14
Dependent Claim
208 words
A statistical multiplexer for multiplexing at least two bit streams, each comprising encoded video signals into a single multiplexed bit stream, comprising: a source of said at least two bit streams, each having plural video signals, a statistics gatherer receiving said video signals from said video source, for pre-encoding a plural of to-be-encoded pictures of each of said video signals, in each of said bit streams, having mutually independent timing, and for generating pre-encoding a priori statistics indicative of a complexity involved in pre-encoding each of said video signals, wherein said pre-encoding includes motion compensation between I, P and B pictures of said to-be-encoded pictures, a statistics computer connected to statistics gatherer for statistically allocating a bit rate to each of said video signals, in each corresponding bit stream, based on said pre-encoding a priori statistics generated in said statistics gatherer, one or more encoders connected to said statistics computer for independently re-encoding each of said video signals, in each corresponding bit stream, to produce a corresponding compressed video bit stream depending on said bit rate allocated in said statistics computer, and a multiplexer for combining each of said compressed video bit streams with at least one other compressed video bit stream into a single multiplexed bit stream.
Claim 15
Dependent Claim
69 words
The statistical multiplexer of claim 12 wherein said statistics gatherer generates a pre-encoded compressed video bit stream for each of said video signals, said statistical multiplexer further comprising: one or more decoders, each of which corresponding to a different one of said encoders, for decoding each of said pre-compressed video bit streams to reproduce said video signal, said corresponding encoder re-encoding said video signals reproduced by said corresponding decoder.
Claim 16
Dependent Claim
24 words
The method of claim 13 wherein said pre-encoding a priori statistics include picture types generated in encoding said video signals in said step (a).
Claim 17
Dependent Claim
19 words
The statistical multiplexer of claim 12 wherein said encoders re-encode said same video signals received at said statistics gatherer.
Claim 18
Dependent Claim
44 words
The statistical multiplexer of claim 12 wherein said statistics gatherer generates pre-encoding results utilized in generating a pre-compressed video signal for each of said video signals, and wherein said encoders utilize said pre-encoding results generated by said statistics gatherer in compressing said video signals.
Claim 19
Dependent Claim
92 words
The statistical multiplexer of claim 12 wherein said statistics computer generates said pre-encoding a priori statistics for a plurality of pictures of each of said video signals, for each video signal, adds up said pre-encoding a priori statistics for a plurality of said pictures of said video signal to produce a first sum, and for each video signal, allocates a number of bits for encoding one of said pictures of said plurality in proportion to said first sum relative to sums produced for each video signal to be combined by said multiplexer.
Claim 20
Dependent Claim
97 words
The statistical multiplexer of claim 17 wherein, for each video signal, said statistical multiplexer generates pre-encoding a priori statistics for a first sequence of pictures of a first predetermined length from a first one of said plurality of pictures to be encoded, adds up said pre-encoding a priori statistics for a second sequence of pictures of a second predetermined length from said first picture, and if said second predetermined length exceeds said first predetermined length, for each picture in said second sequence but not in said first sequence, said statistical multiplexer estimates said pre-encoding a priori statistics.
Claim 21
Dependent Claim
39 words
The statistical multiplexer of claim 12 wherein said bit rate allocated to at least one of said video signals by said statistics computer depends on statistics gathered for at least two pictures of said at least one video signal.
Claim 22
Dependent Claim
29 words
The statistical multiplexer of claim 12 wherein said pre-encoding a priori statistics measure a number of bits generated in encoding each of said video signals in said statistics gatherer.
Claim 23
Dependent Claim
27 words
The statistical multiplexer of claim 12 wherein said pre-encoding a priori statistics measure an average quantization level used in encoding said video signals in said statistics gatherer.
Claim 24
Dependent Claim
26 words
The statistical multiplexer of claim 12 wherein said pre-encoding a priori statistics include scene change locations identified in encoding said video signals in said statistics gatherer.
Claim 25
Dependent Claim
26 words
The statistical multiplexer of claim 12 wherein said pre-encoding a priori statistics include repeat field patterns produced while encoding said video signals in said statistics gatherer.
Claim 26
Dependent Claim
24 words
The statistical multiplexer of claim 12 wherein said pre-encoding apriori statistics include picture types generated in encoding said video signals in said statistics gatherer.
Claim 27
Independent Claim
175 words
A method for multiplexing plural encoded video signals into a single multiplexed bit stream comprising the steps of: (a) generating a priori statistics, during a pre-encoding stage, regarding a plural of to-be-encoded pictures of each of plural video signals having mutually independent timing, said a priori statistics indicating a complexity involved in encoding said to-be-encoded pictures, wherein said pre-encoding stage includes motion compensation between I, P and B pictures of said to-be-encoded pictures, (b) generating aposteriori statistics regarding one or more previously encoded pictures of each of said video signals, indicating a complexity involved in encoding each of said previously encoded pictures, (c) statistically allocating a bit rate to each of said video signals based on said a priori and a posteriori statistics generated in said steps (a) and (b), (d) independently encoding each of said to-be-encoded pictures of said video signals to produce a corresponding compressed video bit stream depending on said bit rate allocated in said step (c), and (e) combining each of said compressed video bit streams into a multiplexed bit stream.
Claim 28
Independent Claim
175 words
A method for multiplexing plural encoded video signals into a single multiplexed bit stream comprising the steps of: (a) generating a priori statistics, during a pre-encoding stage, regarding a plural of to-be-encoded pictures of each of plural video signals having mutually independent timing, said a priori statistics indicating a complexity involved in encoding said to-be-encoded pictures, wherein said pre-encoding stage includes motion compensation between I, P and B pictures of said to-be-encoded pictures, (b) generating aposteriori statistics regarding one or more previously encoded pictures of each of said video signals, indicating a complexity involved in encoding each of said previously encoded pictures, (c) statistically allocating a bit rate to each of said video signals based on said a priori and a posteriori statistics generated in said steps (a) and (b), (d) independently encoding each of said to-be-encoded pictures of said video signals to produce a corresponding compressed video bit stream depending on said bit rate allocated in said step (c), and (e) combining each of said compressed video bit streams into a multiplexed bit stream.
Claim 29
Dependent Claim
25 words
The method of claim 25 further comprising: (f) pre-encoding each of said to-be-encoded pictures, and (g) gathering said a priori statistics during said step (f).
Claim 30
Dependent Claim
28 words
The method of claim 26 wherein said a priori statistics measure a number of bits generated in a compressed one of said to-be-encoded pictures in said step (f).
Claim 31
Dependent Claim
20 words
The method of claim 26 wherein said a priori statistics measure an average quantization level used in said step (f).
Claim 32
Dependent Claim
19 words
The method of claim 26 wherein said a priori statistics include scene change locations identified in said step (f).
Claim 33
Dependent Claim
19 words
The method of claim 26 wherein said a priori statistics include repeat field patterns produced in said step (f).
Claim 34
Dependent Claim
18 words
The method of claim 26 wherein said a priori statistics include picture types generated in said step (f).
Claim 35
Dependent Claim
17 words
The method of claim 25 wherein said a priori statistics include inter-pixel differences in said to-be-encoded pictures.
Claim 36
Dependent Claim
87 words
The method of claim 25 further comprising: (f) allocating bits to a second group of one or more video signals using only a posteriori statistics gathered for said second group of video signals, (g) encoding said second group of video signals according to said bit allocations made in step (f) to produce a second group of compressed video bit streams, and (h) combining said second group of video compressed video bit streams and said video bit streams produced in said step (d) into a multiplexed bit stream.
Claim 37
Dependent Claim
201 words
A statistical multiplexer for multiplexing plural encoded video signals into a single multiplexed bit stream comprising: a statistics gatherer for gathering a priori statistics, during a pre-encoding stage, regarding a plural of to-be-encoded pictures of each of plural video signals having mutually independent timing, said a priori statistics indicating a complexity involved in encoding said to-be-encoded pictures, wherein said pre-encoding stage includes motion compensation between I, P and B pictures of said to-be-encoded pictures, a plurality of encoders for encoding to-be-encoded pictures of said plural video signals and for generating a posteriori statistics regarding one or more previously encoded pictures of each of said video signals, indicating a complexity involved in encoding each of said previously encoded pictures, a statistics computer for statistically allocating a bit rate to each of said video signals based on said a priori and a posteriori statistics generated by said statistics gatherer and said plurality of encoders, wherein said encoders independently encode each of said to-be-encoded pictures of said video signals to produce a corresponding compressed video bit stream depending on said bit rate allocated by said statistics computer, and a multiplexer for combining each of said compressed video bit streams into a multiplexed bit stream.
Claim 38
Dependent Claim
201 words
A statistical multiplexer for multiplexing plural encoded video signals into a single multiplexed bit stream comprising: a statistics gatherer for gathering a priori statistics, during a pre-encoding stage, regarding a plural of to-be-encoded pictures of each of plural video signals having mutually independent timing, said a priori statistics indicating a complexity involved in encoding said to-be-encoded pictures, wherein said pre-encoding stage includes motion compensation between I, P and B pictures of said to-be-encoded pictures, a plurality of encoders for encoding to-be-encoded pictures of said plural video signals and for generating a posteriori statistics regarding one or more previously encoded pictures of each of said video signals, indicating a complexity involved in encoding each of said previously encoded pictures, a statistics computer for statistically allocating a bit rate to each of said video signals based on said a priori and a posteriori statistics generated by said statistics gatherer and said plurality of encoders, wherein said encoders independently encode each of said to-be-encoded pictures of said video signals to produce a corresponding compressed video bit stream depending on said bit rate allocated by said statistics computer, and a multiplexer for combining each of said compressed video bit streams into a multiplexed bit stream.
Claim 39
Dependent Claim
37 words
The statistical multiplexer of claim 34 wherein said statistics gatherer comprises: a second encoder for pre-encoding each of said to-be-encoded pictures to produce pre-compressed pictures, said statistics gatherer gathering said a priori statistics from said pre-compressed pictures.
Claim 40
Dependent Claim
29 words
The statistical multiplexer of claim 35 wherein said a priori statistics measure a number of bits generated in a compressed one of said to-be-encoded pictures in said second encoder.
Claim 41
Dependent Claim
26 words
The statistical multiplexer of claim 35 wherein said a priori statistics measure an average quantization level used in encoding said to-be-encoded pictures in said second encoder.
Claim 42
Dependent Claim
25 words
The statistical multiplexer of claim 35 wherein said a priori statistics include scene change locations identified in encoding said to-be-encoded pictures in said second encoder.
Claim 43
Dependent Claim
25 words
The statistical multiplexer of claim 35 wherein said a priori statistics include repeat field patterns produced in encoding said to-be-encoded pictures in said second encoder.
Claim 44
Dependent Claim
24 words
The statistical multiplexer of claim 35 wherein said a priori statistics include picture types generated in encoding said to-be-encoded pictures in said second encoder.
Claim 45
Dependent Claim
18 words
The statistical multiplexer of claim 34 wherein said a priori statistics include inter-pixel differences in said to-be-encoded pictures.
Claim 46
Dependent Claim
96 words
The statistical multiplexer of claim 34 wherein said statistics computer allocates bits to a second group of one or more video signals using only a posteriori statistics gathered for said second group of video signals, said statistical multiplexer further comprising: a second group of encoders for encoding said second group of video signals according to said bit allocations therefor to produce a second group of compressed video bit streams, wherein said multiplexer combines said second group of video compressed video bit streams and said video bit streams produced by said encoders into a multiplexed bit stream.
References Cited (Backward Citations)
US4394774A
Cited
US5115309A
Cited
US5550589A
Cited
US5216503A
Cited
US5289462A
Cited
US5534926A
Cited
US5537440A
Cited
US5550590A
Cited
US5541852A
Cited
US5617142A
Cited
US5805220A
Cited
US5754700A
Cited
US5708664A
Cited
US5717464A
Cited
US5861919A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-03-14 | 2003-09-13 | 2004-03-14 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-03-14 | 2007-09-13 | 2008-03-14 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-03-14 | 2011-09-13 | 2012-03-14 | $7700.00 | Window Closed / Lapsed |