System and method for improved fine granular scalable video using base layer coding information

Claim 2

For use in a video encoder comprising: 1) a base layer circuit capable of receiving an input stream of video frames and generating therefrom compressed base layer video frames suitable for transmission at a base layer bit rate to a streaming video receiver, and 2) an enhancement layer circuit capable of receiving said input stream of video frames and a decoded version of said compressed base layer video frames and generating therefrom enhancement layer video data associated with, and allocated to, corresponding ones of said compressed base layer video frames and suitable for transmission at a modifiable enhancement layer bit rate to said streaming video receiver, an apparatus for controlling transmission of said enhancement layer video data comprising: a base layer parameter monitor capable of receiving at least one base layer parameter and, in response thereto, developing a rate allocation output and modifying an allocation of said enhancement layer video data among said corresponding ones of said compressed base layer video frames.

Claim 3

The apparatus set forth in claim 1 wherein said video encoder comprises a motion estimation circuit capable of receiving said input stream of video frames and determining therefrom a base layer motion parameter associated with at least one selected frame sequence in said input stream of video frames.

Claim 4

The apparatus set forth in claim 2 wherein said base layer parameter monitor receives said base layer motion parameter and, in response thereto, modifies said allocation of said enhancement layer video data according to a level of motion in said at least one selected frame sequence indicated by said base layer motion parameter.

Claim 5

The apparatus set forth in claim 1 wherein said video encoder comprises a quantization circuit capable of receiving and quantizing transform data associated with said input stream of video frames to thereby reduce a size of said transform data and further capable of determining a base layer quantization error parameter associated with said quantized transform data.

Claim 6

The apparatus set forth in claim 4 wherein said base layer parameter monitor receives said base layer quantization error parameter and, in response thereto, modifies said allocation of said enhancement layer video data according to a quantization error indicated by said base layer quantization error parameter.

Claim 7

The apparatus set forth in claim 1 wherein said video encoder comprises a base layer rate allocation circuit capable of determining said base layer bit rate, wherein said base layer bit rate is set at a pre-determined minimum rate at which said compressed base layer video frames are transmitted to said streaming video receiver, and generating therefrom a base layer bit rate parameter associated with said base layer bit rate.

Claim 8

The apparatus set forth in claim 6 wherein said base layer parameter monitor receives said base layer bit rate parameter and, in response thereto, modifies said allocation of said enhancement layer video data according to an estimated difference between said compressed base layer video frames and estimated compressed base layer video frames associated with a second base layer bit rate greater than said pre-determined minimum rate.

Claim 9

For use in a data network comprising a plurality of nodes capable of receiving streaming video data, a streaming video transmitter capable of transmitting said streaming video data to one or more of said nodes, said streaming video transmitter comprising: a video frame source capable of generating an original stream of video frames; and a video encoder comprising: a base layer circuit capable of receiving said original stream of video frames and generating therefrom compressed base layer video frames suitable for transmission at a base layer bit rate to said one or more of said nodes; an enhancement layer circuit capable of receiving said original stream of video frames and a decoded version of said compressed base layer video frames, developing a rate allocation output and generating therefrom enhancement layer video data associated with, and allocated to, corresponding ones of said compressed base layer video frames and suitable for transmission at a modifiable enhancement layer bit rate to said one or more of said nodes; and an apparatus for controlling transmission of said enhancement layer video data comprising a base layer parameter monitor capable of receiving at least one base layer parameter and, in response thereto, developing a rate allocation output and modifying an allocation of said enhancement layer video data among said corresponding ones of said compressed base layer video frames.

Claim 10

For use in a data network comprising a plurality of nodes capable of receiving streaming video data, a streaming video transmitter capable of transmitting said streaming video data to one or more of said nodes, said streaming video transmitter comprising: a video frame source capable of generating an original stream of video frames; and a video encoder comprising: a base layer circuit capable of receiving said original stream of video frames and generating therefrom compressed base layer video frames suitable for transmission at a base layer bit rate to said one or more of said nodes; an enhancement layer circuit capable of receiving said original stream of video frames and a decoded version of said compressed base layer video frames, developing a rate allocation output and generating therefrom enhancement layer video data associated with, and allocated to, corresponding ones of said compressed base layer video frames and suitable for transmission at a modifiable enhancement layer bit rate to said one or more of said nodes; and an apparatus for controlling transmission of said enhancement layer video data comprising a base layer parameter monitor capable of receiving at least one base layer parameter and, in response thereto, developing a rate allocation output and modifying an allocation of said enhancement layer video data among said corresponding ones of said compressed base layer video frames.

Claim 11

The streaming video transmitter set forth in claim 8 wherein said video encoder comprises a motion estimation circuit capable of receiving said input stream of video frames and determining therefrom a base layer motion parameter associated with at least one selected frame sequence in said input stream of video frames.

Claim 12

The streaming video transmitter set forth in claim 9 wherein said base layer parameter monitor receives said base layer motion parameter and, in response thereto, modifies said allocation of said enhancement layer video data according to a level of motion in said at least one selected frame sequence indicated by said base layer motion parameter.

Claim 13

The streaming video transmitter set forth in claim 8 wherein said video encoder comprises a quantization circuit capable of receiving and quantizing transform data associated with said input stream of video frames to thereby reduce a size of said transform data and further capable of determining a base layer quantization error parameter associated with said quantized transform data.

Claim 14

The streaming video transmitter set forth in claim 11 wherein said base layer parameter monitor receives said base layer quantization error parameter and, in response thereto, modifies said allocation of said enhancement layer video data according to a quantization error indicated by said base layer quantization error parameter.

Claim 15

The streaming video transmitter set forth in claim 8 wherein said video encoder comprises a base layer rate allocation circuit capable of determining said base layer bit rate, wherein said base layer bit rate is set at a pre-determined minimum rate at which said compressed base layer video frames are transmitted to said streaming video receiver, and generating therefrom a base layer bit rate parameter associated with said base layer bit rate.

Claim 16

The streaming video transmitter set forth in claim 13 wherein said base layer parameter monitor receives said base layer bit rate parameter and, in response thereto, modifies said allocation of said enhancement layer video data according to an estimated difference between said compressed base layer video frames and estimated compressed base layer video frames associated with a second base layer bit rate greater than said pre-determined minimum rate.

Claim 17

For use in a video encoder comprising: 1) a base layer circuit capable of receiving an input stream of video frames and generating therefrom compressed base layer video frames suitable for transmission at a base layer bit rate to a streaming video receiver, and 2) an enhancement layer circuit capable of receiving the input stream of video frames and a decoded version of the compressed base layer video frames and generating therefrom enhancement layer video data associated with, and allocated to, corresponding ones of the compressed base layer video frames and suitable for transmission at a modifiable enhancement layer bit rate to the streaming video receiver, a method for controlling a transmission of the enhancement layer video data comprising the steps of: monitoring at least one base layer parameter; and in response to a value of the monitored at least one base layer parameter, developing a rate allocation output and modifying an allocation of the enhancement layer video data among the corresponding ones of the compressed base layer video frames.

Claim 18

For use in a video encoder comprising: 1) a base layer circuit capable of receiving an input stream of video frames and generating therefrom compressed base layer video frames suitable for transmission at a base layer bit rate to a streaming video receiver, and 2) an enhancement layer circuit capable of receiving the input stream of video frames and a decoded version of the compressed base layer video frames and generating therefrom enhancement layer video data associated with, and allocated to, corresponding ones of the compressed base layer video frames and suitable for transmission at a modifiable enhancement layer bit rate to the streaming video receiver, a method for controlling a transmission of the enhancement layer video data comprising the steps of: monitoring at least one base layer parameter; and in response to a value of the monitored at least one base layer parameter, developing a rate allocation output and modifying an allocation of the enhancement layer video data among the corresponding ones of the compressed base layer video frames.

Claim 19

The method set forth in claim 15 wherein the video encoder comprises a motion estimation circuit capable of receiving the input stream of video frames and determining therefrom a base layer motion parameter associated with at least one selected frame sequence in the input stream of video frames.

Claim 20

The method set forth in claim 16 further comprising the steps of monitoring the base layer motion parameter and, in response thereto, modifying the allocation of the enhancement layer video data according to a level of motion in the at least one selected frame sequence indicated by the base layer motion parameter.

Claim 21

The method set forth in claim 15 wherein the video encoder comprises a quantization circuit capable of receiving and quantizing transform data associated with the input stream of video frames to thereby reduce a size of the transform data and further capable of determining a base layer quantization error parameter associated with the quantized transform data.

Claim 22

The method set forth in claim 18 further comprising the steps of monitoring the base layer quantization error parameter and, in response thereto, modifying the allocation of the enhancement layer video data according to a quantization error indicated by the base layer quantization error parameter.

Claim 23

The method set forth in claim 15 wherein the video encoder comprises a base layer rate allocation circuit capable of determining the base layer bit rate, wherein the base layer bit rate is set at a pre-determined minimum rate at which the compressed base layer video frames are transmitted to the streaming video receiver, and generating therefrom a base layer bit rate parameter associated with the base layer bit rate.

Claim 24

The method set forth in claim 20 further comprising the steps of monitoring the base layer bit rate parameter and, in response thereto, modifying the allocation of the enhancement layer video data according to an estimated difference between the compressed base layer video frames and estimated compressed base layer video frames associated with a second base layer bit rate greater than the pre-determined minimum rate.