Abstract A method and apparatus for generating region frames from video frames are disclosed which employs an industry standard encoder to lessen the negative impact on the quality of the transmitted video sequence while consuming fewer bits. The invention utilizes image segmentation and color replacement techniques to create the region frames. Each region frame includes a subject region, zero or more previously segmented regions and zero or more non-subject regions. The subject region is defined by the pixels of the original video frame. The previously segmented regions and non-subject regions are assigned replacement pixels P n ,y and C n , respectively. The replacement pixel C n is chosen to indicate a color that is not likely to be confused with any color in the subject region R n . The replacement pixels P n ,y are chosen such that the compression ratio of the region frame data is maximized. Using the region frames, content based scalability can be provided without the need for special encoders and/or channels having a wider bandwidth. The decoder may comprise color or chroma keying apparatus or circuitry keying on the replacement color C n . Instead of keying on a single value, two thresholds may be assigned to define a boundary condition or a subject semi-transparent region. The decoder is forwarded data of the two thresholds and a flag is sent to indicate the special boundary or semi-transparent region coding. A blending process blends the foreground and background of the semi-transparent object.
A method for encoding video frame data, wherein said video frame data includes pixel values that define regions, said regions categorized as at least one subject region and at least one non-subject region, said method comprising: extracting said pixel values defining a subject region of the at least one subject region from said video frame data; assigning first and second threshold values for pixels such that one represents the subject region and the other represents the at least one non-subject region; assigning a transparency value to said pixel values defining the subject region; and generating encoded pixel values as a weighted summation of the pixel values defining the subject region and one of either a color coding value and background picture pixels, wherein the weighted summation is a function of the transparency value.
Claim 2
Independent Claim
133 words
A method for encoding video frame data, wherein said video frame data includes pixel values that define regions, said regions categorized as at least one subject region and at least one non-subject region, said method comprising: extracting said pixel values defining a subject region of the at least one subject region from said video frame data; assigning first and second threshold values for pixels such that one represents the subject region and the other represents the at least one non-subject region; assigning a transparency value to said pixel values defining the subject region; and generating encoded pixel values as a weighted summation of the pixel values defining the subject region and one of either a color coding value and background picture pixels, wherein the weighted summation is a function of the transparency value.
Claim 3
Dependent Claim
27 words
A method according to claim 1, said transparency value within the range of 0 to N, inclusive, wherein 0 corresponds to transparency and N corresponds to opacity.
Claim 4
Dependent Claim
54 words
A method according to claim 2, said weighted summation defined as: ##EQU3## where g(x,n) are the encoded pixel values; α(x,n) is the transparency value assigned to the subject region; f(x,n) are the pixel values defining the subject region; and C 0 is the one of the color coding value and the background picture pixels.
Claim 5
Dependent Claim
51 words
A method according to claim 1 for communicating the encoded video frame data further comprising steps of: transmitting the encoded pixel values and the first and second thresholds to a decoder; at the decoder, reconstructing the video frame data based on the encoded pixel values and the first and second thresholds.