Video coding scheme with foreground/background separation

Claim 2

A computer-implemented method for encoding pictures of a sequence of pictures, comprising the steps of: (a) determining with an encoding system a relatively fixed background of the sequence of pictures; (b) transmitting the background to a decoding system; (c) separating foreground objects of a current picture of the sequence of pictures from the background; (d) performing motion compensation encoding of the foreground objects with respect to at least one previous picture; (e) transmitting the encoded foreground objects to the decoding system; and (f) repeating steps (c) through (e) for subsequent current pictures of the sequence of pictures without repeating step (b).

Claim 3

The method of claim 1, wherein step (a) comprises the step of selecting the first picture of the sequence of pictures as the background.

Claim 4

The method of claim 1, wherein step (a) comprises the step of selecting as the background a picture having no foreground objects.

Claim 5

The method of claim 1, comprising the further step of: (g) transmitting background updating information to the decoding system in accordance with changes to the background.

Claim 6

The method of claim 4, wherein the background updating information comprises global motion vectors and background residual error.

Claim 7

The method of claim 4, further comprising the steps of: (h) storing the background in a background bitmap; (i) storing a decoded picture bitmap corresponding to the current picture, the decoded picture bitmap comprising foreground objects and portions of the background not occluded by the foreground objects; and (j) storing a separation bitmap which indicates the foreground or background status of pixels of the decoded picture bitmap.

Claim 8

The method of claim 6, comprising the further step of: (k) updating the background bitmap, decoded picture bitmap, and separation bitmap.

Claim 9

The method of claim 6, wherein the separation bitmap is a binary bitmap which indicates whether each pixel of the decoded picture bitmap is a foreground or background pixel.

Claim 10

The method of claim 6, wherein the separation bitmap is a multibit bitmap which indicates a foreground/background blend ratio for each pixel of the decoded picture bitmap.

Claim 11

The method of claim 9, wherein: pixels wholly inside a foreground object have a 100% foreground blend ratio; pixels wholly outside all foreground objects have a 100% background blend ratio; and pixels near a boundary between a foreground object and the background have a blend ratio having both foreground and background components.

Claim 12

A computer-implemented apparatus for encoding pictures of a sequence of pictures, comprising: (a) an encoding system for determining a relatively fixed background of the sequence of pictures; (b) means for transmitting the background to a decoding system; (c) means for separating foreground objects of a current picture of the sequence of pictures from the background; (d) means for performing motion compensation encoding of the foreground objects with respect to at least one previous picture; (e) means for transmitting the encoded foreground objects to the decoding system;and (f) means for repeating the functions of means (c) through (e) for subsequent current pictures of the sequence of pictures without repeating the transmitting of means (b).

Claim 13

A computer-implemented apparatus for encoding pictures of a sequence of pictures, comprising: (a) an encoding system for determining a relatively fixed background of the sequence of pictures; (b) means for transmitting the background to a decoding system; (c) means for separating foreground objects of a current picture of the sequence of pictures from the background; (d) means for performing motion compensation encoding of the foreground objects with respect to at least one previous picture; (e) means for transmitting the encoded foreground objects to the decoding system;and (f) means for repeating the functions of means (c) through (e) for subsequent current pictures of the sequence of pictures without repeating the transmitting of means (b).

Claim 14

The apparatus of claim 11, wherein the encoding system comprises means for selecting the first picture of the sequence of pictures as the background.

Claim 15

The apparatus of claim 11, wherein the encoding system comprises means for selecting as the background a picture having no foreground objects.

Claim 16

The apparatus of claim 11, further comprising: (g) means for transmitting background updating information to the decoding system in accordance with changes to the background.

Claim 17

The apparatus of claim 14, wherein the background updating information comprises global motion vectors and background residual error.

Claim 18

The apparatus of claim 14, further comprising: (h) memory means for storing the background in a background bitmap; (i) memory means for storing a decoded picture bitmap corresponding to the current picture, the decoded picture bitmap comprising foreground objects and portions of the background not occluded by the foreground objects; and (j) memory means for storing a separation bitmap which indicates the foreground or background status of pixels of the decoded picture bitmap.

Claim 19

The apparatus of claim 16, comprising the further step of: (k) means for updating the background bitmap, decoded picture bitmap, and separation bitmap.

Claim 20

The apparatus of claim 16, wherein the separation bitmap is a binary bitmap which indicates whether each pixel of the decoded picture bitmap is a foreground or background pixel.

Claim 21

The apparatus of claim 16, wherein the separation bitmap is a multibit bitmap which indicates a foreground/background blend ratio for each pixel of the decoded picture bitmap.

Claim 22

The apparatus of claim 19, wherein: pixels wholly inside a foreground object have a 100% foreground blend ratio; pixels wholly outside all foreground objects have a 100% background blend ratio; and pixels near a boundary between a foreground object and the background have a blend ratio having both foreground and background components.

Claim 23

The apparatus of claim 11, further comprising: (f) a bus; and (g) a memory device electrically connected to the bus.

Claim 24

A computer-implemented method for decoding pictures of a sequence of pictures, comprising the steps of: (A) decoding encoded pictures to generate a decoded picture; and (B) displaying the decoded picture, wherein the encoded pictures were generated by: (a) determining with an encoding system a relatively fixed background of the sequence of pictures; (b) transmitting the background to the decoding system; (c) separating foreground objects of a current picture of the sequence of pictures from the background; (d) performing motion compensation encoding of the foreground objects with respect to at least one previous picture; (e) transmitting the encoded foreground objects to the decoding system; and (f) repeating steps (c) through (e) for subsequent current pictures of the sequence of pictures without repeating step (b).

Claim 25

A computer-implemented method for decoding pictures of a sequence of pictures, comprising the steps of: (A) decoding encoded pictures to generate a decoded picture; and (B) displaying the decoded picture, wherein the encoded pictures were generated by: (a) determining with an encoding system a relatively fixed background of the sequence of pictures; (b) transmitting the background to the decoding system; (c) separating foreground objects of a current picture of the sequence of pictures from the background; (d) performing motion compensation encoding of the foreground objects with respect to at least one previous picture; (e) transmitting the encoded foreground objects to the decoding system; and (f) repeating steps (c) through (e) for subsequent current pictures of the sequence of pictures without repeating step (b).

Claim 26

The method of claim 22, wherein step (a) comprises the step of selecting the first picture of the sequence of pictures as the background.

Claim 27

The method of claim 22, wherein step (a) comprises the step of selecting as the background a picture having no foreground objects.

Claim 28

The method of claim 22, wherein the encoded pictures were generated by the further step of: (g) transmitting background updating information to the decoding system in accordance with changes to the background.

Claim 29

The method of claim 25, wherein the background updating information comprises global motion vectors and background residual error.

Claim 30

The method of claim 25, wherein the encoded pictures were further generated by the further steps of: (h) storing the background in a background bitmap; (i) storing a decoded picture bitmap corresponding to the current picture, the decoded picture bitmap comprising foreground objects and portions of the background not occluded by the foreground objects; and (j) storing a separation bitmap which indicates the foreground or background status of pixels of the decoded picture bitmap.

Claim 31

The method of claim 27, wherein the encoded pictures were further generated by the further step of: (k) updating the background bitmap, decoded picture bitmap, and separation bitmap.

Claim 32

The method of claim 27, wherein the separation bitmap is a binary bitmap which indicates whether each pixel of the decoded picture bitmap is a foreground or background pixel.

Claim 33

The method of claim 27, wherein the separation bitmap is a multibit bitmap which indicates a foreground/background blend ratio for each pixel of the decoded picture bitmap.

Claim 34

The method of claim 30, wherein: pixels wholly inside a foreground object have a 100% foreground blend ratio; pixels wholly outside all foreground objects have a 100% background blend ratio; and pixels near a boundary between a foreground object and the background have a blend ratio having both foreground and background components.