Derivation of studio camera position and motion from the camera image

Claim 3

The method of claim 1, wherein only the background areas of said video images are used in the measurement of translation and scale change.

Claim 4

The method of claim 2, wherein a signal is used to separate foreground and background and said signal is derived using chroma-key techniques.

Claim 5

The method of claim 2, wherein a signal is used to separate foreground and background portions of the images and said signal is derived using motion detection methods to identify objects moving with a different motion from that predicted for the background.

Claim 6

The method of claim 1, wherein: each image is a single-component signal derived from a camera viewing a scene containing a background of near-uniform color; said background is divided into a plurality of areas each having a hue and/or brightness different from the hue and/or brightness of adjacent areas to allow the generation of a key signal by chroma-key techniques; and wherein said single-component signal is formed from a three-component camera signal so to accentuate differences in hue and/or brightness of individual areas of said background to enable motion estimation.

Claim 9

The method of claim 6, wherein said background is divided into a plurality of areas, each area having one of two hues and/or brightnesses.

Claim 10

The method of claim 6, wherein said areas of the background are square.

Claim 11

The method of claim 1 or 6, wherein said translation and scale change are predicted by the computation of a number of simultaneous equations each of which relate said translation and scale change to spatial and temporal gradients at a point in the reference image and which are solved to yield a least-squares solution for the motion parameters.

Claim 12

The method of claim 1 or 6, comprising: selecting a number of measurement points in said first image for motion estimation; and replacing said first image with a new incoming image when the number of measurement points which lie in areas of background visible in both said first image and a given incoming image falls below a given proportion of the total number of measurement points.

Claim 13

The method of claim 1 or 6, comprising replacing said first image if the scale change between an incoming image and the reference image exceeds a given factor.

Claim 14

The method of claim 1 or 6, comprising spatially prefiltering said first image prior to storage and comparison.

Claim 15

The method of claim 10, wherein said measurement points lie in a regular array in the image.

Claim 16

The method of claim 10 wherein said measurement points are chosen to lie at points of high spatial gradient.

Claim 17

The method of claim 1 or 6, comprising storing replaced reference images for later use.

Claim 18

Apparatus for measuring the translation and scale change in a sequence of video images, comprising: means for acquiring said sequence of images; storage means for storing a first image in said sequence to form a stored image; means for forming a prediction of the translation and scale change from said stored image to a further image in said sequence; means for transforming said stored image by said prediction of the translation and scale change to form a transformed first image; means for comparing said transformed first image with a further image in the sequence; means for deriving measurements of translation and scale change between said stored image and said further image from said comparison and said prediction; and means for replacing said first image with a new incoming image when the image area common to both said first image and incoming image falls below a given proportion of the whole image area of said incoming images.

Claim 19

Apparatus for measuring the translation and scale change in a sequence of video images, comprising: means for acquiring said sequence of images; storage means for storing a first image in said sequence to form a stored image; means for forming a prediction of the translation and scale change from said stored image to a further image in said sequence; means for transforming said stored image by said prediction of the translation and scale change to form a transformed first image; means for comparing said transformed first image with a further image in the sequence; means for deriving measurements of translation and scale change between said stored image and said further image from said comparison and said prediction; and means for replacing said first image with a new incoming image when the image area common to both said first image and incoming image falls below a given proportion of the whole image area of said incoming images.

Claim 20

The apparatus of claim 16, wherein said means for deriving operates only on the background areas of the images, said means for deriving comprising means for separating foreground and background portions of the images using motion techniques to identify objects moving with a different motion from that predicted for the background.

Claim 21

The apparatus of claim 16, wherein said means for deriving operates only on the background areas of the images, and said means for deriving comprising a key generator for generating a chroma-key to separate foreground and background.

Claim 22

The apparatus of claim 16, comprising: means for generating a single-component signal from a camera viewing a scene containing a background of near-uniform color, said background being divided into a plurality of areas each having a hue and/or brightness different from the hue and/or brightness of adjacent areas to allow the generation of a key signal by chroma-key techniques, and wherein the single-component signal is formed from a three-component camera signal so as to accentuate differences in hue and/or brightness of individual areas of the background to enable motion estimation.

Claim 23

Apparatus for measuring the translation and scale change in a sequence of video images derived by a camera, comprising: means for storing a first image of said sequence to form a stored image, said image comprising a single component signal derived by a camera viewing a scene containing a background of near-uniform color, said background being divided into a plurality of areas each having a hue and/or brightness different from the hue and/or brightness of adjacent areas to allow generation of a key signal by chroma-key techniques; means for forming said single-component signal from said camera signal so as to accentuate differences in hue and/or brightness of individual areas of the background to enable motion estimation; means for forming a prediction of the translation and scale change from said stored image to a further image in said sequence; means for transforming the stored image by a prediction of the translation and scale change to form a transformed first image; means for comparing a further image in said sequence with said transformed first image; and means for deriving, from said comparison and said prediction, measurements of translation of scale change between said stored image and said further image.

Claim 24

Apparatus for measuring the translation and scale change in a sequence of video images derived by a camera, comprising: means for storing a first image of said sequence to form a stored image, said image comprising a single component signal derived by a camera viewing a scene containing a background of near-uniform color, said background being divided into a plurality of areas each having a hue and/or brightness different from the hue and/or brightness of adjacent areas to allow generation of a key signal by chroma-key techniques; means for forming said single-component signal from said camera signal so as to accentuate differences in hue and/or brightness of individual areas of the background to enable motion estimation; means for forming a prediction of the translation and scale change from said stored image to a further image in said sequence; means for transforming the stored image by a prediction of the translation and scale change to form a transformed first image; means for comparing a further image in said sequence with said transformed first image; and means for deriving, from said comparison and said prediction, measurements of translation of scale change between said stored image and said further image.

Claim 25

The apparatus of claim 19 or 20, wherein said background is divided into a plurality of areas each area having one or two hues and/or brightnesses.

Claim 26

The apparatus of claim 19 or 20, wherein said areas of the background are square.

Claim 27

The apparatus of claim 19 or 20, comprising: means for predicting the translation and scale change by the computation of a number of simultaneous equations each of which relate the translation and scale change to spatial and temporal gradients at a point in the first image and which are solved to yield a least-squares solution for the motion parameters.

Claim 28

The apparatus of claim 19 or 20, wherein the replacing means comprises: means for selecting a number of measurement points in the first image for motion estimation and for replacing the first image with a new incoming image when the number of measurement points which lie in areas of background visible in both the first image and a given incoming image falls below a given proportion of the total number of measurement points.

Claim 29

The apparatus of claim 16 or 20, comprising a spatial filter for filtering the images prior to storage and comparison.

Claim 30

The apparatus of claim 16 or 20, comprising a further storage means for storing a replaced reference image for future use.