Automated encoded signal color image compositing

Claim 3

The method of claim 1, in which; the combining of the foreground and the background video signals is accomplished by simple addition.

Claim 4

The method of claim 1, in which; the combining of the foreground and the background video signals is accomplished by non-additive mixing, wherein the foreground signal level is reduced as the background signal level is increased, and vice-versa.

Claim 5

The method of claim 1, in which; the function by which the first control signal varies may be linear, partially linear, or non-linear with respect to the variations of illumination on the colored backing and with respect to the backing illumination reflected from the foreground subject.

Claim 6

The method of claim 1, in which; the function by which the second control signal varies may be linear, partially linear, or non-linear with respect to the variations of illumination on the colored backing.

Claim 7

The method of claim 1, in which; the foreground video channel is open at full level throughout an entire video frame.

Claim 8

The method of claim 1, in which; the levels compared and automatically matched are automatically retained when the colored backing is no longer in the foreground scene.

Claim 9

The method of claim 1, in which; the levels compared and automatically matched are selectively manually retained.

Claim 10

The method of claim 1, in which; the automatic control of level and phase is accomplished in digital increments.

Claim 11

The method of claim 7, in which; said levels are digitally retained.

Claim 12

The method of claim 1, in which; back and edge-lighting luminance on the foreground subject received from the colored backing, is retained in proportion to the amount by which the second control signal exceeds the first control signal in removing backing luminance.

Claim 13

The method of claim 1, wherein the effects of backing surface glare and noise are eliminated by the additional method steps of; (a) forming an alternate second control signal consisting of a red, green or blue primary video signal which represents the dominant hue of the colored backing, (b) automatically controlling the level of the alternate second control signal to match the level of the second control signal in the backing area defined by said gating pulse, (c) comparing a portion of the alternate second control signal with the second control signal, and (d) utilizing the lesser of the compared signals to control the level of the background scene video signal.

Claim 14

The method of claim 1, in which; the white balance of the foreground subject, discolored by illumination from the colored backing is restored by limiting the video amplitude of the video signal representing the backing color.

Claim 15

The method of claim 1, wherein lighter shadows are made lighter and darker shadows are made darker, which includes the additional method steps of; (a) adjusting the gain and negative voltage offset of that red, green or blue primary video signal that represents the dominant hue of the colored backing, and (b) utilizing the adjusted gain and offset of that video signal to establish a reference level such that when the primary video signal representing the dominant hue of the colored backing exceeds the reference level it is further increased, and alternately, when it falls below the reference level it is further decreased.

Claim 16

The method of claim 1 wherein backing and lens flare are removed from the foreground subject when not compositing, which includes the additional method steps of; (a) subtracting the second control signal amplitude from the first control signal amplitude to form a difference control signal, (b) substituting the difference control signal in place of the first control signal for selectively removing foreground chroma from the forground subject, (c) disconnecting the second control signal from the background video level control circuit.

Claim 17

The method of claim 1 wherein chroma of the foreground scene is encoded by the phase alternate line (PAL) process, and wherein the removal of backing chroma includes the additional steps of; (a) comparing and automatically matching the phase-angle of the generated subcarrier to the phase-angle of the first phase line of video signal in the colored backing area, (b) comparing and automatically matching the phase-angle of a second generated subcarrier to the phase-angle of the phase alternate line of video signal in the colored backing area, (c) selecting the generated subcarrier, the phase of which has been matched to its corresponding video signal line and automatically matching the level of the generated subcarrier to the level of the subcarrier representing the hue of the colored backing, and (d) subtracting each generated subcarrier from its corresponding line of video signal for the removal of colored backing chroma.

Claim 18

The method of claim 16, in which; each of said first and second generated subcarriers phase-locks to its corresponding line of video signal in the presence of quadrature error.

Claim 19

The method of claim 1, in which; (a) the first control signal E b is represented by an equation of the form: E.sub.b ={(K.sub.3 B-G)-K.sub.1 (G-R) OR K.sub.2 (R-G)}.sup.+, (b) wherein OR designates the larger of G-R and R-G, (c) the + symbol designates positive values only of E b in the equation, and (d) K 1 , K 2 and K 3 designate predetermined constants.

Claim 20

The method of claim 1, in which; (a) the second control signal E c is represented by an equation of the form; E.sub.c ={B-K.sub.1 (G OR R)-K.sub.2 (K.sub.3 -B)}.sup.+, (b) wherein OR designates the larger of G and R, (c) the + symbol designates positive values only of E c in the equation, and (d) K 1 and, K 2 designate predetermined constants, and K 3 designated a predetermined voltage level.

Claim 21

The method of claim 1, in which; (a) the second control signal E c is modified to eliminate glare light effects and to reduce background noise level, (b) wherein the modified E c is expressed as: KB AND E.sub.c (c) wherein AND designates the lesser of two values, and (d) K designates a predetermined constant.

Claim 22

The method of claim 1, in which; the gating pulse is present on each foreground video line when the second control signal is within a small range near its peak value and when said peak value is above a selected minimum value.

Claim 23

An electronic apparatus for compositing encoded color image video signals involving a foreground subject disposed before a colored backing and a background scene, which comprises; (a) a source of foreground composite video signals (1) containing red, green and blue components of a foreground scene, (b) a source of background composite video signals (129), (c) means for generating a color subcarrier frequency (14), (d) means for phase-locking the generated color subcarrier (13) to the chroma burst of the foreground composite video signal, (e) automatic means (56,57,58,59,65) for identifying the colored backing in the foreground scene, (f) automatic means (17,18,19,20,21,22,23,24,25,26,16) for phase-matching the generated color subcarrier with a foreground video subcarrier in an area of the foreground scene identified as colored backing area, (g) means for generating (88) a first control signal derived from the red, green and blue components of the foreground video signal, said first control signal being a function of the intensity of these components emanating directly from the colored backing and indirectly as a reflection resulting from backing illumination of the foreground subject, (h) means for utilizing (27,32,35,36,39,41) the first control signal for automatic level matching of the generated subcarrier with the foreground video subcarrier in an area of the foreground scene identified as the colored backing area, (i) means for subtracting (29) the phase matched and level matched generated subcarrier from the foreground scene video signal over the entire foreground scene, (j) means for generating (89) a second control signal utilizing the red, green and blue foreground component signals where said second control signal is proportional to the intensity of colored light emanating directly from the backing, but is not affected by colored light reflecting from the foreground subject, (k) means to selectively proportion (92) said first and second control signals to form a mixed control signal, (l) automatic means (91) for matching the level of said mixed control signal with the level of the luminance of the foreground video signal when in an area of the colored backing, (m) means for subtracting (94) said automatic level matched mixed control signal from the foreground video signal to remove the luminance of the colored backing, (n) means for automatically controlling (105) the level of the second control signal to match a reference level (110), (o) means for automatically controlling (109) the level of the background scene video signal by means of said level controlled second control signal, and (p) means for combining (112) the foreground scene video signal and the background scene video signal after said signals are subjected to control by said first and second control signals.

Claim 24

An electronic apparatus for compositing encoded color image video signals involving a foreground subject disposed before a colored backing and a background scene, which comprises; (a) a source of foreground composite video signals (1) containing red, green and blue components of a foreground scene, (b) a source of background composite video signals (129), (c) means for generating a color subcarrier frequency (14), (d) means for phase-locking the generated color subcarrier (13) to the chroma burst of the foreground composite video signal, (e) automatic means (56,57,58,59,65) for identifying the colored backing in the foreground scene, (f) automatic means (17,18,19,20,21,22,23,24,25,26,16) for phase-matching the generated color subcarrier with a foreground video subcarrier in an area of the foreground scene identified as colored backing area, (g) means for generating (88) a first control signal derived from the red, green and blue components of the foreground video signal, said first control signal being a function of the intensity of these components emanating directly from the colored backing and indirectly as a reflection resulting from backing illumination of the foreground subject, (h) means for utilizing (27,32,35,36,39,41) the first control signal for automatic level matching of the generated subcarrier with the foreground video subcarrier in an area of the foreground scene identified as the colored backing area, (i) means for subtracting (29) the phase matched and level matched generated subcarrier from the foreground scene video signal over the entire foreground scene, (j) means for generating (89) a second control signal utilizing the red, green and blue foreground component signals where said second control signal is proportional to the intensity of colored light emanating directly from the backing, but is not affected by colored light reflecting from the foreground subject, (k) means to selectively proportion (92) said first and second control signals to form a mixed control signal, (l) automatic means (91) for matching the level of said mixed control signal with the level of the luminance of the foreground video signal when in an area of the colored backing, (m) means for subtracting (94) said automatic level matched mixed control signal from the foreground video signal to remove the luminance of the colored backing, (n) means for automatically controlling (105) the level of the second control signal to match a reference level (110), (o) means for automatically controlling (109) the level of the background scene video signal by means of said level controlled second control signal, and (p) means for combining (112) the foreground scene video signal and the background scene video signal after said signals are subjected to control by said first and second control signals.

Claim 25

The apparatus of claim 22, in which; said means for combining (112) are additive.

Claim 26

The apparatus of claim 22, in which the means for generating the first control signal for a blue backing comprises; (a) first means (4,10) to provide a difference signal, of adjustable amplitude, of the green subtracted from the red foreground video signals, (b) second means (3,9) to provide a difference signal, of adjustable amplitude, of the red subtracted from the green foreground video signals, (c) comparison means (5) to cause only the higher of the first and second control signals to be output from said comparison means, (d) means (8) for increasing or decreasing the level of the blue foreground video signal, and (e) subtractive means (2,6) which subtracts from the blue foreground video signal the green video signal and the output of said comparison means (5) to provide a first control signal for controlling the amplitude of the generated color subcarrier signal.

Claim 27

The apparatus of claim 22, in which the means for generating said second control signal comprises; (a) first means (49) to provide the larger of the red and green foreground component signals and means (50) to adjust the amplitude of the signal provided by said first means, (b) second means (52) to provide a difference signal of adjustable amplitude, of the blue foreground video signal subtracted from a selected d.c. voltage, (c) subtractive means (51) that subtracts from the blue video signal the red and green video signals to form said second control signal, and (d) limiting means (55) to prevent negative values of said second control signal.

Claim 28

The apparatus of claim 22, wherein the automatic means for identifying the colored backing in the foreground scene forms a gating pulse, comprising; (a) means for passing (57) said second control signal when it has an amplitude above a selected level, (b) a diode (60) connected to said means for passing, (c) means for storing (58) a level of said second control signal that exceeds the voltage drop of said diode, (d) means for comparing (59) the non-stored remainder of said first control signal and zero, and (e) means for forming (57,58,59,60,61) a square wave gating pulse (65) when said first control signal remainder is within the voltage range of approximately one diode (60) voltage drop and zero.

Claim 29

The apparatus of claim 22, which additionally includes; (a) a clock signal generator (62), and (b) connections therefrom to said automatic means for matching signal levels (66,97,105,91).

Claim 30

The apparatus of claim 27, which additionally includes; (a) a transmission gate (63), (b) gating pulse means (59) connected thereto for passing clock signals from said clock signal generator to said automatic means for matching signal levels.

Claim 31

The apparatus of claim 22 wherein the effects of backing surface glare are eliminated by additional apparatus, comprising; (a) means for comparing (97) the second control signal with the foreground blue video signal, (b) means for utilizing the comparison (99,100) to match the level of the blue video signal to the level of the second control signal, and (c) means for comparing (98) a portion of the matched blue video signal with the second control signal and outputting from said means for comparing (98) the smaller of the two signals compared to constitute the second control signal modified to eliminate glare and noise.

Claim 32

The apparatus of claim 22, which additionally includes clean-up means for removing unwanted subject matter, comprising; (a) means for modifying said second control signal into a partially non-linear control signal, (b) said means for modifying including means for producing (124,125,126,127) a clean-up signal by amplifying the modified second control signal by raising it to full intensity in areas approaching full transparency, and (c) means for concurrently reducing the intensity of the foreground composite video signal in the same areas, whereby semi-transparent subject matter is made fully transparent at such levels, and dust, footprints, and the like on the colored backing of the foreground scene are eliminated.

Claim 33

The apparatus of claim 22, which additionally includes; (a) means to form (123,97,98) an alternate second control signal consisting of a red, green or blue primary video signal that represents a primary hue of the backing, (b) means to automatically control (97,99) the level of the alternate second control signal to match the level of the second control signal in the backing, (c) means to compare (98) a portion (101) of the alternate second control signal level with the second control signal level, and (d) means to utilize (103,104,105) the lesser of the compared signals, to control the level of the background scene video signal.

Claim 36

The method defined by claim 32 further comprising the steps of: (a) generating a second control signal E b as a function of the brightness and visibility of the colored backing and a secondary illumination on the foreground subject received from the colored backing; (b) automatically removing discoloration chroma resulting from said secondary illumination from the second encoded video signal using the gating pulse signal E c ' and the second control signal E b .

Claim 37

The method defined by claim 32 wherein the step of removing the luminance of the colored backed includes the steps of: (a) comparing and automatically adjusting the level of the control signal E c to match the level of the second encoded video signal during the gating pulse; (b) removing the luminance of the colored backing from the second encoded video signal by subtracting the adjusted level of control signal E c from the second encoded video signal.

Claim 38

The method defined by claim 33 wherein the step of removing the luminance of the colored backing includes the steps of: (a) comparing and automatically adjusting the level of the second control signal E b to match the level of the second encoded video signal during the gating pulse; (b) removing the luminance of the colored backing from the second encoded signal by subtracting the adjusted level of second control signal E b from the second encoded video signal.

Claim 39

The method defined by claim 33 wherein said first and second encoded video signals each include a subcarrier signal whose phase angle and amplitude represent the color content of the background and foreground scenes respectively and wherein the step of automatically removing the chroma of the colored backing includes the steps of: (a) comparing and automatically controlling the phase angle of a generated subcarrier signal to match the phase angle of the second encoded video signal during the gating pulse; (b) comparing and automatically controlling the amplitude of the generated subcarrier signal to match the amplitude of the second encoded video signal during the gating pulse; (c) removing the chroma of the colored backing by subtracting the phase and amplitude matched generated subcarrier under control of the second control signal E b .

Claim 42

The method defined by claim 37 wherein the step of removing the luminance of the colored backing includes the steps of: (a) comparing automatically adjusting the level of the second control signal E b to match the level of the second encoded video signal during the gating pulse; (b) removing the luminance of the colored backing from the second encoded video signal by subtracting the adjusted level of second control signal E b from the second encoded video signal.

Claim 43

An electronic apparatus for compositing a first encoded video signal representing a background scene, and a second encoded video signal representing a foreground scene, said foreground scene including a foreground subject and a colored backing, said apparatus comprising: (a) means for generating a control signal E c as a function of a the visibility and brightness of the colored backing; (b) means for generating a gating pulse signal E c ' which represents portions of the foreground scene corresponding to illuminated portions of the colored backing; (c) chroma removal means coupled to said control signal generating means and said gating pulse signal generating means for automatically removing the chroma of the colored backing from the second encoded video signal; (d) luminance removal means coupled to said control signal generating means, said gating pulse signal generating means, and said chroma removal means for removing the luminance of the colored backing from the second encoded video signal; (e) means coupled to said luminance removal means for combining the second encoded video signal, the chroma and luminance of the colored backing having been removed therefrom, with the first encoded video signal to form a composite video image.

Claim 44

An electronic apparatus for compositing a first encoded video signal representing a background scene, and a second encoded video signal representing a foreground scene, said foreground scene including a foreground subject and a colored backing, said apparatus comprising: (a) means for generating a control signal E c as a function of a the visibility and brightness of the colored backing; (b) means for generating a gating pulse signal E c ' which represents portions of the foreground scene corresponding to illuminated portions of the colored backing; (c) chroma removal means coupled to said control signal generating means and said gating pulse signal generating means for automatically removing the chroma of the colored backing from the second encoded video signal; (d) luminance removal means coupled to said control signal generating means, said gating pulse signal generating means, and said chroma removal means for removing the luminance of the colored backing from the second encoded video signal; (e) means coupled to said luminance removal means for combining the second encoded video signal, the chroma and luminance of the colored backing having been removed therefrom, with the first encoded video signal to form a composite video image.

Claim 45

An electronic apparatus for compositing a first encoded video signal representing a background scene, and a second encoded video signal representing a foreground scene, said foreground scene including a foreground subject and a colored backing, said apparatus comprising: (a) means for generating a control signal E b as a function of the visibility and brightness of the colored backing and a secondary illumination on the foreground subject received from the colored backing; (b) means for generating a gating pulse signal E c ' which represents portions of the foreground scene corresponding to illuminated portions of the colored backing; (c) chroma removal means coupled to said control signal generating means and said gating pulse signal generating means for automatically removing the chroma of the colored backing from the second encoded video signal; (d) luminance removal means coupled to said control signal generating means, said gating pulse signal generating means, and said chroma means for removing the luminance of the colored backing from the second encoded video signal; (e) means coupled to said luminance removal means for combining the second encoded video signal, the chroma and luminance of the colored backing having been removed therefrom, with the first encoded video signal to form a composite video image.

Claim 46

An electronic apparatus for compositing a first encoded video signal representing a background scene, and a second encoded video signal representing a foreground scene, said foreground scene including a foreground subject and a colored backing, said apparatus comprising: (a) means for generating a control signal E b as a function of the visibility and brightness of the colored backing and a secondary illumination on the foreground subject received from the colored backing; (b) means for generating a gating pulse signal E c ' which represents portions of the foreground scene corresponding to illuminated portions of the colored backing; (c) chroma removal means coupled to said control signal generating means and said gating pulse signal generating means for automatically removing the chroma of the colored backing from the second encoded video signal; (d) luminance removal means coupled to said control signal generating means, said gating pulse signal generating means, and said chroma means for removing the luminance of the colored backing from the second encoded video signal; (e) means coupled to said luminance removal means for combining the second encoded video signal, the chroma and luminance of the colored backing having been removed therefrom, with the first encoded video signal to form a composite video image.