← Back to Patent Explorer
US5557339A Expired / Lapsed US ⏱️ 0.0 years remaining

Screen filtering boundary detection for noise filtering prior to image compositing

Assignee: Ultimatte Corp
•
Filing: 1994-05-09
•
Granted: 1996-09-17
•
Expires: 2014-05-09
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method and apparatus which allows different amounts of filtering to be applied to specific parts of a foreground image, thus minimizing visible noise in the backing area, while preserving fine detail information of foreground objects. The method and apparatus identify three areas within the foreground, namely unobscured backing (screen) area, screen to foreground subject transition area, foreground subject area. The area where full amount of filtering is desired is the backing area, including shadows. This is the area where the background image will be added, and if noise is present in this area, it will be added to the background image. The transition area from the screen to the foreground object requires variable amounts of filtering, depending on the width of the transition. For sharply focused edges and very fine detail, the transition width is very small, and any filtering applied there will cause blurring and softening of these edges and details. Therefore, no filtering is applied to those areas. For out of focus and moving objects, the transition width is large, and no foreground detail information is visible. In these areas, a variable amount of filtering is applied, based on the width of the transition. In this manner, noise in these transition areas is significantly reduced, without much noticeable change in already blurred edges. Within foreground subject areas, no filtering is applied, thus preserving the detail of the foreground subject.

Inventors

  • 👤 Arpag Dadourian

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-03 03:34
CPC Classifications
H; H04; H04N; H04N9/00; H04N9/64; H04N9/74; H04N9/75; H04N5/00; H04N5/222; H04N5/262; H04N5/272

Claims Analysis

Total Claims: 10
Claim 1
Independent Claim 265 words
In a system for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said colored backing having a luminance and visibility, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured colored backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising: a) means (101) for generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) means (103) for adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) means (104) for subtracting the level matched control signal from the foreground scene video signals; d) means (105, 106, 108, 109, 110) for processing the foreground scene video signals to identify said transition area; e) means (113) for applying a predetermined amount of filtering to said foreground scene video signals corresponding to a predetermined portion of said transition area prior to processing of said foreground scene video signals by said processing means.
Claim 2
Dependent Claim 265 words
In a system for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said colored backing having a luminance and visibility, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured colored backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising: a) means (101) for generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) means (103) for adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) means (104) for subtracting the level matched control signal from the foreground scene video signals; d) means (105, 106, 108, 109, 110) for processing the foreground scene video signals to identify said transition area; e) means (113) for applying a predetermined amount of filtering to said foreground scene video signals corresponding to a predetermined portion of said transition area prior to processing of said foreground scene video signals by said processing means.
Claim 3
Dependent Claim 241 words
In a method for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured color backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising the steps of: a) generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) subtracting the level matched control signal from the foreground scene video signals; d) processing the foreground scene video signals to identify said transition area; e) applying a predetermined amount of filtering to said foreground scene video signals corresponding to a predetermined portion of said transition area prior to processing of said foreground scene video signals by said processing step.
Claim 4
Dependent Claim 241 words
In a method for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured color backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising the steps of: a) generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) subtracting the level matched control signal from the foreground scene video signals; d) processing the foreground scene video signals to identify said transition area; e) applying a predetermined amount of filtering to said foreground scene video signals corresponding to a predetermined portion of said transition area prior to processing of said foreground scene video signals by said processing step.
Claim 5
Dependent Claim 265 words
In a system for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said colored backing having a luminance and visibility, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured colored backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising: a) means (101) for generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) means (103) for adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) means (104) for subtracting the level matched control signal from the foreground scene video signals; d) means (105, 106, 108, 109, 110) for processing the foreground scene video signals to identify said unobscured colored backing area; e) means (113) for applying a predetermined amount of filtering to said foreground scene video signals corresponding to said unobscured colored backing area prior to processing of said foreground scene video signals by said processing means.
Claim 6
Dependent Claim 265 words
In a system for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said colored backing having a luminance and visibility, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured colored backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising: a) means (101) for generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) means (103) for adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) means (104) for subtracting the level matched control signal from the foreground scene video signals; d) means (105, 106, 108, 109, 110) for processing the foreground scene video signals to identify said unobscured colored backing area; e) means (113) for applying a predetermined amount of filtering to said foreground scene video signals corresponding to said unobscured colored backing area prior to processing of said foreground scene video signals by said processing means.
Claim 7
Dependent Claim 240 words
In a method for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured colored backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising the steps of: a) generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) subtracting the level matched control signal from the foreground scene video signals; d) processing the foreground scene video signals to identify said unobscured colored backing area; e) applying a predetermined amount of filtering to said foreground scene video signals corresponding to said unobscured colored backing area prior to processing of said foreground video signals by said processing step.
Claim 8
Dependent Claim 240 words
In a method for compositing foreground scene and background scene video signals having red, blue and green components, said foreground scene video signals corresponding to a foreground scene and said background scene video signals corresponding to a background scene, each of said components having a corresponding video signal level, to obtain a composite video image wherein the foreground scene includes a foreground subject disposed between a colored backing and a camera, said foreground scene video signals defining a portion of the colored backing area which is unobscured, an opaque foreground subject area and a transition area between said unobscured colored backing area and said opaque foreground subject area, wherein filtering is applied to portions of said foreground scene to reduce visual noise in the composite video image, the improvement comprising the steps of: a) generating a control signal having a level proportional to the luminance and visibility of the colored backing; b) adjusting the level of the control signal to match the video signal level of the red, blue and green color components of the video signal for the colored backing; c) subtracting the level matched control signal from the foreground scene video signals; d) processing the foreground scene video signals to identify said unobscured colored backing area; e) applying a predetermined amount of filtering to said foreground scene video signals corresponding to said unobscured colored backing area prior to processing of said foreground video signals by said processing step.
Claim 9
Dependent Claim 66 words
The system defined by claim 1 further comprising: a) means (105, 106, 108, 109, 110) for processing the foreground scene video signals to identify said unobscured colored backing area; and b) means (113) for applying a predetermined amount of filtering to said foreground scene video signals corresponding to said unobscured colored backing area prior to processing of said foreground scene video signals by said processing means.
Claim 10
Dependent Claim 59 words
The method defined by claim 2 further comprising the steps of: a) processing the foreground scene video signals to identify said unobscured colored backing area; and b) applying a predetermined amount of filtering to said foreground scene video signals corresponding to said unobscured colored backing area prior to processing of said foreground scene video signals by said processing step.

References Cited (Backward Citations)

US3595987A Cited
US3778542A Cited
US4007487A Cited
US4100569A Cited
US4344085A Cited
US4589013A Cited
US4625231A Cited
US5032901A Cited
US5343252A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1999-09-17 2000-03-18 2000-09-17 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2003-09-17 2004-03-18 2004-09-17 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2007-09-17 2008-03-18 2008-09-17 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag