Patent US5329379A successfully refreshed from Google Patents.
← Back to Patent Explorer
US5329379A Expired / Lapsed US ⏱️ 0.0 years remaining

System and method of measuring fidelity of decompressed video signals and images

Assignee: International Business Machines Corp
•
Filing: 1992-10-22
•
Granted: 1994-07-12
•
Expires: 2012-10-22
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image is disclosed. The method comprises, responsive to user selection, for establishing a global assessment mode or a local assessment mode. In the global assessment mode changes in luminance of the reproduced image from the original image and changes in color in first and second color difference values of the reproduced image from the original image are used score fidelity. Changes in luminance are measured using a dynamic range, nonlinear transform equation. In the local assessment mode, and responsive to user selection, the reproduced image and the original image are segmented and corresponding pairs of segments from the reproduced image and the original image are identified. Scoring of fidelity of the reproduced image to the original image is done by comparing corresponding pairs of segments in color, luminance, shape, displacement and texture.

Inventors

  • 👤 Arturo A. Rodriguez
  • 👤 Mark A. Pietras
  • 👤 Andres J. Saenz

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 15:40
CPC Classifications
H; H04; H04N; H04N17/00; H04N17/02; H04N19/00; H04N19/10; H04N19/134; H04N19/154; H04N19/60

Claims Analysis

Total Claims: 22
Claim 1
Independent Claim 163 words
A method of quantitatively measuring fidelity of a reproduced image to an original image, the method comprising the steps of: capturing and digitizing the original image; compressing the original image into a compressed data representation; decompressing the compressed data representation to produce the reproduced image; responsive to user selection, establishing a global assessment mode or a local assessment mode; in the global assessment mode, determining luminance fidelity of the reproduced image to the original image and determining color fidelity over first and second color difference values of the reproduced image to the original image; in the local assessment mode and responsive to user selection, segmenting the reproduced image and the original image and establishing corresponding pairs of segments having one segment each from the reproduced image and the original image; and in the local assessment mode, scoring fidelity of segments of the reproduced image by comparing corresponding pairs of segments from the reproduced image and original image in color, luminance, shape and displacement.
Claim 2
Independent Claim 163 words
A method of quantitatively measuring fidelity of a reproduced image to an original image, the method comprising the steps of: capturing and digitizing the original image; compressing the original image into a compressed data representation; decompressing the compressed data representation to produce the reproduced image; responsive to user selection, establishing a global assessment mode or a local assessment mode; in the global assessment mode, determining luminance fidelity of the reproduced image to the original image and determining color fidelity over first and second color difference values of the reproduced image to the original image; in the local assessment mode and responsive to user selection, segmenting the reproduced image and the original image and establishing corresponding pairs of segments having one segment each from the reproduced image and the original image; and in the local assessment mode, scoring fidelity of segments of the reproduced image by comparing corresponding pairs of segments from the reproduced image and original image in color, luminance, shape and displacement.
Claim 3
Dependent Claim 104 words
A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 1, wherein the step in the local assessment mode of segmenting the reproduced image and the original image and establishing corresponding pairs of segments having one segment from the reproduced image and the original image further includes: prompting the user to select segments by drawing an enclosure around areas in the images; and executing an automatic edge detection process in a neighborhood around user drawn enclosures and setting the border of the selected segments equal to a detected edge.
Claim 4
Dependent Claim 69 words
A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 1, wherein the step in the local assessment mode of scoring fidelity of the reproduced image to the original image by corresponding pairs of segments further includes comparing texture of the segment from the reproduced image to a corresponding segment in the original image.
Claim 5
Dependent Claim 48 words
A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set in claim 3, and further comprising the steps of: responsive to user selection, characterizing the segments of a corresponding pair of segments as textured or nontextured.
Claim 6
Dependent Claim 166 words
A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 4, wherein the step in the local assessment mode of scoring fidelity of the reproduced image to the original image by comparing corresponding pairs of segments in color and luminance further includes: for a textured corresponding pair of segments, determining an average luminance difference between the segments and determining an average change in color for first and second color difference components; for a nontextured corresponding pair of segments, determining luminance change between a pair of segments by computing the root mean square value over the luminance changes between pixels in the respective segments; and for a nontextured corresponding pair of segments, determining color change between a pair of segments by filtering color difference values for subgroups of pixels within the segments and computing the root mean square value of the changes in the color difference values between filtered subgroups of pixels.
Claim 7
Dependent Claim 138 words
A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image, as set forth in claim 1, wherein in the global assessment mode the step of determining luminance fidelity of the reproduced image to the original image and determining color fidelity over first and second color difference values of the reproduced image to the original image includes: determining luminance change between the reproduced image and the original image by computing the root mean square value over the differences between pixels in the respective images; and determining color change between the reproduced image and the original image by filtering color difference values for subgroups of pixels in the images and computing the root mean square value of the changes in the color difference values by comparing filtered subgroups of pixels.
Claim 8
Dependent Claim 104 words
A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 5, wherein luminance is determined over a luminance range extending from minimum to maximum luminance intensity in the corresponding pair of segments and wherein the transformation is logarithmic of the form: ##EQU2## where [Y min , Y max] is the dynamic luminance scale of the data and where P gives L(Y) a resolution equal to a fraction of the original dynamic range and thus controls how luminance differences between the original image frame and the reconstructed frame are penalized.
Claim 9
Dependent Claim 103 words
method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 6, wherein luminance is determined over a luminance range extending from minimum to maximum luminance intensity in the reproduced and original images and wherein the transformation is logarithmic of the form: ##EQU3## where [Y min , Y max] is the dynamic luminance scale of the data and where P gives L(Y) a resolution equal to a fraction of the original dynamic range and thus control how luminance differences between the original image frame and the reconstructed frame are penalized.
Claim 10
Dependent Claim 36 words
A method of quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 7 and further including: generating distortion curves based on fidelity scores.
Claim 11
Dependent Claim 161 words
Apparatus for quantitatively measuring fidelity of a reproduced image with an original image, comprising: means for capturing and digitizing the original image; means for compressing the original image into a compressed data representation; means for decompressing the compressed data representation to produce the reproduced image; means for determining luminance fidelity of the reproduced image to the original image and for determining color fidelity from changes in first and second color difference values in the reproduced image from the original image; means responsive to user selection for segmenting the reproduced image and the original image and establishing corresponding pairs of segments having one segment each from the reproduced image and the original image; and means for scoring fidelity of the reproduced image to the original image by comparing corresponding pairs of segments in color, luminance, shape and displacement of a segment from the reproduced image compared to a corresponding segment in the original image to score the segments in the reproduced image.
Claim 12
Dependent Claim 161 words
Apparatus for quantitatively measuring fidelity of a reproduced image with an original image, comprising: means for capturing and digitizing the original image; means for compressing the original image into a compressed data representation; means for decompressing the compressed data representation to produce the reproduced image; means for determining luminance fidelity of the reproduced image to the original image and for determining color fidelity from changes in first and second color difference values in the reproduced image from the original image; means responsive to user selection for segmenting the reproduced image and the original image and establishing corresponding pairs of segments having one segment each from the reproduced image and the original image; and means for scoring fidelity of the reproduced image to the original image by comparing corresponding pairs of segments in color, luminance, shape and displacement of a segment from the reproduced image compared to a corresponding segment in the original image to score the segments in the reproduced image.
Claim 13
Dependent Claim 100 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 10, wherein the means for segmenting the reproduced image and the original image and for establishing corresponding pairs of segments having one segment from the reproduced image and from the original image further include: means for prompting the user to select segments by drawing an enclosure around the segments; and means for automatically detecting and edge in a neighborhood around user drawn enclosure and setting the border of a selected segment equal to a detected edge.
Claim 14
Dependent Claim 64 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 10, wherein means for scoring fidelity of the reproduced image to the original image by corresponding pairs of segments further include means for comparing texture of the segment from the reproduced image to a corresponding segment in the original image.
Claim 15
Dependent Claim 46 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set in claim 12, and further comprising: means responsive to user selection for identifying the segments of a corresponding pair of segments as textured or nontextured.
Claim 16
Dependent Claim 169 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 13, wherein the means for scoring fidelity of the reproduced image to the original image by comparing corresponding pairs of segments in color and by luminance further includes: means for determining for a textured corresponding pair of segments an average luminance difference between the segments and for determining an average change in color for first and second color difference components; means for determining for a nontextured corresponding pair of segments luminance change between a pair of segments by computing the root mean square value over the luminance changes between pixels in the respective segments; and means for determining for a nontextured corresponding pair of segments color change between a pair of segments by filtering color difference values for subgroups of pixels within the segments and for computing the root means square value of the changes in the color difference values between filtered subgroups of pixels.
Claim 17
Dependent Claim 140 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image, as set forth in claim 10, wherein the means for determining luminance fidelity of the reproduced image to the original image and the means for determining color fidelity over first and second color difference values of the reproduced image to the original image include: means for finding luminance change between the reproduced image and the original image by computing the root means square value over the differences between pixels in the respective images; and means for finding color change between the reproduced image and the original image by filtering color difference values for subgroups of pixels in the image and for computing the root means square value of the changes in the color difference values by comparing filtered subgroups of pixels.
Claim 18
Dependent Claim 103 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 14, wherein luminance is determined over a luminance range extending from minimum to maximum luminance intensity in the corresponding pair of segments and wherein the transformation is logarithmic of the form: ##EQU4## where [Y min , Y max] is the dynamic luminance scale of the data and where P gives L(Y) a resolution equal to a fraction of the original dynamic range and thus controls how luminance differences between the original image frame and the reconstructed frame are penalized.
Claim 19
Dependent Claim 103 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 15, wherein luminance is determined over a luminance range extending from minimum to maximum luminance intensity in the reproduced and original images and wherein the transformation is logarithmic of the form: ##EQU5## where [Y min , Y max] is the dynamic luminance scale of the data and where P gives L(Y) a resolution equal to a fraction of the original dynamic range and thus controls how luminance differences between the original image frame and the reconstructed frame are penalized.
Claim 20
Dependent Claim 37 words
Apparatus for quantitatively measuring fidelity of a reproduced image reconstructed from a compressed data representation of an original image as set forth in claim 16 and further including: means for generating distortion curves based on fidelity scores.
Claim 21
Dependent Claim 42 words
A method as set forth in claim 1, and further comprising the steps of: in the local assessment mode, weighing fidelity scoring for the segments by location in the reproduced image; and summing the weighted scores to generate an overall fidelity score.
Claim 22
Dependent Claim 31 words
Apparatus as set forth in claim 10, and further comprising: means for weighing fidelity scores for segments by location in the reproduced image; and means for summing the weighted fidelity scores.

References Cited (Backward Citations)

US4831659A Cited
US4947447A Cited
US4794455A Cited
US5001560A Cited
US4893188A Cited
US4785349A Cited
US4951139A Cited
US5200831A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1997-07-11 1998-01-10 1998-07-12 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2001-07-11 2002-01-10 2002-07-12 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2005-07-11 2006-01-10 2006-07-12 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag