US6009200A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Dynamic image processing apparatus and method
Assignee: Sony Corp
•
Filing: 1996-09-30
•
Granted: 1999-12-28
•
Expires: 2016-09-30
Abstract
Abstract A method and apparatus for dynamic image processing in which an image is compressed and subsequently expanded or synthesized into an image for display, wherein the image processing is carried out by considering the image information as distributed in a three-dimensional space composed of the two-dimensional image plane and a time axis defined by the time of each of successive video image frames of the input video signal. A multiple resolution filter is employed that has different resolutions provided by increased orders of differentiation and two-dimensional image data is analyzed as it is distributed along the time axis. Signal compression is provided by coding the positional information of the edge points of the image and this is accomplished by detecting characteristic points corresponding to extreme values of the three-dimensional image information and then compressing the image information on the two-dimensional plane to obtain compressed positional information and also compressing the three-dimensional information and then coding both of these compressed information signals for transmission or recording.
Inventors
- 👤 Masahiro Fujita
- 👤 Jin Sato
- 👤 Hiroshi Abe
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 18:42
CPC Classifications
G; G06; G06T; G06T9/00; G06T9/20; G06V; G06V10/00; G06V10/40; G06V10/44; G06V10/443; G06V10/46; G06V10/462; H; H04; H04N; H04N19/00; H04N19/20; H04N19/29; H04N19/50; H04N19/503; H04N19/51; H04N19/537; H04N19/54; H04N19/30; H04N19/39
Claims Analysis
Total Claims: 34
Claim 1
Independent Claim
216 words
A method of processing a dynamic image comprising steps of: providing dynamic image information including a plurality of consecutive frames of two-dimensional image information, wherein each frame of the dynamic image information contains a two-dimensional image that has correspondence with two-dimensional position coordinates and time, wherein the plurality of consecutive frames has a time dimension based on their consecutive nature such that the dynamic image information is three dimensional; analyzing each frame of the dynamic image information in a three-dimensional space having a two-dimensional image plane corresponding to the two-dimensional position coordinates and a time axis corresponding to the time dimension to obtain three-dimensional image information relating to changes in luminance between successive frames of the dynamic image information by performing a first-order differentiation and then a second-order differentiation of the dynamic image information; detecting characteristic points corresponding to extrema values of the three-dimensional image information by determining zero-crossing points at which results of the step of analyzing are zero, each of the characteristic points having three-dimensional information including time and positional information; compressing the positional information of the characteristic points to obtain compressed positional information; compressing three-dimensional image information relating to the results of the step of analyzing to obtain compressed three-dimensional information; and coding both the compressed three-dimensional information and the compressed positional information.
Claim 2
Independent Claim
216 words
A method of processing a dynamic image comprising steps of: providing dynamic image information including a plurality of consecutive frames of two-dimensional image information, wherein each frame of the dynamic image information contains a two-dimensional image that has correspondence with two-dimensional position coordinates and time, wherein the plurality of consecutive frames has a time dimension based on their consecutive nature such that the dynamic image information is three dimensional; analyzing each frame of the dynamic image information in a three-dimensional space having a two-dimensional image plane corresponding to the two-dimensional position coordinates and a time axis corresponding to the time dimension to obtain three-dimensional image information relating to changes in luminance between successive frames of the dynamic image information by performing a first-order differentiation and then a second-order differentiation of the dynamic image information; detecting characteristic points corresponding to extrema values of the three-dimensional image information by determining zero-crossing points at which results of the step of analyzing are zero, each of the characteristic points having three-dimensional information including time and positional information; compressing the positional information of the characteristic points to obtain compressed positional information; compressing three-dimensional image information relating to the results of the step of analyzing to obtain compressed three-dimensional information; and coding both the compressed three-dimensional information and the compressed positional information.
Claim 3
Dependent Claim
46 words
A method of processing a dynamic image as set forth in claim 1, wherein the step of analyzing each frame of the dynamic image information includes using a multiple-order filter function that performs a multiple resolution analysis corresponding to the first-order differentiation and the second-order differentiation.
Claim 4
Dependent Claim
49 words
A method of processing a dynamic image as set forth in claim 2, wherein the multiple resolution analysis includes a convolution computation of a function obtained from a first-order differentiation of a Gaussian smoothing function for the three-dimensional image information with a function formed of the three-dimensional image information.
Claim 5
Dependent Claim
65 words
A method of processing a dynamic image as set forth in claim 1, wherein the step of detecting characteristic points includes a convolution computation of a function formed of the three-dimensional image information with a function obtained from a second-order differentiation of a Gaussian smoothing function for the three-dimensional image information and detection of zero-crossing points corresponding to results of zero for the convolution computation.
Claim 6
Dependent Claim
36 words
A method of processing a dynamic image as set forth in claim 1, wherein the step of compressing the positional information of the characteristic points includes compressing any redundancy in data contained in the positional information.
Claim 7
Dependent Claim
82 words
A method of processing a dynamic image as set forth in claim 1, wherein, for a subset of the characteristic points which can be treated as a line which includes the subset of the characteristic points, the step of compressing the positional information of the characteristic points includes using positional information of a start point of the line and a relationship between predetermined lengths on the line to the characteristic points of the subset including lengths in each of the three dimensions.
Claim 8
Dependent Claim
80 words
A method of processing a dynamic image as set forth in claim 1, wherein, for a subset of the characteristic points which can be treated as a line containing the subset of the characteristic points, the step of compressing the positional information of the characteristic points includes using positional information of a start point of the line, a relationship between predetermined lengths on the line to the characteristic points of the subset, a curvature, and a torsion of the line.
Claim 9
Dependent Claim
87 words
A method of processing a dynamic image as set forth in claim 1, wherein, for a subset of the characteristic points which can be treated as a surface which includes the subset of the characteristic points, the step of compressing the positional information of the characteristic points is carried out by dividing the characteristic points present on the surface into partial sets of characteristic points having a predetermined relationship between distances from each of two planes containing the two-dimensional image to the characteristic points on the surface.
Claim 10
Dependent Claim
116 words
A method of processing a dynamic image as set forth in claim 1, wherein, for a subset of the characteristic points which can be treated as a surface which includes the subset of the characteristic points, the step of compressing the positional information of the characteristic points includes division of the characteristic points into partial sets of characteristic points present on lines of the surface cut by two planes containing the two-dimensional image, and the compression of the positional information is expressed as a function defined by a relationship between the positional information of a start point of each of the lines of the surface cut by the two planes and a curvature of those lines.
Claim 11
Dependent Claim
78 words
A method of processing a dynamic image as set forth in claim 1, wherein, for a portion of the three-dimensional information of the characteristic points where a subset of the characteristic points can be treated as a line, the step of compressing the three-dimensional image information of the characteristic points includes compressing a function defined by a relationship between a predetermined length from a start point of the line and the three-dimensional image information of the characteristic points.
Claim 12
Dependent Claim
80 words
A method of processing a dynamic image as set forth in claim 1, wherein, for a portion of the three-dimensional information of characteristic points where a subset of the characteristic points can be treated as a surface, the step of compressing the three-dimensional image information of the characteristic points includes compressing a function defined by a relationship between two planes that include combinations of the time dimension of the three dimensions and the other two dimensions of the three dimensions.
Claim 13
Independent Claim
234 words
A method of synthesis of a dynamic image comprising steps of: providing compressed signals produced by analyzing dynamic image information of each frame of a plurality of consecutive frames of two-dimensional image information to produce three-dimensional image information that corresponds with a three-dimensional space having a two-dimensional image plane and a time axis by performing a first-order differentiation and then a second-order differentiation of the dynamic image information, detecting characteristic points corresponding to extrema values of the three-dimensional image information by determining zero-crossing points at which results of the analysis of the dynamic image information are zero, each characteristic point having three-dimensional information including time and positional information, compressing the positional information of the characteristic points to obtain compressed positional information, and compressing and coding the three-dimensional image information by mathematically coding the three-dimensional image information of the characteristic points; restoring the positional information of the characteristic points by decompressing the compressed positional information of the characteristic points; restoring the three-dimensional image information of the characteristic points by decompressing and decoding the compressed and coded three-dimensional image information of the characteristic points; and restoring the three-dimensional image information corresponding to the plurality of consecutive frames of the original dynamic image information including the two-dimensional image plane and the time axis from the three-dimensional image information of the characteristic points by interpolating the three-dimensional image information based on the positional information of the characteristic points.
Claim 14
Independent Claim
234 words
A method of synthesis of a dynamic image comprising steps of: providing compressed signals produced by analyzing dynamic image information of each frame of a plurality of consecutive frames of two-dimensional image information to produce three-dimensional image information that corresponds with a three-dimensional space having a two-dimensional image plane and a time axis by performing a first-order differentiation and then a second-order differentiation of the dynamic image information, detecting characteristic points corresponding to extrema values of the three-dimensional image information by determining zero-crossing points at which results of the analysis of the dynamic image information are zero, each characteristic point having three-dimensional information including time and positional information, compressing the positional information of the characteristic points to obtain compressed positional information, and compressing and coding the three-dimensional image information by mathematically coding the three-dimensional image information of the characteristic points; restoring the positional information of the characteristic points by decompressing the compressed positional information of the characteristic points; restoring the three-dimensional image information of the characteristic points by decompressing and decoding the compressed and coded three-dimensional image information of the characteristic points; and restoring the three-dimensional image information corresponding to the plurality of consecutive frames of the original dynamic image information including the two-dimensional image plane and the time axis from the three-dimensional image information of the characteristic points by interpolating the three-dimensional image information based on the positional information of the characteristic points.
Claim 15
Dependent Claim
72 words
A method of synthesis of a dynamic image as set forth in claim 12, wherein, for a subset of the characteristic points which can be treated as included in a line, the three-dimensional image information restored from the subset of the characteristic points is obtained by restoring a function defined by a relationship between lengths from a predetermined position on the line to the characteristic points in each of the three dimensions.
Claim 16
Dependent Claim
67 words
A method of synthesis of a dynamic image as set forth in claim 12, wherein, for a subset of the characteristic points which can be treated as included in a surface, the three-dimensional image information restored from the subset of the characteristic points is obtained by restoring a function defined by two planes that include combinations of two of the three dimensions and the three-dimensional image information.
Claim 17
Dependent Claim
78 words
A method of synthesis of a dynamic image as set forth in claim 12, wherein for a subset of the characteristic points which can be treated as included in a line, the positional information of the characteristic points are restored by restoring a function defined by the positional information of a start point of the line and a relationship between lengths from a predetermined position on the line to the characteristic points in each of the three dimensions.
Claim 18
Dependent Claim
86 words
A method of synthesis of a dynamic image as set forth in claim 12, wherein for a subset of the characteristic points which can be treated as included in a surface, the positional information of the characteristic points are restored by restoring partial sets of characteristic points on the surface defined by a predetermined relationship between distances from two planes, wherein the two planes include combinations of the time dimension of the three dimensions and the other two dimensions, to the characteristic points on the surface.
Claim 19
Dependent Claim
81 words
A method of synthesis of a dynamic image as set forth in claim 12, wherein for a subset of the characteristic points which can be treated as included in a line, the positional information of the characteristic points are restored by restoring a function defined by the positional information of a start point of the line and a relationship between lengths from a predetermined position on the line to the characteristic points of the subset, curvature, and torsion of the line.
Claim 20
Dependent Claim
93 words
A method of synthesis of a dynamic image as set forth in claim 12, wherein for a subset of the characteristic points which can be treated as included in a surfaces the positional information of the characteristic points are restored by restoring a line including the characteristic points of curvature of a line of the surface cut by a plane including a combination of two of the three dimensions and by restoring the line of the surface cut by the plane from a set of points of the line cut by the plane.
Claim 21
Independent Claim
172 words
An apparatus for analysis of a dynamic image, comprising: means for analyzing dynamic image information by analyzing each frame of a plurality of consecutive frames of two-dimensional image information in a three-dimensional space having a two-dimensional image plane representing the two-dimensional image information of each of the frames and a time axis corresponding to a time dimension based on the consecutive nature of the plurality of frames to obtain three-dimensional image information relating to changes in luminance between successive frames of the dynamic image information, wherein the means for analyzing performs a first-order differentiation and then a second-order differentiation of the dynamic image information; means for detecting characteristic points corresponding to extrema values of the three-dimensional image information by determining zero-crossing points at which results of the step of analyzing are zero, each characteristic point having three-dimensional information including time and positional information; means for compressing the positional information of the characteristic points to obtain compressed positional information; and means for compressing and coding three-dimensional image information corresponding to the characteristic points.
Claim 22
Independent Claim
172 words
An apparatus for analysis of a dynamic image, comprising: means for analyzing dynamic image information by analyzing each frame of a plurality of consecutive frames of two-dimensional image information in a three-dimensional space having a two-dimensional image plane representing the two-dimensional image information of each of the frames and a time axis corresponding to a time dimension based on the consecutive nature of the plurality of frames to obtain three-dimensional image information relating to changes in luminance between successive frames of the dynamic image information, wherein the means for analyzing performs a first-order differentiation and then a second-order differentiation of the dynamic image information; means for detecting characteristic points corresponding to extrema values of the three-dimensional image information by determining zero-crossing points at which results of the step of analyzing are zero, each characteristic point having three-dimensional information including time and positional information; means for compressing the positional information of the characteristic points to obtain compressed positional information; and means for compressing and coding three-dimensional image information corresponding to the characteristic points.
Claim 23
Dependent Claim
35 words
An apparatus for analysis of a dynamic image as set forth in claim 19, wherein the means for analyzing includes local analysis means for analyzing the dynamic image information using a multiple resolution analysis method.
Claim 24
Dependent Claim
58 words
An apparatus for analysis of a dynamic image as set forth in claim 19, wherein the means for analyzing includes first-order differentiation means and convolution computation means for performing convolution computation of a function obtained from a first-order differentiation of a Gaussian smoothing function for the three-dimensional image information with a function formed of the three-dimensional image information.
Claim 25
Dependent Claim
58 words
An apparatus for analysis of a dynamic image as set forth in claim 19, wherein the means for detecting includes second-order differentiation means and convolution computation means for performing a convolution computation of a function obtained from second-order differentiation of a Gaussian smoothing function for the three-dimensional image information with a function formed of the three-dimensional image information.
Claim 26
Dependent Claim
83 words
An apparatus for analysis of a dynamic image as set forth in claim 22, wherein, for a subset of the characteristic points which can be treated as a line which includes the subset of the characteristic points, the means for compressing the positional information defines the line by positional information of a start point of the line and a relationship between predetermined lengths on the line to the characteristic points of the subset including length quantity values in each of the three dimensions.
Claim 27
Independent Claim
222 words
An apparatus for synthesis of a dynamic image from compressed signals that were produced by analyzing a plurality of consecutive frames of two-dimensional image information as three-dimensional image information that corresponds with a three-dimensional space having a two-dimensional image plane and a time axis, by detecting characteristic points corresponding to extrema values of the three-dimensional image information, each of the characteristic points having three-dimensional information including time and positional information, by compressing the positional information of the characteristic points to obtain compressed positional information, and by compressing and coding the three-dimensional image information by mathematically coding the three-dimensional image information of the characteristic points, the apparatus for synthesis comprising: means for restoring the positional information of the characteristic points by decompressing the compressed positional information of the characteristic points, the characteristic points corresponding to points at which first order differentiation and second order differentiation of the three-dimensional image information are zero; means for restoring the three-dimensional image information of the characteristic points by decompressing and decoding the compressed and coded three-dimensional image information of the characteristic points to obtain restored three-dimensional image information; and means for restoring the original dynamic image information comprising a two-dimensional image plane and a time axis from the restored three-dimensional image information by interpolating the three-dimensional image information based on the positional information of the characteristic points.
Claim 28
Independent Claim
222 words
An apparatus for synthesis of a dynamic image from compressed signals that were produced by analyzing a plurality of consecutive frames of two-dimensional image information as three-dimensional image information that corresponds with a three-dimensional space having a two-dimensional image plane and a time axis, by detecting characteristic points corresponding to extrema values of the three-dimensional image information, each of the characteristic points having three-dimensional information including time and positional information, by compressing the positional information of the characteristic points to obtain compressed positional information, and by compressing and coding the three-dimensional image information by mathematically coding the three-dimensional image information of the characteristic points, the apparatus for synthesis comprising: means for restoring the positional information of the characteristic points by decompressing the compressed positional information of the characteristic points, the characteristic points corresponding to points at which first order differentiation and second order differentiation of the three-dimensional image information are zero; means for restoring the three-dimensional image information of the characteristic points by decompressing and decoding the compressed and coded three-dimensional image information of the characteristic points to obtain restored three-dimensional image information; and means for restoring the original dynamic image information comprising a two-dimensional image plane and a time axis from the restored three-dimensional image information by interpolating the three-dimensional image information based on the positional information of the characteristic points.
Claim 29
Dependent Claim
71 words
An apparatus for synthesis of a dynamic image as set forth in claim 24, wherein, for a subset of the characteristic points which can be treated as included in a line, the means for restoring the three-dimensional image information restores the three-dimensional image information by restoring a function defined by a relationship between lengths from a predetermined position on the line to the characteristic points in each of the three dimensions.
Claim 30
Dependent Claim
69 words
An apparatus for synthesis of a dynamic image as set forth in claim 24, wherein, for a subset of the characteristic points which can be treated as included in a surface, the means for restoring the three-dimensional image information restores the three-dimensional image information by restoring a function defined by two planes including combinations of two of the three dimensions, with one dimension excluded, and the three-dimensional image information.
Claim 31
Dependent Claim
75 words
An apparatus for synthesis of a dynamic image as set forth in claim 24, wherein, for a subset of the characteristic points which can be treated as included in a line, the means for restoring the positional information restores a function defined by the positional information of a start point of the line and a relationship between lengths from a predetermined position on the line to the characteristic points in each of the three dimensions.
Claim 32
Dependent Claim
82 words
An apparatus for synthesis of a dynamic image as set forth in claim 24, wherein, for a subset of the characteristic points which can be treated as included in a surface, the means for restoring the positional information restores partial sets of characteristic points on the surface defined by characteristic points having a predetermined relationship with distances from two planes, including combinations of the time dimension of the three dimensions and the other two dimensions, to the characteristic points on the surface.
Claim 33
Dependent Claim
75 words
An apparatus for synthesis of a dynamic image as set forth in claim 24, wherein, for a subset of the characteristic points which can be treated as included in a line, the means for restoring the positional information restores a function defined by the positional information of a start point of the line and a relationship between lengths from a predetermined position on the line to the characteristic points, curvature, and torsion of the line.
Claim 34
Dependent Claim
84 words
An apparatus for synthesis of a dynamic image as set forth in claim 24, wherein, for a subset of the characteristic points which can be treated as included in a surface, the means for restoring the positional information restores a line formed by characteristic points of curvature of a line of the surface cut by a plane formed by a combination of two of the three dimensions and restores the cut line from a set of points of the line cut by the plane.
References Cited (Backward Citations)
US4590606A
Cited
US4903018A
Cited
US4947447A
Cited
US4891643A
Cited
US5359438A
Cited
US5416606A
Cited
US5361147A
Cited
US5339390A
Cited
US5282255A
Cited
US5166987A
Cited
US5237625A
Cited
US5485533A
Cited
US5121191A
Cited
US5311305A
Cited
US5253056A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-12-27 | 2003-06-28 | 2003-12-28 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-12-27 | 2007-06-28 | 2007-12-28 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-12-27 | 2011-06-28 | 2011-12-28 | $7700.00 | Window Closed / Lapsed |