← Back to Patent Explorer
US6041143A Expired / Lapsed US ⏱️ 0.0 years remaining

Multiresolution compressed image management system and method

Assignee: Qualcomm Inc
•
Filing: 1998-04-14
•
Granted: 2000-03-21
•
Expires: 2018-04-14
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract In a multiresolution image processing system images are stored in files that contain thumbnail data as well as a full image data structure. The image data is preferably wavelet or wavelet-like transform coefficients, generated by applying a wavelet or wavelet-like transform to an image multiple times. Data representing mid-level resolution images are generated on the fly by extracting from the full image data structure only the data needed for the user or application selected resolution level. If the user has selected a subset of the image for viewing at a higher resolution level, a corresponding mid-level resolution image is constructed by extracting from the full image data structure the data needed for the user specified image portion at the user or application selected resolution level. The full image data structure is preferably encoded and stored in a manner allowing the image data for mid-level resolution images to be efficiently extracted without having to compute or recompute any image coefficients. By storing only thumbnail data and the full image data in an image file, and producing image data structures for other resolution levels on the fly, the storage requirements for image files are reduced. Since the image data structures for other resolution levels can be generated with minimal computational resources in a small fraction of a second, in most implementations the user will not be adversely affected by the non-inclusion of the other resolution levels in the image file.

Inventors

  • 👤 Charles K. Chui
  • 👤 Lefan Zhang

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-10 01:28
CPC Classifications
G; G06; G06T; G06T3/00; G06T3/40; G06T3/4084; H; H04; H04N; H04N19/00; H04N19/10; H04N19/134; H04N19/162; H04N19/169; H04N19/17; H04N19/60; H04N19/63; H04N21/00; H04N21/40; H04N21/43; H04N21/44; H04N21/4402; H04N21/440263; H04N21/47; H04N21/472; H04N21/4728; H04N19/102

Claims Analysis

Total Claims: 27
Claim 1
Independent Claim 220 words
Image processing apparatus, for use in conjunction with an image display device, the image processing apparatus comprising: a memory device for storing data, including a first image data structure, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image; a data processor coupled to the memory device; a multiresolution image management procedure, executable by the data processor, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected.
Claim 2
Dependent Claim 220 words
Image processing apparatus, for use in conjunction with an image display device, the image processing apparatus comprising: a memory device for storing data, including a first image data structure, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image; a data processor coupled to the memory device; a multiresolution image management procedure, executable by the data processor, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected.
Claim 3
Dependent Claim 287 words
Image processing apparatus, for use in conjunction with an image display device, the image processing apparatus comprising: a memory device for storing data, including a first image data structure, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image; a data processor coupled to the memory device; a multiresolution image management procedure, executable by the data processor, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected; wherein the first array includes a sequence of subarrays, each representing a rectangular set of wavelet coefficients in a respective region of a wavelet or wavelet-like transform coefficient array; the image data extraction instructions include instructions for copying a subset of the subarrays in the first array into the second array, without modification thereof, wherein the subarray subset is determined in accordance with the selected resolution level.
Claim 4
Dependent Claim 287 words
Image processing apparatus, for use in conjunction with an image display device, the image processing apparatus comprising: a memory device for storing data, including a first image data structure, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image; a data processor coupled to the memory device; a multiresolution image management procedure, executable by the data processor, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected; wherein the first array includes a sequence of subarrays, each representing a rectangular set of wavelet coefficients in a respective region of a wavelet or wavelet-like transform coefficient array; the image data extraction instructions include instructions for copying a subset of the subarrays in the first array into the second array, without modification thereof, wherein the subarray subset is determined in accordance with the selected resolution level.
Claim 5
Dependent Claim 124 words
The image processing apparatus of claim 2, wherein the image data extraction instructions include instructions for partially copying a second subset of subarrays in the first array into the second array, the wavelet coefficients represented by each subarray in the second subset including some wavelet coefficients associated with the selected resolution level and some wavelet coefficients not associated with the selected resolution level; and each subarray in the second subset is partially copied by decoding the subarray to generate a rectangular set of wavelet coefficients, replacing with zero values the wavelet coefficients in the rectangular set that are not associated with the selected resolution level, re-encoding the rectangular set of wavelet coefficients and storing the re-encoded set of wavelet coefficients in the second array.
Claim 6
Dependent Claim 33 words
The image processing apparatus of claim 2, wherein the subarray subset is determined in accordance with the selected resolution level and a user specified subregion of the image corresponding to the first array.
Claim 7
Dependent Claim 52 words
The image processing apparatus of claim 2, wherein the first image data structure includes a thumbnail data structure containing an array of wavelet transform coefficients corresponding to a low resolution image; the multiresolution image management procedure including instructions for displaying the decoding the thumbnail data structure and displaying the low resolution image.
Claim 8
Dependent Claim 87 words
The image processing apparatus of claim 2, the multiresolution image management procedure including: image cropping instructions for enabling a user to select a cropped portion of the low resolution image; and cropped image data extraction instructions for generating a third image data structure from the first image data structure by extracting from the first array a subset of the wavelet transform coefficients corresponding to the cropped portion of the low resolution image and storing the extracted subset in a third array in the third image data structure.
Claim 9
Dependent Claim 110 words
The image processing apparatus of claim 1, the multiresolution image management procedure including: image cropping instructions for enabling a user to select a cropped portion of an image displayed on the image display device, wherein the displayed image has been generated from data in the first data structure or in the second data structure; and cropped image data extraction instructions for generating a third image data structure from the first image data structure by extracting from the first array a subset of the wavelet transform coefficients corresponding to the cropped portion of the displayed image and storing the extracted subset in a third array in the third image data structure.
Claim 10
Dependent Claim 70 words
The image processing apparatus of claim 1, wherein the first array includes a set of tree structures, each representing a tree of wavelet coefficients at respective positions in a wavelet or wavelet-like transform coefficient array; and the image data extraction instructions include instructions for copying a portion of each of the tree structures into the second array, wherein the copied portion is determined in accordance with the selected resolution level.
Claim 11
Independent Claim 193 words
A method of processing image data, for use in conjunction with an image display device, the steps of the method comprising: storing a first image data structure, the first image data structure including a first array of wavelet or wavelet-like transform coefficients corresponding to a full resolution image; generating a second image data structure from the first image data structure by extracting a subset of the wavelet or wavelet-like transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; and applying an inverse wavelet or wavelet-like transform to the wavelet or wavelet-like transform coefficients in the second image data structure so as to generate image data for displaying a corresponding image on the image display device; wherein the first array includes a sequence of subarrays, each representing a rectangular set of coefficients in a respective region of a wavelet or wavelet-like transform coefficient array; the second image data structure generating step includes copying a subset of the subarrays in the first array into the second array, without modification thereof, wherein the subarray subset is determined in accordance with a selected resolution level.
Claim 12
Independent Claim 193 words
A method of processing image data, for use in conjunction with an image display device, the steps of the method comprising: storing a first image data structure, the first image data structure including a first array of wavelet or wavelet-like transform coefficients corresponding to a full resolution image; generating a second image data structure from the first image data structure by extracting a subset of the wavelet or wavelet-like transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; and applying an inverse wavelet or wavelet-like transform to the wavelet or wavelet-like transform coefficients in the second image data structure so as to generate image data for displaying a corresponding image on the image display device; wherein the first array includes a sequence of subarrays, each representing a rectangular set of coefficients in a respective region of a wavelet or wavelet-like transform coefficient array; the second image data structure generating step includes copying a subset of the subarrays in the first array into the second array, without modification thereof, wherein the subarray subset is determined in accordance with a selected resolution level.
Claim 13
Dependent Claim 121 words
The method of claim 9, wherein the second image data structure generating step includes partially copying a second subset of subarrays in the first array into the second array, the wavelet or wavelet-like coefficients represented by each subarray in the second subset including some coefficients associated with the selected resolution level and some coefficients not associated with the selected resolution level; and each subarray in the second subset is partially copied by decoding the subarray to generate a rectangular set of wavelet or wavelet-like coefficients, replacing with zero values the coefficients in the rectangular set that are not associated with the selected resolution level, re-encoding the rectangular set of coefficients and storing the re-encoded set of coefficients in the second array.
Claim 14
Dependent Claim 31 words
The method of claim 9, wherein the subarray subset is determined in accordance with the selected resolution level and a user specified subregion of the image corresponding to the first array.
Claim 15
Dependent Claim 45 words
The method of claim 9, wherein the first image data structure includes a thumbnail data structure containing an array of wavelet or wavelet-like transform coefficients corresponding to a low resolution image; the method includes decoding the thumbnail data structure and displaying the low resolution image.
Claim 16
Dependent Claim 72 words
The method of claim 12, including enabling a user to select a cropped portion of the low resolution image; and generating a third image data structure from the first image data structure by extracting from the first array a subset of the wavelet or wavelet-like transform coefficients corresponding to the cropped portion of the low resolution image and storing the extracted subset in a third array in the third image data structure.
Claim 17
Dependent Claim 95 words
The method of claim 9, including: enabling a user to select a cropped portion of an image displayed on the image display device, wherein the displayed image has been generated from data in the first data structure or in the second data structure; and generating a third image data structure from the first image data structure by extracting from the first array a subset of the wavelet or wavelet-like transform coefficients corresponding to the cropped portion of the displayed image and storing the extracted subset in a third array in the third image data structure.
Claim 18
Dependent Claim 307 words
A computer program product for use in conjunction with a computer controlled system having memory and an image display device, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising: an image storage module for storing data, including a first image data structure, in the memory of the computer controlled system, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image, the first array including a sequence of subarrays, each representing a rectangular set of wavelet coefficients in a respective region of a wavelet or wavelet-like transform coefficient array; a multiresolution image management module, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure, the image data extraction instructions including instructions for copying a subset of the subarrays in the first array into the second array, without modification thereof, wherein the subarray subset is determined in accordance with the selected resolution level; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected.
Claim 19
Dependent Claim 307 words
A computer program product for use in conjunction with a computer controlled system having memory and an image display device, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising: an image storage module for storing data, including a first image data structure, in the memory of the computer controlled system, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image, the first array including a sequence of subarrays, each representing a rectangular set of wavelet coefficients in a respective region of a wavelet or wavelet-like transform coefficient array; a multiresolution image management module, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure, the image data extraction instructions including instructions for copying a subset of the subarrays in the first array into the second array, without modification thereof, wherein the subarray subset is determined in accordance with the selected resolution level; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected.
Claim 20
Dependent Claim 124 words
The computer program product of claim 15, wherein the image data extraction instructions include instructions for partially copying a second subset of subarrays in the first array into the second array, the wavelet coefficients represented by each subarray in the second subset including some wavelet coefficients associated with the selected resolution level and some wavelet coefficients not associated with the selected resolution level; and each subarray in the second subset is partially copied by decoding the subarray to generate a rectangular set of wavelet coefficients, replacing with zero values the wavelet coefficients in the rectangular set that are not associated with the selected resolution level, re-encoding the rectangular set of wavelet coefficients and storing the re-encoded set of wavelet coefficients in the second array.
Claim 21
Dependent Claim 33 words
The computer program product of claim 15, wherein the subarray subset is determined in accordance with the selected resolution level and a user specified subregion of the image corresponding to the first array.
Claim 22
Dependent Claim 52 words
The computer program product of claim 15, wherein the first image data structure includes a thumbnail data structure containing an array of wavelet transform coefficients corresponding to a low resolution image; the multiresolution image management module including instructions for displaying the decoding the thumbnail data structure and displaying the low resolution image.
Claim 23
Dependent Claim 87 words
The computer program product of claim 15, the multiresolution image management module including: image cropping instructions for enabling a user to select a cropped portion of the low resolution image; and cropped image data extraction instructions for generating a third image data structure from the first image data structure by extracting from the first array a subset of the wavelet transform coefficients corresponding to the cropped portion of the low resolution image and storing the extracted subset in a third array in the third image data structure.
Claim 24
Dependent Claim 241 words
A computer program product for use in conjunction with a computer controlled system having memory and an image display device, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising: an image storage module for storing data, including a first image data structure, in the memory of the computer controlled system, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image; a multiresolution image management module, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected.
Claim 25
Dependent Claim 241 words
A computer program product for use in conjunction with a computer controlled system having memory and an image display device, the computer program product comprising a computer readable storage medium and a computer program mechanism embedded therein, the computer program mechanism comprising: an image storage module for storing data, including a first image data structure, in the memory of the computer controlled system, the first image data structure including a first array of wavelet transform coefficients corresponding to a full resolution image; a multiresolution image management module, including instructions for generating an image at any of a plurality of selectable resolution levels, the instructions including: image reconstruction instructions for applying an inverse wavelet or wavelet-like transform to a specified set of image data so as to generate image data for displaying a corresponding image on the image display device; and image data extraction instructions, for use when an image resolution level lower than full resolution is selected, wherein the image data extraction instructions generate a second image data structure from the first image data structure by extracting a subset of the wavelet transform coefficients from the first array and storing the extracted subset in a second array in the second image data structure; wherein the image reconstruction instructions operate on the second image data structure when an image resolution level lower than full resolution is selected and operate on the first image data structure when a full image resolution is selected.
Claim 26
Dependent Claim 112 words
The computer program product of claim of 20, wherein the multiresolution image management module includes: image cropping instructions for enabling a user to select a cropped portion of an image displayed on the image display device, wherein the displayed image has been generated from data in the first data structure or in the second data structure; and cropped image data extraction instructions for generating a third image data structure from the first image data structure by extracting from the first array a subset of the wavelet transform coefficients corresponding to the cropped portion of the displayed image and storing the extracted subset in a third array in the third image data structure.
Claim 27
Dependent Claim 71 words
The computer program product of claim of 20, wherein the first array includes a set of tree structures, each representing a tree of wavelet coefficients at respective positions in a wavelet or wavelet-like transform coefficient array; and the image data extraction instructions include instructions for copying a portion of each of the tree structures into the second array, wherein the copied portion is determined in accordance with the selected resolution level.

References Cited (Backward Citations)

US5867602A Cited
US5881176A Cited
US5778098A Cited
US5748789A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-03-21 2003-09-20 2004-03-21 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-03-21 2007-09-20 2008-03-21 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-03-21 2011-09-20 2012-03-21 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag