← Back to Patent Explorer
US6453069B1 Expired / Lapsed US ⏱️ 0.0 years remaining

Method of extracting image from input image using reference image

Assignee: Canon Inc
•
Filing: 1997-11-17
•
Granted: 2002-09-17
•
Expires: 2017-11-17
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract This invention relates to an image processing method for precisely and automatically recognizing a specific image extraction region to be divided from an input image, and extracting the specific image extraction region. Thresholding is done for intensity differences of edge data obtained from the input data to extract difference edge data. A main extraction region is estimated from the outermost contour line extracted based on the extraction result of the difference edge data. Thresholding or the like is done in units of pixels of the input image to extract an initial region. Extraction region determination processing is done for extracting an accurate target region by combining the main extraction region and initial region.

Inventors

  • 👤 Masakazu Matsugu
  • 👤 Tatsushi Katayama
  • 👤 Koji Hatanaka

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 13:34
CPC Classifications
G; G06; G06T; G06T7/00; G06T7/10; G06T7/11; G06T7/12; G06T7/174; G06T7/181; G06T7/187; G06T7/194; G06V; G06V10/00; G06V10/40; G06V10/46; G06V10/70; G06V10/74; G06V10/75; G06V10/751; G06V10/7515; G06T2207/00; G06T2207/10; G06T2207/10016; G06T2207/20; G06T2207/20112; G06T2207/20156; G06T2207/20212; G06T2207/20224

Claims Analysis

Total Claims: 26
Claim 1
Independent Claim 133 words
An image segmentation method for segmenting an object, which is not present in a reference image, from an input image including the object using the reference image, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; and the image region specifying step of specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image.
Claim 2
Dependent Claim 133 words
An image segmentation method for segmenting an object, which is not present in a reference image, from an input image including the object using the reference image, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; and the image region specifying step of specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image.
Claim 3
Dependent Claim 143 words
An image segmentation method for segmenting a predetermined image region from an input image input from an external device such as an image input device using a reference image, comprising: the edge distribution extraction step of extracting edge distributions in the input image and reference image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line distributions in terms of predetermined directions in the input image and reference image on the basis of the extracted edge distributions; the singular edge extraction step of extracting a singular edge on the basis of a difference between the detected line distributions in each of said directions between the reference image and input image; and the image extraction step of extracting the predetermined image region in the input image on the basis of the extracted singular edge.
Claim 4
Dependent Claim 143 words
An image segmentation method for segmenting a predetermined image region from an input image input from an external device such as an image input device using a reference image, comprising: the edge distribution extraction step of extracting edge distributions in the input image and reference image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line distributions in terms of predetermined directions in the input image and reference image on the basis of the extracted edge distributions; the singular edge extraction step of extracting a singular edge on the basis of a difference between the detected line distributions in each of said directions between the reference image and input image; and the image extraction step of extracting the predetermined image region in the input image on the basis of the extracted singular edge.
Claim 5
Dependent Claim 211 words
An image identification method for identifying an object, which is not present in a reference image, in an input image including the object using a standard model image representing a predetermined object and the reference image, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; the auto-framing step of specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image; and the model size estimation step of estimating a size with respect to the standard model image on the basis of the specified existence range of the object, wherein a size of the standard model image is changed to the estimated size, and thereafter, the object is identified on the basis of similarity between the object image present in the existence range in the input image and the size-changed standard model image.
Claim 6
Dependent Claim 211 words
An image identification method for identifying an object, which is not present in a reference image, in an input image including the object using a standard model image representing a predetermined object and the reference image, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; the auto-framing step of specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image; and the model size estimation step of estimating a size with respect to the standard model image on the basis of the specified existence range of the object, wherein a size of the standard model image is changed to the estimated size, and thereafter, the object is identified on the basis of similarity between the object image present in the existence range in the input image and the size-changed standard model image.
Claim 7
Dependent Claim 150 words
An image segmentation method for extracting an object, which is not present in a reference image, from an input image including the object using the reference image, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; the auto-framing step of specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image; and the extraction processing step of performing extraction processing of the object within the specified existence range of the object.
Claim 8
Dependent Claim 150 words
An image segmentation method for extracting an object, which is not present in a reference image, from an input image including the object using the reference image, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; the auto-framing step of specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image; and the extraction processing step of performing extraction processing of the object within the specified existence range of the object.
Claim 9
Dependent Claim 163 words
An image segmentation method for segmenting an image region to be extracted from an input image using a reference image that represents a region approximating a remaining region excluding the image region, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; the singular contour extraction step of extracting a singular contour portion of the image region to be extracted on the basis of a distribution of differences between the detected line components in each of said directions in the reference image and input image; and the image extraction step of extracting the image region to be extracted on the basis of distribution data representing the extracted singular contour portion.
Claim 10
Dependent Claim 163 words
An image segmentation method for segmenting an image region to be extracted from an input image using a reference image that represents a region approximating a remaining region excluding the image region, comprising: the edge intensity distribution extraction step of extracting edge intensity distributions in the reference image and input image; the direction-classified line detection step of detecting, in each of a plurality of blocks divided on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; the singular contour extraction step of extracting a singular contour portion of the image region to be extracted on the basis of a distribution of differences between the detected line components in each of said directions in the reference image and input image; and the image extraction step of extracting the image region to be extracted on the basis of distribution data representing the extracted singular contour portion.
Claim 11
Dependent Claim 80 words
The method according to claim 5 , wherein the image extraction step comprises: the partial region extraction step of extracting a portion of the image region to be extracted as a partial region from the input image; the region growing step of performing region growing by thresholding similarities between the extracted partial region as a seed and its neighboring regions; and the extraction step of extracting a region obtained by the region growth as the image region to be extracted.
Claim 12
Dependent Claim 48 words
The method according to claim 5 , wherein the singular contour extraction step includes the step of extracting, as the singular contour portion, edges in the input image which have different line labels in terms of directions in identical neighboring regions of the input image and reference image.
Claim 13
Dependent Claim 109 words
The method according to claim 5 , wherein the singular contour extraction step comprises: the dominant line map extraction step of dividing the reference image into a plurality of blocks and detecting dominant line direction components in the blocks; and the line direction comparison step of comparing a label assigned to each of edges of the input image and the dominant direction line component in the block to which that edge belongs, and when the label assigned to the edge is different from the dominant direction line component in the block to which that edge belongs, the edge is extracted as the singular contour portion of the input image.
Claim 14
Dependent Claim 67 words
The method according to claim 5 , wherein the image extraction step comprises: the partial region extraction step of binarizing a portion of the image region to be extracted and extracting the binary data as mask data; the smoothing step of smoothing the extracted mask data; and the singular contour restoration step of restoring the singular contour portion to mask data after the mask data is smoothed.
Claim 15
Dependent Claim 49 words
The method according to claim 5 , wherein the singular contour extraction step includes the step of detecting a occluding boundary line serving as a boundary between the image region to be extracted, and the remaining region, and determining the detected occluding boundary line as the singular contour portion.
Claim 16
Dependent Claim 111 words
The method according to claim 10 , wherein the singular contour extraction step comprises: the dominant line map extraction step of segmenting the reference image into a plurality of blocks and detecting dominant line direction components in the blocks, a boundary point located in the vicinity of a boundary between a block without any dominant direction line component, and a block with the dominant direction line component among the blocks of the input image is extracted, and an edge of the input image located at a position closest to the boundary point in a predetermined local region including the boundary point is extracted as a portion of the occluding boundary line.
Claim 17
Dependent Claim 41 words
The method according to claim 6 , wherein the region growing step includes the step of controlling the region growing so that a region growing direction from the edge substantially agrees with a label in units of directions of that edge.
Claim 18
Dependent Claim 155 words
An image segmentation method for segmenting an image region to be extracted from an input image using a reference image that represents a region approximating a remaining region excluding the image region, comprising: the low-resolution image extraction step of extracting low-resolution image portions in the input image and reference image; the image matching step of performing matching corresponding points between for the input image and reference image; the dominant line map extraction step of segmenting the input image and reference image into a plurality of blocks an detecting, in each of a plurality of blocks divided on an image screen, dominant line direction components in the blocks; and the extraction step of extracting the image region on the basis of a degree of mating between a label in each of said directions of each edge of the input image and a label of the dominant line map of the reference image at the edge position.
Claim 19
Dependent Claim 155 words
An image segmentation method for segmenting an image region to be extracted from an input image using a reference image that represents a region approximating a remaining region excluding the image region, comprising: the low-resolution image extraction step of extracting low-resolution image portions in the input image and reference image; the image matching step of performing matching corresponding points between for the input image and reference image; the dominant line map extraction step of segmenting the input image and reference image into a plurality of blocks an detecting, in each of a plurality of blocks divided on an image screen, dominant line direction components in the blocks; and the extraction step of extracting the image region on the basis of a degree of mating between a label in each of said directions of each edge of the input image and a label of the dominant line map of the reference image at the edge position.
Claim 20
Dependent Claim 89 words
The method according to claim 13 , wherein the image matching step comprises: the corresponding point extraction step of extracting corresponding points between the reference image and input image; the first transformation step of geometrically transforming one of the input image and reference image on the basis of the extracted corresponding points; and the second transformation step of performing color correction of one of the input image and reference image, so that corresponding pixels in regions including the corresponding points have substantially equal gray levels after the geometric transformation.
Claim 21
Dependent Claim 30 words
The method according to claim 14 , wherein the geometric transformation includes entire or local processing associated with at least one of a translation, rotation, magnification transformation, and perspective transformation.
Claim 22
Dependent Claim 187 words
An image segmentation apparatus for segmenting an image region to be extracted from an input image using a reference image that represents a region substantially equal to a remaining region excluding the image region, comprising: storage means for storing the reference image; edge extraction means for extracting edge distributions in the input image and reference image; direction-classified line detection means for detecting, in each of a plurality of blocks divided on an image screen, line distributions in terms of directions in the input image and reference image on the basis of the extracted edge distributions; corresponding point extraction means for extracting corresponding point information between the reference image and input image; transformation means for geometrically transforming one of the input image and reference image on the basis of the extracted corresponding point information; singular edge extraction means for extracting a singular edge on the basis of a line distribution difference in each of said directions between the geometrically transformed image, and the other image; and segmentation means for segmenting the image region to be extracted from the input image on the basis of the extracted singular edge.
Claim 23
Dependent Claim 187 words
An image segmentation apparatus for segmenting an image region to be extracted from an input image using a reference image that represents a region substantially equal to a remaining region excluding the image region, comprising: storage means for storing the reference image; edge extraction means for extracting edge distributions in the input image and reference image; direction-classified line detection means for detecting, in each of a plurality of blocks divided on an image screen, line distributions in terms of directions in the input image and reference image on the basis of the extracted edge distributions; corresponding point extraction means for extracting corresponding point information between the reference image and input image; transformation means for geometrically transforming one of the input image and reference image on the basis of the extracted corresponding point information; singular edge extraction means for extracting a singular edge on the basis of a line distribution difference in each of said directions between the geometrically transformed image, and the other image; and segmentation means for segmenting the image region to be extracted from the input image on the basis of the extracted singular edge.
Claim 24
Dependent Claim 30 words
The apparatus according to claim 16 , wherein the geometric transformation includes entire or local processing associated with at least one of a translation, rotation, magnification transformation, and perspective transformation.
Claim 25
Dependent Claim 206 words
An image identification apparatus for identifying an object in an input image including the object which is not present in a reference image using a standard model image representing a predetermined object and the reference image, comprising: edge intensity distribution extraction means for extracting edge intensity distributions in the reference image and input image; direction-classified line detection means for detecting, in each of a plurality of blocks on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; auto-framing means for specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image; and model size estimation means for estimating a size with respect to the standard model image on the basis of the specified existence range of the object, wherein a size of the standard model image is changed to the estimated size, and thereafter, the object is identified on the basis of similarity between the object image present in the existence range in the input image and the size-changed standard model image.
Claim 26
Dependent Claim 206 words
An image identification apparatus for identifying an object in an input image including the object which is not present in a reference image using a standard model image representing a predetermined object and the reference image, comprising: edge intensity distribution extraction means for extracting edge intensity distributions in the reference image and input image; direction-classified line detection means for detecting, in each of a plurality of blocks on an image screen, line components in terms of predetermined directions for edges in the reference image and input image on the basis of the extracted edge intensity distributions; auto-framing means for specifying an existence range of the object in the input image on the basis of a distribution of differences between the detected line components in each of said directions between the reference image and input image; and model size estimation means for estimating a size with respect to the standard model image on the basis of the specified existence range of the object, wherein a size of the standard model image is changed to the estimated size, and thereafter, the object is identified on the basis of similarity between the object image present in the existence range in the input image and the size-changed standard model image.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2005-09-16 2006-03-18 2006-09-17 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2009-09-16 2010-03-18 2010-09-17 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2013-09-16 2014-03-18 2014-09-17 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag