US6990233B2 — Apparatus and method for extracting object based …

Claim 1

Independent Claim 154 words

An apparatus for extracting an object from an image, comprising: an image input unit for receiving a query image including an object and an object extraction target image from which the object included in the query image is to be extracted; an object position determination unit for determining a position of the object in the object extraction target image using pixel based color feature matching; an image segmentation unit for segmenting each of the query image and the object extraction target image into a plurality of regions using image features including color or texture; and an object region determination unit for performing matching between the segmented regions in the query image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching.

Claim 2

Independent Claim 154 words

An apparatus for extracting an object from an image, comprising: an image input unit for receiving a query image including an object and an object extraction target image from which the object included in the query image is to be extracted; an object position determination unit for determining a position of the object in the object extraction target image using pixel based color feature matching; an image segmentation unit for segmenting each of the query image and the object extraction target image into a plurality of regions using image features including color or texture; and an object region determination unit for performing matching between the segmented regions in the query image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching.

Claim 3

Independent Claim 225 words

An apparatus for extracting an object from an image, comprising: an image input unit for receiving a guery image including an object and an object extraction target image from which the object included in the guery image is to be extracted; an object position determination unit for determining a position of the object in the object extraction target image using pixel based color feature matching; an image segmentation unit for segmenting each of the guery image and the object extraction target image into a plurality of regions using image features including color or texture; and an object region determination unit for performing matching between the segmented regions in the guery image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching, wherein the object position determination unit comprises: a color histogram calculator for calculating color histograms with respect to the query image and the object extraction target image; an image projector for replacing the pixel values with respect to the query image and the object extraction target image with ratio histograms; and a candidate object position determiner for determining candidate object positions in the object extraction target image having the ratio histogram.

Claim 4

Independent Claim 225 words

An apparatus for extracting an object from an image, comprising: an image input unit for receiving a guery image including an object and an object extraction target image from which the object included in the guery image is to be extracted; an object position determination unit for determining a position of the object in the object extraction target image using pixel based color feature matching; an image segmentation unit for segmenting each of the guery image and the object extraction target image into a plurality of regions using image features including color or texture; and an object region determination unit for performing matching between the segmented regions in the guery image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching, wherein the object position determination unit comprises: a color histogram calculator for calculating color histograms with respect to the query image and the object extraction target image; an image projector for replacing the pixel values with respect to the query image and the object extraction target image with ratio histograms; and a candidate object position determiner for determining candidate object positions in the object extraction target image having the ratio histogram.

Claim 5

Dependent Claim 35 words

The apparatus of claim 2 , wherein the color histogram calculator calculates the number of pixels in a quantized color space with respect to each of the query image and the object extraction target image.

Claim 6

Dependent Claim 103 words

The apparatus of claim 2 , wherein the candidate object position determiner performs convolution on the value of a mask determined based on a minimum bounding box surrounding the object included in the query image and the object extraction target image having the ratio histogram, calculates color distance differences between pixels with respect to which the resulting values of the convolution is no less than a predetermined threshold in the object extraction target image, and determines pixels as candidate object positions according to the average of color distance differences obtained with respect to each of the pixels in increasing order of the average.

Claim 7

Dependent Claim 31 words

The apparatus of claim 2 , wherein the image segmentation unit segments the query image and the object extraction target image into regions using the image features including color or texture.

Claim 8

Dependent Claim 176 words

The apparatus of claim 2 , wherein the object region determination unit comprises: a region matching unit for performing region matching with respect to the segmented regions of the query image and segmented regions corresponding to the object position in the object extraction target image using image features including at least color and texture and determining whether the object extraction target image includes an object according to the result of region matching; an adjacency matrix calculator for calculating a spatial adjacency matrix with respect to the segmented query image and calculating a spatial adjacency matrix with respect to an image resulting from the region matching on the segmented object extraction target image which is determined as having the object; a correspondence region detector for detecting correspondence regions between the query image and the object extraction target image using the adjacency matrixes calculated by the adjacency matrix calculator; and a similarity calculator for calculating the similarity between the query image and the object extraction target image based on the correspondence regions and determining a final object region.

Claim 9

Dependent Claim 78 words

The apparatus of claim 6 , wherein the region matching unit detects a segmented region, which includes a pixel at the determined position of the object and meets a mask determined based on a region surrounding the object in the query image, in the segmented object extraction target image, calculates a similarity distance between each detected region and each of the segmented regions of the query image, and determined whether the object extraction target image includes the object.

Claim 10

Dependent Claim 93 words

The apparatus of claim 6 , wherein the adjacency matrix calculator assigns label numbers to the segmented regions of the query image and to segmented regions including the object of the query image in the object extraction target image and forms adjacency matrixes in which each element has a first value when corresponding regions are adjacent and has a second value when they are not adjacent, the adjacency matrixes showing information about how adjacent the segmented regions assigned the label numbers are in the query image and the object extraction target image, respectively.

Claim 11

Dependent Claim 66 words

The apparatus of claim 6 , wherein the correspondence region detector forms a comparison matrix using the adjacency matrixes in different manners according to whether the number of the segmented regions in the query image is greater or less than the number of segmented region in the object extraction target image to show the correspondence regions between the query image and the object extraction target image.

Claim 12

Dependent Claim 62 words

The apparatus of claim 6 , wherein the correspondence region detector forms a comparison matrix using the adjacency matrixes and using only segmented regions, which have most similar image features to the segmented regions having label numbers in the query image, in the object extraction target image to show the correspondence regions between the query image and the object extraction target image.

Claim 13

Dependent Claim 59 words

The apparatus of claim 10 , wherein the correspondence region detector determines the segmented regions having the most similar image features to the segmented regions of the query image in the object extraction target image using a distance matrix and reconstructs the comparison matrix according to the correspondence regions between the query image and the object extraction target image.

Claim 14

Dependent Claim 73 words

The apparatus of claim 11 , wherein the distance matrix has the label numbers of the query image as row values and has the label numbers of the object extraction target image as column values, and each element in the distance matrix is a distance between a region assigned one of the label numbers in the query image and a region assigned one of the label numbers in the object extraction target image.

Claim 15

Dependent Claim 43 words

The apparatus of claim 8 , wherein the similarity calculator calculates the similarity by dividing the number of elements having the first value in an upper triangular matrix by the number of all elements in the upper triangular matrix in the comparison matrix.

Claim 16

Independent Claim 137 words

A method of extracting an object from an image, comprising the steps of: (a) receiving a query image including an object and an object extraction target image from which the object included in the query image is to be extracted; (b) determining a position of the object in the object extraction target image using pixel based color feature matching; (c) segmenting the query image and the object extraction target image into a plurality of regions using image features including color or texture; and (d) performing matching between the segmented regions in the query image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching.

Claim 17

Independent Claim 137 words

A method of extracting an object from an image, comprising the steps of: (a) receiving a query image including an object and an object extraction target image from which the object included in the query image is to be extracted; (b) determining a position of the object in the object extraction target image using pixel based color feature matching; (c) segmenting the query image and the object extraction target image into a plurality of regions using image features including color or texture; and (d) performing matching between the segmented regions in the query image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching.

Claim 18

Independent Claim 188 words

A method of extracting an object from an image, comprising the steps of: (a) receiving a query image including an object and an object extraction target image from which the object included in the query image is to be extracted; (b) determining a position of the object in the object extraction target image using pixel based color feature matching; (c) calculating color histograms with respect to the query image and the object extraction target image; (d) replacing the color histograms with respect to the query image and the object extraction target image with ratio histograms; (e) determining candidate object positions in the object extraction target image having the ratio histogram; (f) segmenting the query image and the object extraction target image into a plurality of regions using image features including color or texture; and (g) performing matching between the segmented regions in the guery image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching.

Claim 19

Independent Claim 188 words

A method of extracting an object from an image, comprising the steps of: (a) receiving a query image including an object and an object extraction target image from which the object included in the query image is to be extracted; (b) determining a position of the object in the object extraction target image using pixel based color feature matching; (c) calculating color histograms with respect to the query image and the object extraction target image; (d) replacing the color histograms with respect to the query image and the object extraction target image with ratio histograms; (e) determining candidate object positions in the object extraction target image having the ratio histogram; (f) segmenting the query image and the object extraction target image into a plurality of regions using image features including color or texture; and (g) performing matching between the segmented regions in the guery image and the segmented regions in the determined position of the object in the object extraction target image using color or texture features and determining a final object region using similarity in spatial adjacency between matching regions obtained as a result of the matching.

Claim 20

Dependent Claim 38 words

The method of claim 15 , wherein the step (c) comprises calculating the number of pixels at each bin in a quantized color space with respect to each of the query image and the object extraction target image.

Claim 21

Dependent Claim 44 words

The method of claim 16 , wherein the step (d) comprises calculating the ratio histogram by dividing the number of pixels in each bin with respect to the query image by the number of pixels in all bins with respect to the query image.

Claim 22

Dependent Claim 48 words

The method of claim 16 , wherein the step (d) comprises defining the ratio histogram as a ratio of the number of pixels in each bin with respect to the query image to the number of pixels in each bin with respect to the object extraction target image.

Claim 23

Dependent Claim 114 words

The method of claim 15 , wherein the step (e) comprises the steps of: (e 1 ) performing convolution on the value of a mask determined based on a minimum bounding box surrounding the object included in the query image and the object extraction target image having the ratio histogram, (e 2 ) calculating color distance differences between pixels with respect to which the resulting values of the convolution is no less than a predetermined threshold in the object extraction target image; and (e 3 ) determining pixels as candidate object positions according to the average of color distance differences obtained with respect to each of the pixels in increasing order of the average.

Claim 24

Dependent Claim 148 words

The method of claim 19 , wherein the mask at a pixel (x p , y p ) is a circle defined by ⁢ W = { 255 , ( x - x p ) 2 + ( y - y p ) 2 ≤ W ⁢ ⁢ R 0 , o ⁢ ⁢ t ⁢ ⁢ h ⁢ ⁢ e ⁢ ⁢ r ⁢ ⁢ w ⁢ ⁢ i ⁢ ⁢ s ⁢ ⁢ e ⁢ W ⁢ ⁢ R = α ⁡ ( b ⁢ ⁢ s + ( b ⁢ ⁢ l - b ⁢ ⁢ s ) ⁢ b ⁢ ⁢ s b ⁢ ⁢ l ) , bl indicates the length of the longer side of the bounding box, bs indicates the length of the shorter side of the bounding box, and α indicates a variable for adjusting the size of the mask.

Claim 25

Dependent Claim 78 words

The method of claim 19 , wherein the average color distance difference is defined by AD pixelcolor = 1 N ⁢ ∑ i = 1 N ⁢ ( R q - R d ) 2 + ( G q - G d ) 2 + ( B q - B d ) 2 , N indicates the number of valid pixels within the bounding box, q indicates the query image, and d indicates the object extraction target image.

Claim 26

Dependent Claim 168 words

The method of claim 15 , wherein the step (g) comprises the steps of: (g 1 ) performing region matching with respect to the segmented regions of the query image and segmented regions corresponding to the object position in the object extraction target image using image features including color or texture and determining whether the object extraction target image includes an object according to the result of region matching; (g 2 ) calculating a spatial adjacency matrix with respect to the segmented query image and calculating a spatial adjacency matrix with respect to an image resulting from the region matching on the segmented object extraction target image which is determined as having the object; (g 3 ) detecting correspondence regions between the query image and the object extraction target image using the adjacency matrixes calculated in step (g 2 ); and (g 4 ) calculating the similarity between the query image and the object extraction target image based on the correspondence regions and determining a final object region.

Claim 27

Dependent Claim 98 words

The method of claim 22 , wherein the step (g 1 ) comprises the steps of: (g 1 - 1 ) detecting a segmented region, which includes a pixel at the determined position of the object and meets a mask determined based on a region surrounding the object in the query image, in the segmented object extraction target image; and (g 1 - 2 ) calculating a distance difference in color or texture between each detected region and each of the segmented regions of the query image to determine whether the object extraction target image includes the object.

Claim 28

Dependent Claim 129 words

The method of claim 23 , wherein the distance difference in color or texture is defined as a distance between two regions in a space of an image feature including color or texture, the distance between two regions is calculated from D CT ⁡ ( x , y ) = w c ⁢ D c ⁡ ( x , y ) + w t ⁢ D t ⁡ ( x , y ) w c + w t , D c (x,y) and D t (x,y) indicate a distance between two regions x and y in a color space and a distance between the two regions x and y in a texture space, respectively, and w c and w t indicate weight coefficients, respectively, applied to the respective distances.

Claim 29

Dependent Claim 95 words

The method of claim 22 , wherein the step (g 2 ) comprises assigning label numbers to the segmented regions of the query image and to segmented regions including the object of the query image in the object extraction target image and forming adjacency matrixes in which each element has a first value when corresponding regions are adjacent and has a second value when they are not adjacent, the adjacency matrixes showing information about how adjacent the segmented regions assigned the label numbers are in the query image and the object extraction target image, respectively.

Claim 30

Dependent Claim 68 words

The method of claim 22 , wherein the step (g 3 ) comprises forming a comparison matrix using the adjacency matrixes in different manners according to whether the number of the segmented regions in the query image is greater or less than the number of segmented region in the object extraction target image to show the correspondence regions between the query image and the object extraction target image.

Claim 31

Dependent Claim 64 words

The method of claim 22 , wherein the step (g 3 ) comprises forming a comparison matrix using the adjacency matrixes and using only segmented regions, which have most similar image features to the segmented regions having label numbers in the query image, in the object extraction target image to show the correspondence regions between the query image and the object extraction target image.

Claim 32

Dependent Claim 61 words

The method of claim 22 , wherein the step (g 3 ) comprises determining the segmented regions having the most similar image features to the segmented regions of the query image in the object extraction target image using a distance matrix and reconstructing the comparison matrix according to the correspondence regions between the query image and the object extraction target image.

Claim 33

Dependent Claim 73 words

The method of claim 28 , wherein the distance matrix has the label numbers of the query image as row values and has the label numbers of the object extraction target image as column values, and each element in the distance matrix is a distance between a region assigned one of the label numbers in the query image and a region assigned one of the label numbers in the object extraction target image.

Claim 34

Dependent Claim 72 words

The method of claim 22 , wherein when each element in the adjacency matrixes has a first value when corresponding regions are adjacent and has a second value when they are not adjacent, the step (g 4 ) comprises calculating the similarity by dividing the number of elements having the first value in an upper triangular matrix by the number of all elements in the upper triangular matrix in the comparison matrix.

Claim 35

Dependent Claim 85 words

The method of claim 27 , wherein the step (d 4 ), the similarity is calculated from S = E u M u , and when each element in the adjacency matrixes has a first value when corresponding regions are adjacent and has a second value when they are not adjacent, E u indicates the number of elements having the first value in an upper triangular matrix of the comparison matrix, and M u indicates the number of all elements in the upper triangular matrix.

Claim 36

Dependent Claim 21 words

A computer readable recording medium on which a program for executing the method of claim 14 in a computer is recorded.

Annuity Stage	Window Opens	Payment Deadline	Surcharge Period Until	Estimated Fee	Status
3.5 Years (Year 4)	2009-01-23	2009-07-25	2010-01-24	$2000.00	Window Closed / Lapsed
7.5 Years (Year 8)	2013-01-23	2013-07-25	2014-01-24	$3760.00	Window Closed / Lapsed
11.5 Years (Year 12)	2017-01-23	2017-07-25	2018-01-24	$7700.00	Window Closed / Lapsed

Apparatus and method for extracting object based on feature matching between segmented regions in images

Abstract

Inventors

Bibliographic Details

Claims Analysis

References Cited (Backward Citations)

USPTO Annuity & Maintenance Windows

Assigned Categories & Tags

Assign Category Tag