Image processing apparatus and method for interpolating missing pixels

Claim 2

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an interpolating unit configured to generate interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated, and according to each degree of changes in image signals of said pixel to be interpolated, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 3

The image processing apparatus according to claim 1 , wherein said interpolating unit is configured to determine each degree of changes in image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and to determine each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 4

The image processing apparatus according to claim 1 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated by using said four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 5

The image processing apparatus according to claim 1 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of said four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 6

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an interpolating unit configured to generate interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of said pixel to be interpolated and according to a minimum value of each degree of changes in four adjacent pixels located at positions surrounding said pixel to be interpolated in the horizontal direction and vertical direction, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 7

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an interpolating unit configured to generate interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of said pixel to be interpolated and according to a minimum value of each degree of changes in four adjacent pixels located at positions surrounding said pixel to be interpolated in the horizontal direction and vertical direction, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 8

The image processing apparatus according to claim 5 , wherein said interpolating unit is configured to determine each degree of changes in image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and to determine each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 9

The image processing apparatus according to claim 5 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated by using said four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 10

The image processing apparatus according to claim 5 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of said four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 11

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an interpolating unit configured to generate interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of two adjacent pixels located on each of two sides of said pixel to be interpolated, according to each degree of changes in image signals of said pixel to be interpolated, and according to a difference in degrees between an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 12

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an interpolating unit configured to generate interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of two adjacent pixels located on each of two sides of said pixel to be interpolated, according to each degree of changes in image signals of said pixel to be interpolated, and according to a difference in degrees between an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 13

The image processing apparatus according to claim 9 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated, when one of a minimum value of each degree of changes in the horizontal direction of the two adjacent pixels located on the two sides of said pixel to be interpolated and a minimum value of each degree of changes in the vertical direction of the two adjacent pixels located on the two sides of said pixel to be interpolated is larger than a prespecified threshold value, according to each of the minimum values.

Claim 14

The image processing apparatus according to claim 9 , wherein said interpolating unit is configured to determine each degree of changes in image signals of two adjacent pixels located on the two sides of said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and to determine each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 15

The image processing apparatus according to claim 9 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated, when one of a minimum value of each degree of changes in the horizontal direction of the two adjacent pixels located on the two sides of said pixel to be interpolated and a minimum value of each degree of changes in the vertical direction of the two adjacent pixels located on the two sides of said pixel to be interpolated is equal to or less than a prespecified threshold value, according to whether an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction is a maximum signal or a minimum signal in a 3×3 pixel-area around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 16

The image processing apparatus according to claim 9 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated by using four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 17

The image processing apparatus according to claim 9 , wherein said interpolating unit is configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 18

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of four adjacent pixels located at positions surrounding a pixel to be interpolated; a second computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a first minimum-value computing unit configured to compute a minimum value of the degrees of changes in the horizontal direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing unit; a second minimum-value computing unit configured to compute a minimum value of the degrees of changes in the vertical direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing unit; and an interpolation-signal computing unit configured to generate the interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to a result of computation in said second computing unit and according to the minimum values computed by said first and second minimum-value computing units, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 19

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of four adjacent pixels located at positions surrounding a pixel to be interpolated; a second computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a first minimum-value computing unit configured to compute a minimum value of the degrees of changes in the horizontal direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing unit; a second minimum-value computing unit configured to compute a minimum value of the degrees of changes in the vertical direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing unit; and an interpolation-signal computing unit configured to generate the interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to a result of computation in said second computing unit and according to the minimum values computed by said first and second minimum-value computing units, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 20

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of two adjacent pixels located on each of two sides of a pixel to be interpolated; a second computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a difference determining unit configured to obtain a difference in degrees between an image signal of an adjacent pixel to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction; a first minimum-value computing unit configured to compute a minimum value of the degrees of changes in the horizontal direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing unit; a second minimum-value computing unit configured to compute a minimum value of the degrees of changes in the vertical direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing unit; a first comparing unit configured to compare the minimum value computed by said first minimum-value computing unit with a first threshold value; a second comparing unit configured to compare the minimum value computed by said second minimum-value computing unit with the first threshold value; a third comparing unit configured to compare each degree of changes in the horizontal direction of image signals of said pixel to be interpolated computed by said second computing unit with a second threshold value; a fourth comparing unit configured to compare each degree of changes in the vertical direction of image signals of said pixel to be interpolated computed by said second computing unit with the second threshold value; a selecting unit configured to select interpolation constants according to results of comparison in said first to fourth comparing units and a result of determination in said difference determining unit; and an interpolation-signal computing unit configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to the interpolation constants selected by said selecting unit.

Claim 21

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of two adjacent pixels located on each of two sides of a pixel to be interpolated; a second computing unit configured to compute each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a difference determining unit configured to obtain a difference in degrees between an image signal of an adjacent pixel to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction; a first minimum-value computing unit configured to compute a minimum value of the degrees of changes in the horizontal direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing unit; a second minimum-value computing unit configured to compute a minimum value of the degrees of changes in the vertical direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing unit; a first comparing unit configured to compare the minimum value computed by said first minimum-value computing unit with a first threshold value; a second comparing unit configured to compare the minimum value computed by said second minimum-value computing unit with the first threshold value; a third comparing unit configured to compare each degree of changes in the horizontal direction of image signals of said pixel to be interpolated computed by said second computing unit with a second threshold value; a fourth comparing unit configured to compare each degree of changes in the vertical direction of image signals of said pixel to be interpolated computed by said second computing unit with the second threshold value; a selecting unit configured to select interpolation constants according to results of comparison in said first to fourth comparing units and a result of determination in said difference determining unit; and an interpolation-signal computing unit configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to the interpolation constants selected by said selecting unit.

Claim 22

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an image pickup section including said pixels; and an interpolating means for generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated, and according to each degree of changes in image signals of said pixel to be interpolated, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 23

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an image pickup section including said pixels; and an interpolating means for generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated, and according to each degree of changes in image signals of said pixel to be interpolated, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 24

The image processing apparatus according to claim 17 , wherein said interpolating means is configured to determine each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and to determine each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 25

The image processing apparatus according to claim 17 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated by using four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 26

The image processing apparatus according to claim 17 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 27

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an image pickup section including said pixels; and an interpolating means for generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of said pixel to be interpolated and according to a minimum value of each degree of changes in four adjacent pixels located at positions surrounding said pixel to be interpolated in the horizontal direction and vertical direction, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 28

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an image pickup section including said pixels; and an interpolating means for generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of said pixel to be interpolated and according to a minimum value of each degree of changes in four adjacent pixels located at positions surrounding said pixel to be interpolated in the horizontal direction and vertical direction, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 29

The image processing apparatus according to claim 21 , wherein said interpolating means is configured to determine each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and to determine each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 30

The image processing apparatus according to claim 21 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated by using four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 31

The image processing apparatus according to claim 21 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 32

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an image pickup section including said pixels; and an interpolating means for generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of two adjacent pixels located on each of two sides of said pixel to be interpolated, according to each degree of changes in image signals of said pixel to be interpolated, and according to a difference in degrees between an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 33

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: an image pickup section including said pixels; and an interpolating means for generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of two adjacent pixels located on each of two sides of said pixel to be interpolated, according to each degree of changes in image signals of said pixel to be interpolated, and according to a difference in degrees between an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 34

The image processing apparatus according to claim 25 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated, when one of a minimum value of each degree of changes in the horizontal direction of the two adjacent pixels located on the two sides of said pixel to be interpolated and a minimum value of each degree of changes in the vertical direction of the two adjacent pixels located on the two sides of said pixel to be interpolated is larger than a prespecified threshold value, according to each of the minimum values.

Claim 35

The image processing apparatus according to claim 25 , wherein said interpolating means is configured to determine each degree of changes in image signals of two adjacent pixels located on the two sides of said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and to determine each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 36

The image processing apparatus according to claim 25 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated, when one of a minimum value of each degree of changes in the horizontal direction of two adjacent pixels located on the two sides of said pixel to be interpolated and a minimum value of each degree of changes in the vertical direction of the two adjacent pixels located on the two sides of said pixel to be interpolated is equal to or less than a prespecified threshold value, according to whether an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction is a maximum signal or a minimum signal in a 3×3 pixel-area around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 37

The image processing apparatus according to claim 25 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated by using four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 38

The image processing apparatus according to claim 25 , wherein said interpolating means is configured to generate interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 39

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of four adjacent pixels located at positions surrounding a pixel to be interpolated; a second computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a first minimum-value computing means for computing a minimum value of the degrees of changes in the horizontal direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing means; a second minimum-value computing means for computing a minimum value of the degrees of changes in the vertical direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing means; and an interpolation-signal computing means for generating the interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to a result of computation in said second computing means and the minimum values computed by said first and second minimum-value computing means, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 40

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of four adjacent pixels located at positions surrounding a pixel to be interpolated; a second computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a first minimum-value computing means for computing a minimum value of the degrees of changes in the horizontal direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing means; a second minimum-value computing means for computing a minimum value of the degrees of changes in the vertical direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing means; and an interpolation-signal computing means for generating the interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to a result of computation in said second computing means and the minimum values computed by said first and second minimum-value computing means, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 41

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of two adjacent pixels located on each of two sides of a pixel to be interpolated; a second computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a difference determining means for obtaining difference in degrees between an image signal of an adjacent pixel to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction; a first minimum-value computing means for computing a minimum value of the degrees of changes in the horizontal direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing means; a second minimum-value computing means for computing a minimum value of the degrees of changes in the vertical direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing means; a first comparing means for comparing the minimum value computed by said first minimum-value computing means with a first threshold value; a second comparing means for comparing the minimum value computed by said second minimum-value computing means with the first threshold value; a third comparing means for comparing each degree of changes in the horizontal direction of image signals of said pixel to be interpolated computed by said second computing means with a second threshold value; a fourth comparing means for comparing each degree of changes in the vertical direction of image signals of said pixel to be interpolated computed by said second computing means with the second threshold value; a selecting means for selecting interpolation constants according to results of comparison in said first to fourth comparing means and a result of determination in said difference determining means; and an interpolation-signal computing means for generating interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to the interpolation constants selected by said selecting means.

Claim 42

An image processing apparatus configured to process pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said apparatus comprising: a first computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of two adjacent pixels located on each of two sides of a pixel to be interpolated; a second computing means for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a difference determining means for obtaining difference in degrees between an image signal of an adjacent pixel to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction; a first minimum-value computing means for computing a minimum value of the degrees of changes in the horizontal direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing means; a second minimum-value computing means for computing a minimum value of the degrees of changes in the vertical direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing means; a first comparing means for comparing the minimum value computed by said first minimum-value computing means with a first threshold value; a second comparing means for comparing the minimum value computed by said second minimum-value computing means with the first threshold value; a third comparing means for comparing each degree of changes in the horizontal direction of image signals of said pixel to be interpolated computed by said second computing means with a second threshold value; a fourth comparing means for comparing each degree of changes in the vertical direction of image signals of said pixel to be interpolated computed by said second computing means with the second threshold value; a selecting means for selecting interpolation constants according to results of comparison in said first to fourth comparing means and a result of determination in said difference determining means; and an interpolation-signal computing means for generating interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to the interpolation constants selected by said selecting means.

Claim 43

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated, and according to each degree of changes in image signals of said pixel to be interpolated, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 44

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated, and according to each degree of changes in image signals of said pixel to be interpolated, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 45

The image processing method according to claim 33 , wherein said generating step determines each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and determines each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 46

The image processing method according to claim 33 , wherein said generating step generates interpolation signals of said pixel to be interpolated by using four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 47

The image processing method according to claim 33 , wherein said generating step generates interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 48

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of said pixel to be interpolated and minimum values of each degree of changes in four adjacent pixels located at positions surrounding said pixel to be interpolated in the horizontal direction and vertical direction, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 49

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of said pixel to be interpolated and minimum values of each degree of changes in four adjacent pixels located at positions surrounding said pixel to be interpolated in the horizontal direction and vertical direction, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 50

The image processing method according to claim 37 , wherein said generating step determines each degree of changes in image signals of four adjacent pixels located at positions surrounding said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and determines each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 51

The image processing method according to claim 37 , wherein said generating step generates interpolation signals of said pixel to be interpolated by using four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 52

The image processing method according to claim 37 , wherein said generating step generates interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 53

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of two adjacent pixels located on each of two sides of said pixel to be interpolated, according to each degree of changes in image signals of said pixel to be interpolated, and according to a difference in degrees between an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 54

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: generating interpolation signals of a pixel to be interpolated according to each degree of changes in image signals of two adjacent pixels located on each of two sides of said pixel to be interpolated, according to each degree of changes in image signals of said pixel to be interpolated, and according to a difference in degrees between an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 55

The image processing method according to claim 41 , wherein said generating step generates interpolation signals of said pixel to be interpolated, when one of a minimum value of each degree of changes in the horizontal direction of two adjacent pixels located on the two sides of said pixel to be interpolated and a minimum value of each degree of changes in the vertical direction of the two adjacent pixels located on the two sides of said pixel to be interpolated is larger than a prespecified threshold value, according to each of the minimum values.

Claim 56

The image processing method according to claim 41 , wherein said generating step determines each degree of changes in image signals of two adjacent pixels located on the two sides of said pixel to be interpolated in a 3×3 pixel-area around each of the adjacent pixels, and determines each degree of changes in image signals of said pixel to be interpolated in a 3×3 pixel-area around said pixel to be interpolated.

Claim 57

The image processing method according to claim 41 , wherein said generating step generates interpolation signals of said pixel to be interpolated, when one of a minimum value of each degree of changes in the horizontal direction of two adjacent pixels located on the two sides of said pixel to be interpolated and a minimum value of each degree of changes in the vertical direction of the two adjacent pixels located on the two sides of said pixel to be interpolated is equal to or less than a prespecified threshold value, according to whether an image signal of each of the adjacent pixels to said pixel to be interpolated in the horizontal direction is a maximum signal or a minimum signal in a 3×3 pixel-area around the adjacent pixel to said pixel to be interpolated in the horizontal direction.

Claim 58

The image processing method according to claim 41 , wherein said generating step generates interpolation signals of said pixel to be interpolated by using four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 59

The image processing method according to claim 41 , wherein said generating step generates interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of four adjacent pixels located at positions surrounding said pixel to be interpolated.

Claim 60

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals said method comprising: a first computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of four adjacent pixels located at positions surrounding a pixel to be interpolated; a second computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a first minimum-value computing step for computing a minimum value of the each degree of changes in the horizontal direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing step; a second minimum-value computing step for computing a minimum value of the each degree of changes in the vertical direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing step; and generating the interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to a result of computation in said second computing step and the minimum values computed by said first and second minimum-value computing steps, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 61

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein each pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals said method comprising: a first computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of four adjacent pixels located at positions surrounding a pixel to be interpolated; a second computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a first minimum-value computing step for computing a minimum value of the each degree of changes in the horizontal direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing step; a second minimum-value computing step for computing a minimum value of the each degree of changes in the vertical direction of image signals of the four adjacent pixels located at positions surrounding said pixel to be interpolated computed by said first computing step; and generating the interpolation signals of said pixel to be interpolated by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to a result of computation in said second computing step and the minimum values computed by said first and second minimum-value computing steps, wherein: each degree of changes is determined by determining a difference between at least two pixels adjacent to the pixel for which the degree of change is determined, and said each degree of changes in image signals of the four adjacent pixels is determined by determining a difference between at least two pixels of the same color as the adjacent pixel for which the degree of change is determined.

Claim 62

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein said pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: a first computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of two adjacent pixels located on the two sides of a pixel to be interpolated; a second computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a difference determining step for obtaining a difference in degrees between an image signal of an adjacent pixel to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction; a first minimum-value computing step for computing a minimum value of the each degree of changes in the horizontal direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing step; a second minimum-value computing step for computing a minimum value of the each degree of changes in the vertical direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing step; a first comparing step for comparing the minimum value computed by said first minimum-value computing step with a first threshold value; a second comparing step for comparing the minimum value computed by said second minimum-value computing step with the first threshold value; a third comparing step for comparing each degree of changes in the horizontal direction of image signals of said pixel to be interpolated computed by said second computing step with a second threshold value; a fourth comparing step for comparing each degree of changes in the vertical direction of image signals of said pixel to be interpolated computed by said second computing step with the second threshold value; selecting interpolation constants according to results of comparison in said first to fourth comparing steps and a result of determination in said difference determining step; and generating interpolation signals of said pixel to be interpolated each by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to the interpolation constants selected by said selecting step.

Claim 63

An image processing method for processing pixels having missing image signals by interpolation, said pixels being arranged in a grid configuration wherein said pixel is between other pixels in a horizontal direction and a vertical direction, said other pixels having image signals corresponding to said missing image signals, said method comprising: a first computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of two adjacent pixels located on the two sides of a pixel to be interpolated; a second computing step for computing each degree of changes in the horizontal direction and vertical direction of image signals of said pixel to be interpolated; a difference determining step for obtaining a difference in degrees between an image signal of an adjacent pixel to said pixel to be interpolated in the horizontal direction and each image signal of pixels around the adjacent pixel to said pixel to be interpolated in the horizontal direction; a first minimum-value computing step for computing a minimum value of the each degree of changes in the horizontal direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing step; a second minimum-value computing step for computing a minimum value of the each degree of changes in the vertical direction of image signals of the two adjacent pixels located on the two sides of said pixel to be interpolated computed by said first computing step; a first comparing step for comparing the minimum value computed by said first minimum-value computing step with a first threshold value; a second comparing step for comparing the minimum value computed by said second minimum-value computing step with the first threshold value; a third comparing step for comparing each degree of changes in the horizontal direction of image signals of said pixel to be interpolated computed by said second computing step with a second threshold value; a fourth comparing step for comparing each degree of changes in the vertical direction of image signals of said pixel to be interpolated computed by said second computing step with the second threshold value; selecting interpolation constants according to results of comparison in said first to fourth comparing steps and a result of determination in said difference determining step; and generating interpolation signals of said pixel to be interpolated each by weighting and averaging pixels in the horizontal direction and pixels in the vertical direction of the four adjacent pixels located at positions surrounding said pixel to be interpolated according to the interpolation constants selected by said selecting step.

Claim 64

In an image processing apparatus configured to process a plurality of pixels arranged in a grid configuration, wherein each pixel has a defined image signal and a plurality of undefined image signals, each pixel to be processed being adjacent to other pixels having defined image signals corresponding to the undefined image signals of the pixel to be processed, the improvement comprising: an interpolating unit configured to interpolate the undefined image signals of said each pixel to be processed according to each degree of changes associated with said other pixels, and according to each degree of changes associated with said pixel to be processed, wherein said degree of changes associated with said other pixels is a variation that exists between defined image signals of same color image signal pixels surrounding each of said other pixels in a horizontal and vertical direction, said degree of changes associated with said pixel to be processed is a variation that exists between defined image signals of like image signal pixels among said other pixels, and wherein each degree of changes is determined by determining a difference between at least 2 pixels adjacent to the pixel for which the degree of change is determined.

Claim 65

In an image processing apparatus configured to process a plurality of pixels arranged in a grid configuration, wherein each pixel has a defined image signal and a plurality of undefined image signals, each pixel to be processed being adjacent to other pixels having defined image signals corresponding to the undefined image signals of the pixel to be processed, the improvement comprising: an interpolating unit configured to interpolate the undefined image signals of said each pixel to be processed according to each degree of changes associated with said other pixels, and according to each degree of changes associated with said pixel to be processed, wherein said degree of changes associated with said other pixels is a variation that exists between defined image signals of same color image signal pixels surrounding each of said other pixels in a horizontal and vertical direction, said degree of changes associated with said pixel to be processed is a variation that exists between defined image signals of like image signal pixels among said other pixels, and wherein each degree of changes is determined by determining a difference between at least 2 pixels adjacent to the pixel for which the degree of change is determined.

Claim 66

The image processing apparatus according to claim 49 , wherein said other pixels are four pixels adjacent to said pixel to be processed, said interpolating unit is configured to determine each degree of changes associated with each of the four adjacent pixels by using a 3×3 pixel-area around each of the adjacent pixels, and said interpolating unit is also configured to determine each degree of changes associated with said pixel to be processed by using a 3×3 pixel-area around said pixel to be processed.

Claim 67

The image processing apparatus according to claim 49 , wherein said interpolating unit is configured to interpolate undefined image signals of at least one pixel to be processed by using only defined image signals of said other pixels.

Claim 68

The image processing apparatus according to claim 49 , wherein said interpolating unit is configured to interpolate undefined image signals of said pixel to be processed by weighting and averaging defined image signals of said other pixels.