Stereoscopic image pickup and display apparatus

Claim 2

A stereoscopic image pickup apparatus comprising: an image pickup device for capturing pairs of images of an object from a plurality of viewpoints, each of said pairs of images referred to as a left image and a corresponding right image; a converging angle moving mechanism for varying a converging angle of said image pickup device; a signal processor for generating image data for said images captured by said image pickup device; a parallax calculator for calculating a parallax of said object for individual pairs of images by directly using said image data from said signal processor relating only to a respective pair of images, free of the use of a pointer, and using a block-matching technique; a parallax processor for detecting the smallest value of parallax, representing a parallax of a nearest object to said image pickup device, calculated by said parallax calculator; a depth display position calculator for calculating from said smallest value of parallax detected by said parallax processor a depthwise position of said nearest object to be reproduced at a nearest point when a captured image is displayed by a stereoscopic image display device; a fusing range verifier for verifying whether said depthwise position of said nearest object calculated by said depth display position calculator is within a fusional range of a viewer when the viewer views a reproduced image; and a converging angle controller for controlling said converging angle moving mechanism, when said fusing range verifier determines that said depthwise position of said nearest object is not within the fusional range of the viewer, in order to change said converging angle so that said depthwise position of said nearest object is near a boundary of the fusional range of the viewer, thereby minimizing three-dimensional distortion of the image display device while maximizing display area that a viewer can fuse.

Claim 3

A stereoscopic image pickup apparatus according to claim 1, wherein the parallax processor detects the largest value of parallax, representing a parallax of a farthest object from said image pickup device, calculated by said parallax calculator; the depth display position calculator calculates from said smallest value of parallax detected by said parallax processor the depthwise position of said farthest object to be reproduced at a farthest point when the captured image is displayed by a stereoscopic image display device; said fusing range verifier verifies whether said farthest point is within a fusional range of the viewer when the viewer views the reproduced image; and said converging angle controller controls said converging angle moving mechanism, when said fusing range verifier determines that said depthwise position of said farthest object is not within the fusional range of the viewer, in order to change said converging angle so that said depthwise position of said farthest object is near a boundary of the fusional range of the viewer, thereby minimizing three-dimensional distortion of the image display device while maximizing display area that a viewer can fuse.

Claim 4

A stereoscopic image display apparatus comprising: a parallax calculator for calculating and outputting a binocular parallax or three-dimensional position of an object directly from only left and right images of the object captured from at least two different angles, free of the use of a pointer, and using block-matching technique between plural viewpoint images, the images captured from the at least two different angles designated the right image and the left image; a fixating point calculator, responsive to the output of the parallax calculator, for calculating a depthwise center position of the object; and a parallax controller, responsive to the fixating point calculator, for moving the right and left images in opposite directions horizontally so that said depthwise center position indicated by said fixating point calculator is reproduced near a boundary of a viewer's fusional limit such that the moving distance of the right image and the left image is minimized, thereby reducing the three-dimensional distortion of the displayed image.

Claim 5

A stereoscopic image display apparatus comprising: a parallax calculator for calculating and outputting a binocular parallax or three-dimensional position of an object directly from only left and right images of the object captured from at least two different angles, free of the use of a pointer, and using block-matching technique between plural viewpoint images, the images captured from the at least two different angles designated the right image and the left image; a fixating point calculator, responsive to the output of the parallax calculator, for calculating a depthwise center position of the object; and a parallax controller, responsive to the fixating point calculator, for moving the right and left images in opposite directions horizontally so that said depthwise center position indicated by said fixating point calculator is reproduced near a boundary of a viewer's fusional limit such that the moving distance of the right image and the left image is minimized, thereby reducing the three-dimensional distortion of the displayed image.

Claim 6

A stereoscopic image display apparatus according to claim 3, wherein said fixating point calculator calculates the depthwise position to be controlled by said parallax controller, by taking an average or a weighted average with greater weight given to the center of the screen, over an entire screen or over a small area within an image in the output of said parallax calculator.

Claim 7

A stereoscopic image display apparatus according to claim 3, wherein said fixating point calculator calculates the depthwise position to be controlled by said parallax controller, by calculating the largest value or smallest value in an entire screen, or in a small area within an image, in the output of said parallax calculator.

Claim 8

A stereoscopic image display apparatus according to claim 3, wherein said fixating point calculator includes a line-of sight detector for detecting a line of vision of a viewer; a fixating point evaluator for detecting from the line of vision detected by said line-of-sight detector a fixating point in a displayed image on which the viewer's fixating is focused; and a control amount calculator for calculating an average value for binocular parallax at a required display image position from parallax values calculated by said parallax calculator and from the fixating point detected by said fixating point evaluator.

Claim 9

A stereoscopic image display apparatus according to claim 6, wherein said fixating point evaluator extracts data only for a period in which a moving speed of the viewer's line of vision is slow, and holds and low-pass filters the data to detect the viewer's fixating point.

Claim 10

A stereoscopic image display apparatus according to claim 6, wherein said control amount calculator calculates the depthwise position to be controlled by the parallax controller, by averaging the output of said parallax calculator over a prescribed range centering around the viewer's fixating point in the displayed image indicated by the output of said fixating point evaluator.

Claim 11

A stereoscopic image display apparatus according to claim 6, wherein said parallax controller moves two images in opposite direction horizontally so that the output of said control amount calculator is reproduced near the boundary of a viewer's fusional limit, and so that moving distance of right and left images becomes smallest for making three dimension distortion of displayed image smaller.

Claim 12

A stereoscopic image pickup and display apparatus comprising: an image pickup device for capturing pairs of images of an object from a plurality of viewpoints, each of said pairs of images referred to as a left image and a corresponding right image; a converging angle moving mechanism for varying a converging angle of said image pickup device; a signal processor for generating image data for said images captured by said image pickup device; a parallax calculator for calculating a parallax of said object for individual pairs of images by directly using said image data from said signal processor relating only to a respective pair of images, free of the use of a pointer; a parallax processor for detecting the smallest value of parallax, representing a parallax of a nearest object to said image pickup device, calculated by said parallax calculator; a depth display position calculator for calculating from said smallest value of parallax detected by said parallax processor a depthwise position of said nearest object to be reproduced at a nearest point when a captured image is displayed by a stereoscopic image display device; a fusing range verifier for verifying whether said depthwise position of said nearest object calculated by said depth display position calculator is within a fusional range of a viewer when the viewer views a reproduced image; and a converging angle controller for controlling said converging angle moving mechanism, when said fusing range verifier determines that said depthwise position of said nearest object is not within the fusional range of the viewer, in order to change said converging angle so that said depthwise position of said nearest object is near a boundary of the fusional range of the viewer, thereby minimizing three-dimensional distortion of the image display device while maximizing display area that a viewer can fuse; a fixating point calculator for calculating a depthwise center position of the object on the basis of an output of said parallax calculator; and a parallax controller for performing control so that said depthwise center position is reproduced near a boundary of a viewer's fusional limit, and so that a moving distance of a right image and a left image becomes smallest, thereby reducing the three-dimensional distortion of the displayed image.

Claim 13

A stereoscopic image pickup and display apparatus comprising: an image pickup device for capturing pairs of images of an object from a plurality of viewpoints, each of said pairs of images referred to as a left image and a corresponding right image; a converging angle moving mechanism for varying a converging angle of said image pickup device; a signal processor for generating image data for said images captured by said image pickup device; a parallax calculator for calculating a parallax of said object for individual pairs of images by directly using said image data from said signal processor relating only to a respective pair of images, free of the use of a pointer; a parallax processor for detecting the smallest value of parallax, representing a parallax of a nearest object to said image pickup device, calculated by said parallax calculator; a depth display position calculator for calculating from said smallest value of parallax detected by said parallax processor a depthwise position of said nearest object to be reproduced at a nearest point when a captured image is displayed by a stereoscopic image display device; a fusing range verifier for verifying whether said depthwise position of said nearest object calculated by said depth display position calculator is within a fusional range of a viewer when the viewer views a reproduced image; and a converging angle controller for controlling said converging angle moving mechanism, when said fusing range verifier determines that said depthwise position of said nearest object is not within the fusional range of the viewer, in order to change said converging angle so that said depthwise position of said nearest object is near a boundary of the fusional range of the viewer, thereby minimizing three-dimensional distortion of the image display device while maximizing display area that a viewer can fuse; a fixating point calculator for calculating a depthwise center position of the object on the basis of an output of said parallax calculator; and a parallax controller for performing control so that said depthwise center position is reproduced near a boundary of a viewer's fusional limit, and so that a moving distance of a right image and a left image becomes smallest, thereby reducing the three-dimensional distortion of the displayed image.