Stereoscopic image generating system for substantially matching visual range with vergence distance

Claim 2

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant.

Claim 3

An apparatus according to claim 1, wherein said two-dimensional image data control means sets control directions for the first and second two-dimensional image data to opposite directions.

Claim 4

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two-dimensional image data control means sets a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU35## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image as 2.

Claim 5

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two-dimensional image data control means sets a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU35## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image as 2.

Claim 6

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein the first and second two-dimensional image data control means are stereoscopically observed in a visual range L Base , and said two-dimensional image data control means sets a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU36## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image as 2.

Claim 7

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein the first and second two-dimensional image data control means are stereoscopically observed in a visual range L Base , and said two-dimensional image data control means sets a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU36## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image as 2.

Claim 8

An apparatus according to claim 1, wherein the specific object is an object whose distance to each of the first and second viewpoints changes with time.

Claim 9

An apparatus according to claim 1, wherein said two-dimensional image data control means changes a control amount in accordance with a distance L obj from the specific object to each of the first and second viewpoints in a direction of depth.

Claim 10

An apparatus according to claim 1, further comprising a head-mounted display including: first and second display elements for receiving the first and second two-dimensional image data controlled by said two-dimensional image data control means to display images according to the first and second two-dimensional image data; and first and second eyepiece optical systems for enlarging and presenting the images displayed by said first and second display elements to first and second eyeballs of an observer, respectively.

Claim 11

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, further comprising: specific object setting means for setting, as the specific object, an object of the plurality of objects which is located in a central 50% range of horizontal field angles of said first and second rendering means and closest to said first and second rendering means.

Claim 12

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, further comprising: specific object setting means for setting, as the specific object, an object of the plurality of objects which is located in a central 50% range of horizontal field angles of said first and second rendering means and closest to said first and second rendering means.

Claim 13

An apparatus according to claim 1, wherein said two-dimensional image data control means includes image data shift means for horizontally shifting the first and second two-dimensional image data in accordance with the distance from the specific object to each of the first and second viewpoints.

Claim 14

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a horizontal shift amount S thereof satisfies the following condition: ##EQU37## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj is the distance from the specific object to the middle point, θ is the half field angle of each of said first and second rendering means, and P H-half is the half of the number of horizontal pixels of the second two-dimensional image.

Claim 15

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a horizontal shift amount S thereof satisfies the following condition: ##EQU37## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj is the distance from the specific object to the middle point, θ is the half field angle of each of said first and second rendering means, and P H-half is the half of the number of horizontal pixels of the second two-dimensional image.

Claim 16

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a horizontal shift amount S thereof satisfies the following condition: ##EQU38## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj is the distance from the specific object to the middle point, 0 is the half field angle of each of said first and second rendering means, P H-half is the half of the number of horizontal pixels of the second two-dimensional image, α and β are the minimum and maximum values of original vergence values 1000/L obj as values each obtained by multiplying a reciprocal of a distance from the specific object to each of said first and second rendering means in a direction of depth with 1,000, and γ is the half of the change amount of converted vergence 1000/L Tag and satisfies 0≦γ<2 and γ≦1000 L Base .

Claim 17

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a horizontal shift amount S thereof satisfies the following condition: ##EQU38## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj is the distance from the specific object to the middle point, 0 is the half field angle of each of said first and second rendering means, P H-half is the half of the number of horizontal pixels of the second two-dimensional image, α and β are the minimum and maximum values of original vergence values 1000/L obj as values each obtained by multiplying a reciprocal of a distance from the specific object to each of said first and second rendering means in a direction of depth with 1,000, and γ is the half of the change amount of converted vergence 1000/L Tag and satisfies 0≦γ<2 and γ≦1000 L Base .

Claim 18

An apparatus according to claim 9, wherein a shift amount S of said image data shift means changes in accordance with an ordinal image frame number.

Claim 19

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two-dimensional image data control means includes image data shift means for horizontally shifting the first and second two-dimensional image data in accordance with the distance from the specific object to each of the first and second viewpoints, and further, wherein said image data shift means comprises image data extraction means for partially extracting image data upon shifting image data.

Claim 20

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two-dimensional image data control means includes image data shift means for horizontally shifting the first and second two-dimensional image data in accordance with the distance from the specific object to each of the first and second viewpoints, and further, wherein said image data shift means comprises image data extraction means for partially extracting image data upon shifting image data.

Claim 21

An apparatus according to claim 1, wherein said two-dimensional image data control means includes gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distance from the specific object to each of the first and second viewpoints.

Claim 22

A stereoscopic image generating apparatus comprising: storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two dimensional image data control means includes gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distance from the specific object to each of the first and second viewpoints, and further wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a gazing direction angle ψ of each of said first and second rendering means satisfies the following condition: ##EQU39## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, and ω is the angle between each of the first and second viewpoints and a line segment obtained by connecting a corresponding one of the first and second viewpoints and the specific object.

Claim 23

A stereoscopic image generating apparatus comprising: storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two dimensional image data control means includes gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distance from the specific object to each of the first and second viewpoints, and further wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a gazing direction angle ψ of each of said first and second rendering means satisfies the following condition: ##EQU39## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, and ω is the angle between each of the first and second viewpoints and a line segment obtained by connecting a corresponding one of the first and second viewpoints and the specific object.

Claim 24

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two dimensional image data control means includes gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distance from the specific object to each of the first and second viewpoints, and further wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a gazing direction angle ψ of each of said first and second rendering means satisfies the following condition: ##EQU40## for ##EQU41## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj is the distance from the specific object to the middle point, ω is the angle between each of the first and second viewpoints and a line segment obtained by connecting a corresponding one of the first and second viewpoints and the specific object, α and β are the minimum and maximum values of original vergence values 1000/L obj as values each obtained by multiplying a reciprocal of a distance from the specific object to each of said first and second rendering means in a direction of depth with 1,000, and γ is the half of the change amount of converted vergence 1000/L Tag and satisfies 0≦γ<2 and γ≦1000/L Base .

Claim 25

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two dimensional image data control means includes gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distance from the specific object to each of the first and second viewpoints, and further wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a gazing direction angle ψ of each of said first and second rendering means satisfies the following condition: ##EQU40## for ##EQU41## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj is the distance from the specific object to the middle point, ω is the angle between each of the first and second viewpoints and a line segment obtained by connecting a corresponding one of the first and second viewpoints and the specific object, α and β are the minimum and maximum values of original vergence values 1000/L obj as values each obtained by multiplying a reciprocal of a distance from the specific object to each of said first and second rendering means in a direction of depth with 1,000, and γ is the half of the change amount of converted vergence 1000/L Tag and satisfies 0≦γ<2 and γ≦1000/L Base .

Claim 26

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two dimensional image data control means includes gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distance from the specific object to each of the first and second viewpoints, and further wherein said gazing directions of said first and second rendering means which are controlled by said gazing direction control means are changed in accordance with an ordinal image frame number.

Claim 27

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and two dimensional image data control means for controlling to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said first and second rendering means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant, wherein said two dimensional image data control means includes gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distance from the specific object to each of the first and second viewpoints, and further wherein said gazing directions of said first and second rendering means which are controlled by said gazing direction control means are changed in accordance with an ordinal image frame number.

Claim 28

A stereoscopic image generating apparatus for generating moving pictures of left and right viewpoints, comprising: rendering means for rendering a plurality of images including at least one image whose size changes with time in each of the moving pictures of the left and right viewpoints, so that the plurality of images have a parallax; first image control means for controlling to translate one specific image of the images whose sizes change with time and which are rendered by said rendering means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the moving pictures of the left and right viewpoints is set substantially constant; and second image control means for controlling to translate remaining images of each of the moving pictures of the left and right viewpoints with respect to said one specific image in accordance with a change in size of said one specific image rendered by said rendering means.

Claim 29

A stereoscopic image generating apparatus for generating moving pictures of left and right viewpoints, comprising: rendering means for rendering a plurality of images including at least one image whose size changes with time in each of the moving pictures of the left and right viewpoints, so that the plurality of images have a parallax; first image control means for controlling to translate one specific image of the images whose sizes change with time and which are rendered by said rendering means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the moving pictures of the left and right viewpoints is set substantially constant; and second image control means for controlling to translate remaining images of each of the moving pictures of the left and right viewpoints with respect to said one specific image in accordance with a change in size of said one specific image rendered by said rendering means.

Claim 30

An apparatus according to claim 18, wherein said first and second image control means control translation such that said one specific image is relatively separated from the remaining images when said one specific image of the images whose size changes with time is enlarged with time, and said one specific image is made to relatively come close to the remaining images when said one specific image of the images whose size changes with time is reduced with time.

Claim 31

An apparatus according to claim 18, wherein said first and second image control means do not change relative horizontal positions of said one specific image of the images whose size changes with time in translation control of moving pictures of the left and right viewpoints.

Claim 32

A stereoscopic image generating apparatus for generating first and second moving pictures having different viewpoints, comprising: rendering means for rendering a plurality of images including at least one image whose size changes with time in each of the first and second moving pictures, so that the plurality of images have a parallax; first image control means for controlling one specific image of the images whose sizes change with time and which are rendered by said rendering means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the first and second moving pictures is set substantially constant; and second image control means for controlling remaining images of each of the first and second moving pictures, so that a difference in the remaining images of each of the first and second moving pictures between horizontal displacement amounts from the centers of the first and second moving pictures is changed, wherein said first and second image control means control translation such that said one specific image is relatively separated from the remaining images when said one specific image of the images whose size changes with time is enlarged with time, and said one specific image is made to relatively come close to the remaining images when said one specific image of the images whose size changes with time is reduced with time.

Claim 33

A stereoscopic image generating apparatus for generating first and second moving pictures having different viewpoints, comprising: rendering means for rendering a plurality of images including at least one image whose size changes with time in each of the first and second moving pictures, so that the plurality of images have a parallax; first image control means for controlling one specific image of the images whose sizes change with time and which are rendered by said rendering means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the first and second moving pictures is set substantially constant; and second image control means for controlling remaining images of each of the first and second moving pictures, so that a difference in the remaining images of each of the first and second moving pictures between horizontal displacement amounts from the centers of the first and second moving pictures is changed, wherein said first and second image control means control translation such that said one specific image is relatively separated from the remaining images when said one specific image of the images whose size changes with time is enlarged with time, and said one specific image is made to relatively come close to the remaining images when said one specific image of the images whose size changes with time is reduced with time.

Claim 34

An apparatus according to claim 21, wherein said first and second image control means control translation such that said one specific image is relatively separated from the remaining images when said one specific image of the images whose size changes with time is enlarged with time, and said one specific image is made to relatively come close to the remaining images when said one specific image of the images whose size changes with time is reduced with time.

Claim 35

An apparatus according to claim 21, wherein said first and second image control means do not change relative horizontal positions of said one specific image of the images whose size changes with time in translation control of moving pictures of the left and right viewpoints.

Claim 36

A stereoscopic image generating apparatus comprising: storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; first two-dimensional image data control means for controlling to translate all the first two-dimensional data generated by said first rendering means; and second two-dimensional image data control means for controlling to translate all the second two-dimensional image data from said second rendering means in a movement amount different from a translation amount of said first two-dimensional image data control means.

Claim 37

A stereoscopic image generating apparatus comprising: storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; first two-dimensional image data control means for controlling to translate all the first two-dimensional data generated by said first rendering means; and second two-dimensional image data control means for controlling to translate all the second two-dimensional image data from said second rendering means in a movement amount different from a translation amount of said first two-dimensional image data control means.

Claim 38

An apparatus according to claim 24, wherein said first and second two-dimensional image data control means set control directions for the first and second two-dimensional image data to opposite directions.

Claim 39

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; first two-dimensional image data control means for controlling to translate all the first two-dimensional data generated by said first rendering means; and second two-dimensional image data control means for controlling to translate all the second two-dimensional image data from said second rendering means in a movement amount different from a translation amount of said first two-dimensional image data control means, wherein said first and second two-dimensional image data control means set a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU42## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second, rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image as 2.

Claim 40

A stereoscopic image generating apparatus comprising; storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, motion data of the plurality of objects in the three dimensional coordinate system, and position data of first and second viewpoints in the three dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; first two-dimensional image data control means for controlling to translate all the first two-dimensional data generated by said first rendering means; and second two-dimensional image data control means for controlling to translate all the second two-dimensional image data from said second rendering means in a movement amount different from a translation amount of said first two-dimensional image data control means, wherein said first and second two-dimensional image data control means set a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU42## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second, rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image as 2.

Claim 41

An apparatus according to claim 24, wherein the first and second two-dimensional image data controlled by said first and second two-dimensional image data control means are stereoscopically observed in a vidual range L Base , and said first and second two-dimensional image data control means set a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU43## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image as 2.

Claim 42

A stereoscopic image generating apparatus comprising: storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; first two-dimensional image data control means for controlling to translate all the first two-dimensional data generated by said first rendering means, and second two-dimensional image data control means for controlling to translate image data from said second rendering means in a movement amount different from a translation amount of said first two-dimensional image data control means, wherein the first and second two-dimensional image data controlled by said first and second two-dimensional image data control means are stereoscopically observed in a visual range L Base , and said first and second two-dimensional image data control means set a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU44## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image of 2.

Claim 43

A stereoscopic image generating apparatus comprising: storage means for storing three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system; first rendering means for generating, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; second rendering means for generating, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; first two-dimensional image data control means for controlling to translate all the first two-dimensional data generated by said first rendering means, and second two-dimensional image data control means for controlling to translate image data from said second rendering means in a movement amount different from a translation amount of said first two-dimensional image data control means, wherein the first and second two-dimensional image data controlled by said first and second two-dimensional image data control means are stereoscopically observed in a visual range L Base , and said first and second two-dimensional image data control means set a change amount Δ(x 1 -x 2 ) in an entire image of the difference (x 1 -x 2 ) between the horizontal displacement amount x 1 of the specific object on the first two-dimensional image and the horizontal displacement amount x 2 of the specific object on the second two-dimensional image to satisfy the following condition: ##EQU44## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, θ is the half field angle of each of said first and second rendering means, x 1 and x 2 are the horizontal displacement amounts obtained by normalizing a horizontal distance of the entire two-dimensional image of 2.

Claim 44

An apparatus according to claim 26, wherein said first and second two-dimensional image data control means change control amounts in accordance with distances L obj from the specific objects on the first and second two-dimensional images to the first and second viewpoints in a direction of depth.

Claim 45

An apparatus according to claim 24, further comprising a head-mounted display including: first and second display elements for receiving the first and second two-dimensional image data controlled by said first and second two-dimensional image data control means to display images according to the first and second two-dimensional image data; and first and second eyepiece optical systems for enlarging and presenting the images displayed by said first and second display elements to first and second eyeballs of an observer, respectively.

Claim 46

An apparatus according to claim 26, further comprising: specific object setting means for setting, as the specific objects on the first and second two-dimensional images, objects of the plurality of objects which are located in central 50% ranges of horizontal field angles of said first and second rendering means and closest to said first and second rendering means.

Claim 47

An apparatus according to claim 26, wherein said first and second two-dimensional image data control means include image data shift means for horizontally shifting the first and second two-dimensional image data in accordance with the distances from the specific objects on the first and second two-dimensional images to the first and second viewpoints.

Claim 48

An apparatus according to claim 26, wherein the first and second two-dimensional images controlled by said first and second two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a horizontal shift amount S thereof satisfies the following condition: ##EQU45## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj are the distances from the specific objects on the first and second two-dimensional images to the middle point, θ is the half field angle of each of said first and second rendering means, and P H-half is the half of the number of horizontal pixels of the second two-dimensional image.

Claim 49

An apparatus according to claim 26, wherein the first and second two-dimensional images controlled by said two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a horizontal shift amount S thereof satisfies the following condition and equation: ##EQU46## for ##EQU47## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj are the distances from the specific objects on the first and second two-dimensional images to the middle point, θ is the half field angle of each of said first and second rendering means, P H-half is the half of the number of horizontal pixels of each of the first and second two-dimensional image, α and β are the minimum and maximum values of original vergence values 1000/L obj as values each obtained by multiplying a reciprocal of a distance from the specific object to each of said first and second rendering means in a direction of depth with 1,000, and γ is the half of the change amount of converted vergence 1000/L Tag and satisfies 0≦γ≦2 and γ≦1000/L Base .

Claim 50

An apparatus according to claim 32, wherein a shift amount S of each of said image data shift means changes in accordance with an ordinal image frame number.

Claim 51

An apparatus according to claim 32, wherein said image data shift means comprises image data extraction means for partially extracting image data upon shifting image data.

Claim 52

An apparatus according to claim 26, wherein said first and second two-dimensional image data control means include gazing direction control means for changing gazing directions of said first and second rendering means in accordance with the distances from the specific objects on the first and second two-dimensional images to the first and second viewpoints.

Claim 53

An apparatus according to claim 37, wherein the first and second two-dimensional images controlled by said first and second two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a gazing direction angle ψ of each of said first and second rendering means satisfies the following condition: ##EQU48## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, and ω is the angles between the first and second viewpoints and line segments obtained by connecting the first and second viewpoints and the specific objects on the first and second two-dimensional images.

Claim 54

An apparatus according to claim 37, wherein the first and second two-dimensional images controlled by said first and second two-dimensional image data control means are stereoscopically observed in a visual range L Base , and a gazing direction angle ψ of each of said first and second rendering means satisfies the following condition and equation: ##EQU49## for ##EQU50## where d is the distance between each of the first and second viewpoints and a middle point between the first and second viewpoints, L obj are the distances from the specific objects on the first and second two-dimensional images to the middle point, ω are the angles between the first and second viewpoints and line segments obtained by connecting the first and second viewpoints and the specific objects on the first and second two-dimensional images, α and β are the minimum and maximum values of original vergence values 1000/L obj as values each obtained by multiplying a reciprocal of a distance from each specific object to each of said first and second rendering means in a direction of depth with 1,000, and γ is the half of the change amount of converted vergence 1000/L Tag and satisfies 0≦γ≦2 and γ≦1000/L Base .

Claim 55

An apparatus according to claim 37, wherein said gazing directions of said first and second rendering means which are controlled by said gazing direction control means are changed in accordance with an ordinal image frame number.

Claim 56

An article of manufacture comprising computer readable storage medium having computer readable program code means, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to store three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system in storage means; second computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; third computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and fourth computer readable program means for causing said computer to control to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said computer in accordance with said second and third computer readable program means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant.

Claim 57

An article of manufacture comprising computer readable storage medium having computer readable program code means, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to store three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system in storage means; second computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; third computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; and fourth computer readable program means for causing said computer to control to translate all two-dimensional image data of at least one of the first and second two-dimensional image data which are obtained by said computer in accordance with said second and third computer readable program means for a specific object arbitrarily selected from the plurality of objects, so that a difference between horizontal displacement amounts from the centers of the first and second two-dimensional image data is set substantially constant.

Claim 58

An article of manufacture comprising a computer readable storage medium having computer readable program code means recorded to execute processing for generating moving pictures of left and right viewpoints, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to render a plurality of images including at least one image whose size changes with time in each of the moving pictures of the left and right viewpoints, so that the plurality of images have a parallax; second computer readable program means for causing said computer to control to translate one specific image of the images whose sizes change with time and which are rendered by said computer in accordance with said first computer readable program means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the moving pictures of the left and right viewpoints is set substantially constant; and third computer readable program means for causing said computer to control to translate remaining images of each of the moving pictures of the left and right viewpoints with respect to said one specific image in accordance with a change in size of said one specific image rendered by said computer in accordance with said first computer readable program means.

Claim 59

An article of manufacture comprising a computer readable storage medium having computer readable program code means recorded to execute processing for generating moving pictures of left and right viewpoints, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to render a plurality of images including at least one image whose size changes with time in each of the moving pictures of the left and right viewpoints, so that the plurality of images have a parallax; second computer readable program means for causing said computer to control to translate one specific image of the images whose sizes change with time and which are rendered by said computer in accordance with said first computer readable program means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the moving pictures of the left and right viewpoints is set substantially constant; and third computer readable program means for causing said computer to control to translate remaining images of each of the moving pictures of the left and right viewpoints with respect to said one specific image in accordance with a change in size of said one specific image rendered by said computer in accordance with said first computer readable program means.

Claim 60

An article of manufacture comprising a computer readable storage medium having computer readable program code means recorded to execute processing for generating first and second moving pictures having different viewpoints, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to render a plurality of images including at least one image whose size changes with time in each of the first and second moving pictures, so that the plurality of images have a parallax; second computer readable program means for causing said computer to control one specific image of the images whose sizes change with time and which are rendered by said computer in accordance with said first computer readable program means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the first and second moving pictures is set substantially constant; and third computer readable program means for causing said computer to control remaining images of each of the first and second moving pictures, so that a difference in the remaining images of each of the first and second moving pictures between horizontal displacement amounts from the centers of the first and second moving pictures is changed.

Claim 61

An article of manufacture comprising a computer readable storage medium having computer readable program code means recorded to execute processing for generating first and second moving pictures having different viewpoints, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to render a plurality of images including at least one image whose size changes with time in each of the first and second moving pictures, so that the plurality of images have a parallax; second computer readable program means for causing said computer to control one specific image of the images whose sizes change with time and which are rendered by said computer in accordance with said first computer readable program means, so that a difference in said one specific image between horizontal displacement amounts from the centers of the first and second moving pictures is set substantially constant; and third computer readable program means for causing said computer to control remaining images of each of the first and second moving pictures, so that a difference in the remaining images of each of the first and second moving pictures between horizontal displacement amounts from the centers of the first and second moving pictures is changed.

Claim 62

An article of manufacture comprising a computer readable storage medium having computer readable program code means recorded to execute processing for generating a stereoscopic image, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to store three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system; second computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; third computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; fourth computer readable program means for causing said computer to control to translate all the first two-dimensional data generated by said computer in accordance with said second computer readable program means; and fifth computer readable program means for causing said computer to control to translate all the second two-dimensional image data from said computer in accordance with said third computer readable program means in a movement amount different from a translation amount controlled by said computer in accordance with said fourth computer readable program means.

Claim 63

An article of manufacture comprising a computer readable storage medium having computer readable program code means recorded to execute processing for generating a stereoscopic image, wherein said computer readable program code means comprises: first computer readable program means for causing a computer to store three-dimensional shape data of a plurality of objects, initial position data of the plurality of objects in a three-dimensional coordinate system, motion data of the plurality of objects in the three-dimensional coordinate system, and position data of first and second viewpoints in the three-dimensional coordinate system; second computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, first two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the first viewpoint; third computer readable program means for causing said computer to generate, on the basis of the data stored in said storage means, second two-dimensional image data obtained by rendering the plurality of objects in the three-dimensional coordinate system from the second viewpoint; fourth computer readable program means for causing said computer to control to translate all the first two-dimensional data generated by said computer in accordance with said second computer readable program means; and fifth computer readable program means for causing said computer to control to translate all the second two-dimensional image data from said computer in accordance with said third computer readable program means in a movement amount different from a translation amount controlled by said computer in accordance with said fourth computer readable program means.