Image processing apparatus, method and system

Claim 2

An apparatus according to Claim 1, wherein said processing means moves, adds, deletes or changes at least one of the shape data and the light space data.

Claim 3

An apparatus according to Claim 1, wherein the another information processing apparatus is a data distributing apparatus for distributing data to plural image processing apparatuses.

Claim 4

An apparatus according to Claim 1, wherein the another information processing apparatus is an image processing apparatus having the same function as that of said image processing apparatus.

Claim 5

An apparatus according to Claim 1, further comprising: position and direction data memory means for storing data representing a viewpoint position and a sight-line direction of a user of said image processing apparatus in the virtual three-dimensional space, and wherein said displaying means displays the virtual three-dimensional space based on the data representing the viewpoint position and the sight-line direction stored in said position and direction data memory means.

Claim 6

An apparatus according to Claim 5, wherein said transmitting means transmits the indication information generated by said indication information generating means, and also transmits the data representing the viewpoint position and the sight-line direction stored in said position and direction data memory means.

Claim 7

An apparatus according to Claim 1, wherein three-dimensional image data led from two-dimensional multi-viewpoint images is used instead of the light space data.

Claim 8

An apparatus according to Claim 1, wherein, in the processing by said processing means, said re-displaying means discriminatingly displays the shape data or the light space data being the object of the processing.

Claim 9

An image processing apparatus comprising: tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image; displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said tree-structure data memory means; receiving means for receiving indication information indicating a changing content of the tree-structure data, transmitted from an another information processing apparatus connected to said image processing apparatus; changing means for changing the tree-structure data stored in said tree-structure data memory means, based on the indication information received by said receiving means; and re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said changing means.

Claim 10

An apparatus according to Claim 9, wherein the changing content indicated by the indication information received by said receiving means is to move, add, delete or change at least one of the shape data and the light space data.

Claim 11

An apparatus according to Claim 9, wherein the another information processing apparatus is a data distributing apparatus for distributing data to plural image processing apparatuses.

Claim 12

An apparatus according to Claim 9, wherein the another information processing apparatus is an image processing apparatus having the same function as that of said image processing apparatus.

Claim 13

An apparatus according to Claim 9, wherein said receiving means receives the indication information indicating the changing content of the tree-structure data, and also receives data representing a viewpoint position and a sight-line direction of a user of the another image processing apparatus in the virtual three-dimensional space.

Claim 14

An apparatus according to Claim 13, further comprising data generating means for generating data representing a virtual model of the user of the another image processing apparatus in the virtual three-dimensional space, based on the data representing the viewpoint position and the sight-line direction received by said receiving means, and wherein said re-displaying means displays the virtual model of the user of the another image processing apparatus, in the virtual three-dimensional space.

Claim 15

An apparatus according to Claim 9, wherein three-dimensional image data led from two-dimensional multi-viewpoint images is used instead of the light space data.

Claim 16

An apparatus according to Claim 9, wherein said re-displaying means discriminatingly displays the shape data or the light space data being the object of the processing, based on the indication information received by said receiving means and indicating the changing content in the tree-structure data.

Claim 17

An image processing method which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, said method comprising: a displaying step of displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means; a processing step of processing at least one of the shape data and the light space data both displayed; a changing step of changing the tree-structure data stored in the tree-structure data memory means, based on the processing content in said processing step; a re-displaying step of re-displaying the virtual three-dimensional space, based on the data changing content in said changing step; an indication information generating step of generating indication information indicating the changing content of the tree-structure data, based on the processing content in said processing step; and a transmitting step of transmitting the indication information generated in said indication information generating step to an another information processing apparatus connected to the image processing apparatus.

Claim 18

A method according to Claim 17, wherein in said processing step at least one of the shape data and the light space data is moved, added, deleted or changed.

Claim 19

A method according to Claim 17, wherein the another information processing apparatus is a data distributing apparatus for distributing data to plural image processing apparatuses.

Claim 20

A method according to Claim 17, wherein the another information processing apparatus is an image processing apparatus having the same function as that of the above-described image processing apparatus.

Claim 21

A method according to Claim 17, wherein the image processing apparatus further comprises a position and direction data memory means for storing data representing a viewpoint position and a sight-line direction of a user of the image processing apparatus in the virtual three-dimensional space, and in said displaying step the virtual three-dimensional space is displayed based on the data representing the viewpoint position and the sight-line direction stored in the position and direction data memory means.

Claim 22

A method according to Claim 21, wherein, in said transmitting step, the indication information generated in said indication information generating step is transmitted, and also the data representing the viewpoint position and the sight-line direction stored in the position and direction data memory means is transmitted.

Claim 23

A method according to Claim 17, wherein three-dimensional image data led from two-dimensional multi-viewpoint images is used instead of the light space data.

Claim 24

A method according to Claim 17, wherein, in said re-displaying step, the shape data or the light space data being the object of the processing in said processing step is discriminatingly displayed.

Claim 25

An image processing method which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, said method comprising: a displaying step of displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means; a receiving step of receiving indication information indicating a changing content of the tree-structure data, transmitted from an another information processing apparatus connected to the image processing apparatus; a changing step of changing the tree-structure data stored in the tree-structure data memory means, based on the indication information received in said receiving step; and a re-displaying step of re-displaying the virtual three-dimensional space, based on the data changing content in said changing step.

Claim 26

A method according to Claim 25, wherein the changing content indicated by the indication information received in said receiving step is to move, add, delete or change at least one of the shape data and the light space data.

Claim 27

A method according to Claim 25, wherein the another information processing apparatus is a data distributing apparatus for distributing data to plural image processing apparatuses.

Claim 28

A method according to Claim 25, wherein the another information processing apparatus is an image processing apparatus having the same function as that of the above-described image processing apparatus.

Claim 29

A method according to Claim 25, wherein, in said receiving step, the indication information indicating the changing content of the tree-structure data is received, and also data representing a viewpoint position and a sight-line direction of a user of the another image processing apparatus in the virtual three-dimensional space is received.

Claim 30

A method according to Claim 29, further comprising a data generating step of generating data representing a virtual model of the user of the another image processing apparatus in the virtual three-dimensional space, based on the data representing the viewpoint position and the sight-line direction received in said receiving step, and wherein in said re-displaying step the virtual model of the user of the another image processing apparatus is displayed in the virtual three-dimensional space.

Claim 31

A method according to Claim 25, wherein three-dimensional image data led from two-dimensional multi-viewpoint images is used instead of the light space data.

Claim 32

A method according to Claim 25, wherein in said re-displaying step the shape data or the light space data being the object of the changing in said changing step is discriminatingly displayed based on the indication information received in said receiving step and indicating the changing content in the tree-structure data.

Claim 33

A computer-readable memory medium which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, and which stores a computer program including: a displaying module for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means; a processing module for processing at least one of the shape data and the light space data both displayed; a changing module for changing the tree-structure data stored in the tree-structure data memory means, based on the processing content; a re-displaying module for re-displaying the virtual three-dimensional space, based on the data changing content; an indication information generating module for generating indication information indicating the changing content of the tree-structure data, based on the processing content; and a transmitting module for transmitting the generated indication information to an another information processing apparatus connected to the image processing apparatus.

Claim 34

A computer-readable memory medium which is used in an image processing apparatus comprising a tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, and which stores a computer program including: a displaying module for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in the tree-structure data memory means; a receiving module for receiving indication information indicating a changing content of the tree-structure data, transmitted from an another information processing apparatus connected to the image processing apparatus; a changing module for changing the tree-structure data stored in.the tree-structure data memory means, based on the received indication information; and a re-displaying module for re-displaying the virtual three-dimensional space, based on the data changing content.

Claim 35

An image processing system in which a first terminal equipment is connected to a second terminal equipment through a server, comprising: said first terminal equipment further comprising, first tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, first displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said first tree-structure data memory means, processing means for processing at least one of the shape data and the light space data both displayed, first changing means for changing the tree-structure data stored in said first tree-structure data memory means, based on the processing content by said processing means, first re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said first changing means, indication information generating means for generating indication information indicating the changing content of the tree-structure data, based on the processing content by said processing means, and first transmitting means for transmitting the indication information generated by said indication information generating means to said server connected to said first terminal equipment; said server further comprising, first receiving means for receiving the indication information transmitted from said first terminal equipment, and second transmitting means for transmitting the indication information received by said first receiving means to said second terminal equipment; and said second terminal equipment further comprising, second tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, second displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said second tree-structure data memory means, second receiving means for receiving the indication information indicating the changing content of the tree-structure data, transmitted from said server connected to said second terminal equipment, second changing means for changing the tree-structure data stored in said second tree-structure data memory means, based on the indication information received by said second receiving means, and second re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said second changing means.

Claim 36

An image processing system in which a first terminal equipment and a second terminal equipment are connected to each other, comprising: said first terminal equipment further comprising, first tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, first displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said first tree-structure data memory means, processing means for processing at least one of the shape data and the light space data both displayed, first changing means for changing the tree-structure data stored in said first tree-structure data memory means, based on the processing content by said processing means, first re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said first changing means, indication information generating means for generating indication information indicating the changing content of the tree-structure data, based on the processing content by said processing means, and transmitting means for transmitting the indication information generated by said indication information generating means to said second terminal equipment connected to said first terminal equipment; and said second terminal equipment further comprising, second tree-structure data memory means for storing tree-structure data, the tree-structure data including as components shape data geometrically describing a three-dimensional space and a three-dimensional object and light space data describing the three-dimensional space and the three-dimensional object based on a real-photographed image, second displaying means for displaying a virtual three-dimensional space in which the shape data and the light space data are mixed with each other, based on the tree-structure data stored in said second tree-structure data memory means, receiving means for receiving the indication information indicating the changing content of the tree-structure data, transmitted from said first terminal equipment connected to said second terminal equipment, second changing means for changing the tree-structure data stored in said second tree-structure data memory means, based on the indication information received by said receiving means, and second re-displaying means for re-displaying the virtual three-dimensional space, based on the data changing content by said second changing means.

Claim 37

A computer-graphics system comprising first and second interconnected processing apparatus, each having: a memory storing shape data defining the surface of a first three-dimensional object, light space data defining a second three-dimensional object, and data defining a hierarchical tree structure between the first and second objects; display means for displaying images of the objects in accordance with the stored data; and processing means for amending the stored data; wherein information defining amendments to the data in the first apparatus is transmitted to the second apparatus to cause corresponding changes therein.

Claim 38

A system according to claim 37, wherein the first and second processing apparatus are interconnected via a server, the server accessing a memory storing data corresponding to the data stored in the first and second apparatus.

Claim 39

Processing apparatus for use in a system according to claim 37 or 38, comprising: memory means for storing shape data defining the surface of a first three-dimensional object, light space data defining a second three-dimensional object, and data defining a hierarchical tree structure between the first and second objects; means for generating image data defining an image in accordance with data stored in the memory means; processing means for amending data stored in the memory means; and means for transmitting data defining amendments made by the processing means.

Claim 40

Processing apparatus for use in a system according to claim 37 or 38, comprising: memory means for storing shape data defining the surface of a first three-dimensional object, light space data defining a second three-dimensional object, and data defining a hierarchical tree structure between the first and second objects; means for generating image data defining an image in accordance with data stored in the memory means; means for receiving data defining amendments to be made to the data; and means for amending the data stored in the memory means in accordance with the received data.

Claim 41

A computer graphics system comprising: memory means storing shape data defining the surface of a first three-dimensional object, light space data defining a second three-dimensional object and data defining a hierarchical tree structure between the first and second objects; first processing apparatus connected to the memory means, having display means for displaying images of the objects in accordance with the stored data, and means for amending the stored data; and second processing apparatus connected to the memory means, having display means for displaying images of the objects in accordance with the stored data, and means for amending the stored data; wherein information defining amendments to the stored data made by the first apparatus is transmitted to the second apparatus.

Claim 42

Apparatus for use in a system according to claim 41, comprising: means for receiving shape data defining the surface of a first three-dimensional object, light space data defining a second three-dimensional object, and data defining a hierarchical tree structure between the first and second objects; means for generating image data defining an image in accordance with the received data; processing means for amending the data; and means for transmitting data defining amendments made by the processing means.

Claim 43

Apparatus for use in a system according to claim 41, comprising: means for receiving object data comprising shape data defining the surface of a first three-dimensional object, light space data defining a second three-dimensional object, and data defining a hierarchical tree structure between the first and second objects; means for generating image data defining an image in accordance with the received data; means for receiving data defining amendments to the object data; and means for generating amended image data in accordance with the received amendment data.

Claim 44

A storage device storing computer-readable instructions for causing a programmable processing apparatus to have the processing functions of an apparatus according to any of claims 39, 40, 42 and 43.

Claim 45

A signal conveying instructions for causing a programmable processing apparatus to have the processing functions of an apparatus according to any of claims 39, 40, 42 and 43.