Patent EP0804022A1 successfully refreshed from Google Patents.
← Back to Patent Explorer
EP0804022A1 Expired / Lapsed EP ⏱️ 0.0 years remaining

Device and method for processing image

Assignee: Sony Corp
•
Filing: 1996-11-14
•
Granted: —
•
Expires: 2016-11-14
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A device and method for mapping a plurality of images on a two-dimensional plane onto the corresponding faces of a body in a virtual three-dimensional space. A mapping image to be displayed on the side face of the body which is adjacent to the target image display face of the body on which the target image is mapped is generated in accordance with the shape of the target image display face. The images mapped onto the faces are moved according to the movement of the body in the three-dimensional space. Thus a picture is displayed on a screen as if the picture were stuck to the faces of the body moving in a virtual space according to a simple operation of the operator.

Inventors

  • 👤 Akihiro Takashima
  • 👤 Nobuyuki Minami
  • 👤 Kazuhiro Maruyama

Bibliographic Details

Application Number —
Jurisdiction EP
Data Source google_patents
Last Synchronized 2026-11-09 16:35
CPC Classifications
G; G06; G06T; G06T15/00; G06T15/10; H; H04; H04N; H04N5/00; H04N5/222; H04N5/262; H04N5/2628

Claims Analysis

Total Claims: 20
Claim 1
Independent Claim 221 words
An image processing apparatus comprising: first image forming means for forming an object image by writing a first image in a first memory and transforming said first image written in said first memory based on a first control data input from a predetermined control means; second image forming means for forming a first side image by writing a second image in a second memory and transforming said second image written in said second memory into the image having a shape in accordance with said object image based on a second control data input from said control means; third image forming means for forming a second side image by writing a third image in a third memory and transforming said third image written in said third memory into the image having a shape in accordance with said object image based on a third control data input from said control means; and control means for displacing said object image, said first side image, and said second side image in accordance with the movement of said solid in the three-dimensional space having said object image, said first side image, and said second side image on the corresponding predetermined faces, and for perspectively transforming on a predetermined screen surface said object image, said first side image, and said second side image mapped on said solid.
Claim 2
Dependent Claim 559 words
The image processing apparatus according to claim 1, wherein: a transformation matrix M A for mapping said object image on a predetermined face of said solid is expressed by the following equation: M A = L A · T rs where, L A :   a matrix for displacing the object image onto a predetermined face of the solid T rs :   a matrix for transforming the object image in accordance with the shape of the predetermined face of the solid; a transformation matrix M B for mapping said first side image on a predetermined face of said solid is expressed by the following equation: M B = L BO · S B · R Bx · R Bz · L B where, L BO :   a matrix for displacing the first side image onto a standard position S B :   a matrix for displacing the first side image in accordance with the shape of the mapping face of the object image R Bx :   a matrix for rotating the first side image for a predetermined angle for the object image R Bz :   a matrix for rotating the first side image for an angle in accordance with the shape of the face of which the object image is mapped L B :   a matrix for displacing the first side image to a predetermined position contacting with the face on which the object image of solid is mapped; a transformation matrix M B for mapping said first side image on a predetermined face of said solid is expressed by the following equation: M C = L CO · S C · R Cx · R Cz · L C where, L CO :   a matrix for displacing the second side image to a standard position S C :   a matrix for displacing the second side image in accordance with the shape of the mapping face of the object image R Cx :   a matrix for rotating the second side image for a predetermined angle for the object image R Cz :   a matrix for rotating the second side image for an angle in accordance with the shape of the face of which the object image is mapped L C :   a matrix for displacing the second side image to a predetermined position contacting with the face which the object image of solid is mapped; a transformation matrix T O for displacing said object image, said first side image, and said second side image in accordance with the movement of said solid is expressed by the following equation: where, r 11 to r 33 :   parameters for transforming respective images for x-, y-, and z-axis of the three-dimensional coordinates of xyz l x :   a parameter for displacing in parallel the image for x-axis l y :   a parameter for displacing in parallel the image for y-axis l z :   a parameter for displacing in parallel the image for z-axis s :   a parameter for magnifying or reducing the image in the x-, y-, and z-axis directions; a matrix P O for perspective-transforming on a predetermined screen surface said object image, said first side image, and said second side image mapped on said solid is expressed by the following equation: where, P z :   a perspective value at the time of perspective-transforming the solid in the three-dimensional space on the screen.
Claim 3
Dependent Claim 36 words
The image processing apparatus according to claim 2, wherein said transformation matrix T O is a matrix having three lines and three rows excluding parameters of third line and third row which are parameters of z-axis.
Claim 4
Dependent Claim 173 words
The image processing apparatus according to claim 2 or 3, wherein said object image to be mapped on a predetermined face of said solid is perspective-transformed on the screen by the transformation matrix T A expressed by the equation: T A = M A · T O · P O using said transformation matrixes M A , T O , and P O ; said first side image to be mapped on a predetermined face of said solid is perspective-transformed on the screen by the transformation matrix T B expressed by the equation: T B = M B · T O · P O using said transformation matrixes M B , T O , and P O ; and said second side image to be mapped on a predetermined face of said solid is perspective-transformed on the screen by the transformation matrix T C expressed by the equation: T C = M C · T O · P O using said transformation matrixes M C , T O , and P O .
Claim 5
Dependent Claim 138 words
The image processing apparatus according to claim 1, wherein said control means determines the back or front face of said object image, said first side image and said second side image which are mapped on respective faces of said solid; maps, on a face corresponding to said solid, the image having the front face as a result of said determination out of said object image, said first side image, and said second side image; maps, on the facing plane of a face corresponding to said solid, the image having the back face as a result of said determination out of said object image, said first side image, and said second side image; and controls said first side image and said second side image not to be displayed when said determination result is neither the back nor the front.
Claim 6
Dependent Claim 571 words
The image processing apparatus according to claim 5, wherein: a transformation matrix M A ' for mapping said object image on a facing plane of said solid is expressed by the following equation: M A ' = L A ' · T rs where, L A ' :   a matrix for displacing the object image onto a facing plane of the solid T rs :   a matrix for transforming the object image in accordance with the shape of the facing plane of the solid; a transformation matrix M B ' for mapping said first side image on a facing plane of said solid is expressed by the following equation: M B ' = L BO · S B · R Bx · R Bz · L B ' where, L BO :   a matrix for displacing the first side image onto a standard position S B :   a matrix for displacing the first side image in accordance with the shape of the mapping face of the object image R Bx :   a matrix for rotating the first side image for a predetermined angle for the object image R Bz :   a matrix for rotating the first side image for an angle in accordance with the shape of the face of which the object image is mapped L B ' :   a matrix for displacing the first side image onto a predetermined position contacting with the face on which the object image of solid is mapped; a transformation matrix M C for mapping said first side image on a facing plane of said solid is expressed by the following equation: M C ' = L CO · S C · R Cx · R Cz · L C ' where, L CO :   a matrix for moving the second side image to a standard position S C :   a matrix for displacing the second side image in accordance with the shape of the mapping face of the object image R Cx :   a matrix for rotating the second side image for a predetermined angle for the object image P Cz :   a matrix for rotating the second side image for an angle in accordance with the shape of the face of which the object image is mapped L C ' :   a matrix for displacing the second side image to a facing plane contacting with the face on which the object image of solid is mapped; a transformation matrix T O for displacing said object image, said first side image, and said second side image in accordance with the movement of said solid is expressed by the following equation: where, r 11 to r 33 :   parameters for transforming respective images for x-, y-, and z-axis of the three-dimensional coordinates of xyz l x :   a parameter for displacing in parallel the image for x-axis l y :   a parameter for displacing in parallel the image for y-axis l z :   a parameter for displacing in parallel the image for z-axis s :   a parameter for magnifying or reducing the image in the x-, y-, and z-axis directions; a matrix P O for perspective-transforming on a predetermined screen surface said object image, said first side image, and said second side image mapped on said solid is expressed by the following equation: where, P z :   a perspective value at the time of perspective-transforming the solid in the three-dimensional space on the screen.
Claim 7
Dependent Claim 69 words
The image processing apparatus according to claim 4, wherein said determination of the back or front is performed based on the values of respective matrix equations of the above-described transformation matrixes T A , T B , and T C for perspective-transforming on the screen said object image, said first side image, and said second side image, which are three-dimensionally transformed on respective corresponding predetermined faces of the solid.
Claim 8
Dependent Claim 119 words
The image processing apparatus according to claim 1, comprising: reduction rate priority mode for cutting out said object image, said first side image, and/or said second side image in a size corresponding to the mapping faces respectively, when said object image, said first side image, and/or said second side image are mapped on the corresponding faces of said solid respectively; and crop priority mode for reducing or magnifying the portion of previously cut out area of said object image, said first side image, and/or said second side image into a size corresponding to the mapping faces, when said object image, said first side image, and/or said second side image are mapped on the corresponding faces of said solid respectively.
Claim 9
Dependent Claim 41 words
The image processing apparatus according to claim 5, wherein said control means changes the front and back of the image of which said determined result is the back, when said image is mapped on said facing plane corresponding to said solid.
Claim 10
Dependent Claim 52 words
The image processing apparatus according to claim 2 or 3, wherein said object image written in said first memory, said first side image written in said second memory, and said second side image written in said third memory are read based on the inverse matrix of said transformation matrix T 0 respectively.
Claim 11
Dependent Claim 180 words
An image processing method comprising the steps of: forming an object image by writing a first image in a first memory to be image-transformed based on a first control data input from a predetermined control means; forming a first side image by writing a second image in a second memory to be image-transformed into the shape in accordance with said object image based on a second control data input from said control means; forming a second side image by writing a third image in a third memory to be image-transformed into the shape in accordance with said object image based on a third control data input from said control means; displacing said object image, said first side image, and said second side image in accordance with the movement in a three-dimensional space of a solid which has said object image, said first side image, and said second side image respectively on the predetermined faces; and perspectively transforming said object image, said first side image, and said second side image which are mapped on said solid on a predetermined screen surface.
Claim 12
Dependent Claim 560 words
The image processing method according to claim 11, wherein: a transformation matrix M A for mapping said object image on a predetermined face of said solid is expressed by the following equation: M A = L A · T rs where, L A :   a matrix for displacing the object image onto a predetermined face of the solid T rs :   a matrix for transforming the object image in accordance with the shape of the predetermined face of the solid; a transformation matrix M B for mapping said first side image on a predetermined face of said solid is expressed by the following equation: M B = L BO · S B · R Bx · R Bz · L B where, L BO :   a matrix for displacing the first side image to a standard position S B :   a matrix for moving the first side image in accordance with the shape of the mapping face of the object image R Bx :   a matrix for rotating the first side image for a predetermined angle for the object image R Bz :   a matrix for rotating the first side image for an angle in accordance with the shape of the face of which the object image is mapped L B :   a matrix for displacing the first side image onto a predetermined position contacting with the face on which the object image of solid is mapped; a transformation matrix M B for mapping said first side image on a predetermined face of said solid is expressed by the following equation: M C = L CO · S C · R Cx · R Cz · L C where, L CO :   a matrix for displacing the second side image onto a standard position S C :   a matrix for displacing the second side image in accordance with the shape of the mapping face of the object image R Cx :   a matrix for rotating the second side image for a predetermined angle for the object image R Cz :   a matrix for rotating the second side image for an angle in accordance with the shape of the face of which the object image is mapped L C :   a matrix for displacing the second side image to a predetermined position contacting with the face on which the object image of solid is mapped; a transformation matrix T O for displacing said object image, said first side image, and said second side image in accordance with the movement of said solid is expressed by the following equation: where, r 11 to r 33 :   parameters for transforming respective images for x-, y-, and z-axis of the three-dimensional coordinates of xyz l x :   a parameter for displacing in parallel the image for x-axis l y :   a parameter for displacing in parallel the image for y-axis l z :   a parameter for displacing in parallel the image for z-axis s :   a parameter for magnifying or reducing the image in the x-, y-, and z-axis directions; a matrix P O for perspective-transforming on a predetermined screen surface said object image, said first side image, and said second side image mapped on said solid is expressed by the following equation: where, P z :   a perspective value at the time of perspective-transforming the solid in the three-dimensional space on the screen.
Claim 13
Dependent Claim 36 words
The image processing method according to claim 12, wherein said transformation matrix T O is a matrix having three lines and three rows excluding parameters of third line and third row which are parameters of z-axis.
Claim 14
Dependent Claim 173 words
The image processing method according to claim 12 or 13, wherein said object image to be mapped on a predetermined face of said solid is perspective-transformed on the screen by the transformation matrix T A expressed by the equation: T A = M A · T O · P O using said transformation matrixes M A , T O , and P O ; said first side image to be mapped on a predetermined face of said solid is perspective-transformed on the screen by the transformation matrix T B expressed by the equation: T B = M B · T O · P O using said transformation matrixes M B , T O , and P O ; and said second side image to be mapped on a predetermined face of said solid is perspective-transformed on the screen by the transformation matrix T C expressed by the equation: T C = M C · T O · P O using said transformation matrixes M C , T O , and P O .
Claim 15
Dependent Claim 138 words
The image processing method according to claim 11, comprising the steps of: determining the back or front face of said object image, said first side image and said second side image which are mapped on respective faces of said solid; mapping, on a face corresponding to said solid, the image having the front face as a result of said determination out of said object image, said first side image, and said second side image; mapping, on the facing plane of a face corresponding to said solid, the image having the back face as a result of said determination out of said object image, said first side image, and said second side image; and controlling said first side image and said second side image not to be displayed when said determination result is neither the back nor the front.
Claim 16
Dependent Claim 571 words
The image processing method according to claim 15, wherein: a transformation matrix M A ' for mapping said object image on a facing plane of said solid is expressed by the following equation: M A ' = L A ' · T rs where, L A ' :   a matrix for displacing the object image onto a facing plane of the solid T rs :   a matrix for transforming the object image in accordance with the shape of the facing plane of the solid; a transformation matrix M B ' for mapping said first side image on a facing plane of said solid is expressed by the following equation: M B ' = L BO · S B · R Bx · R Bz · L B ' where, L BO :   a matrix for displacing the first side image onto a standard position S B :   a matrix for displacing the first side image in accordance with the shape of the mapping face of the object image R Bx :   a matrix for rotating the first side image for a predetermined angle for the object image R Bz :   a matrix for rotating the first side image for an angle in accordance with the shape of the face of which the object image is mapped L B ' :   a matrix for displacing the first side image onto a predetermined position contacting with the face on which the object image of solid is mapped; a transformation matrix M C for mapping said first side image on a facing plane of said solid is expressed by the following equation: M C ' = L CO · S C · R Cx · R Cz · L C ' where, L CO :   a matrix for displacing the second side image to a standard position S C :   a matrix for displacing the second side image in accordance with the shape of the mapping face of the object image R Cx :   a matrix for rotating the second side image for a predetermined angle for the object image R Cz :   a matrix for rotating the second side image for an angle in accordance with the shape of the face of which the object image is mapped L C ' :   a matrix for displacing the second side image to a facing plane contacting with the face on which the object image of solid is mapped; a transformation matrix T O for displacing said object image, said first side image, and said second side image in accordance with the movement of said solid is expressed by the following equation: where, r 11 to r 33 :   parameters for transforming respective images for x-, y-, and z-axis of the three-dimensional coordinates of xyz l x :   a parameter for displacing in parallel the image for x-axis l y :   a parameter for displacing in parallel the image for y-axis l z :   a parameter for displacing in parallel the image for z-axis s :   a parameter for magnifying or reducing the image in the x-, y-, and z-axis directions; a matrix P O for perspective-transforming on a predetermined screen surface said object image, said first side image, and said second side image mapped on said solid is expressed by the following equation: where, P z :   a perspective value at the time of perspective-transforming the solid in the three-dimensional space on the screen.
Claim 17
Dependent Claim 69 words
The image processing method according to claim 14, wherein said determination of the back or front is performed based on the values of respective matrix equations of the above-described transformation matrixes T A , T B , and T C for perspective-transforming on the screen said object image, said first side image, and said second side image, which are three-dimensionally transformed on respective corresponding predetermined faces of the solid.
Claim 18
Dependent Claim 119 words
The image processing method according to claim 11, comprising: reduction rate priority mode for cutting out said object image, said first side image, and/or said second side image in a size corresponding to the mapping faces respectively, when said object image, said first side image, and/or said second side image are mapped on the corresponding faces of said solid respectively; and crop priority mode for reducing or magnifying the portion of previously cut out area of said object image, said first side image, and/or said second side image into a size corresponding to the mapping faces, when said object image, said first side image, and/or said second side image are mapped on the corresponding faces of said solid respectively.
Claim 19
Dependent Claim 39 words
The image processing method according to claim 15, wherein the front and back of the image of which said determined result is the back is changed, when said image is mapped on said facing plane corresponding to said solid.
Claim 20
Dependent Claim 52 words
The image processing method according to claim 12 or 13, wherein said object image written in said first memory, said first side image written in said second memory, and said second side image written in said third memory are read based on the inverse matrix of said transformation matrix T 0 respectively.

References Cited (Backward Citations)

No citation records indexed.

USPTO Annuity & Maintenance Windows

Maintenance schedule is calculated for granted US utility patents.

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag