Method and system for synthesizing actual scene image and graphic image

Claim 2

An image data producing system comprising: a scene data storage unit in which a first video data from a first recording with a camera of a scene where a dummy object is moving is stored; a background data storage unit in which a second video data from a second recording with a camera of said scene where said dummy object is not present is stored; a calculating unit for determining an object movement data indicating movement of said dummy object based on said first video data; a model data producing unit for producing a third image data of a object model which has the same movement as that of said dummy object, based on said object movement data; and a synthesizing unit for synthesizing said second video data and said third image data to produce a fourth video data of said scene where said object model is moving.

Claim 3

An image data producing system according to claim 1 , further comprising a model data storage unit in which a design data of said object model is stored, and wherein said model data producing unit produces said third image data based on said object movement data and said design data of said object model.

Claim 4

An image data producing system according to claim 1 , wherein said dummy object has at least three indicators, and wherein said calculating unit calculates three-dimensional movement of said dummy object in said first video data based on positions of said at least three indicators in said first video data to produce said object movement data.

Claim 5

An image data producing system according to claim 1 , further comprising a reflection data storage unit in which a fifth image data of said scene in which said dummy object is not present and which is imaged by use of a fisheye lens is stored, and wherein said model data producing unit performs mapping said fifth image data on a portion of said third image data corresponding to a predetermined area of said object model.

Claim 6

An image data producing system according to claim 1 , further comprising a reflection data storage unit in which a fifth image data of said scene in which said dummy object is not present and which is imaged by use of a fisheye lens is stored, and wherein said synthesizing unit performs mapping said fifth image data on a portion of said fourth video data corresponding to a predetermined area of said object model.

Claim 7

An image data producing system according to claim 1 , further comprising: a camera which operates in response to operation control data; an instructing unit for generating said operation control data based on operations of a user; and a first storage processing unit for storing said first video data imaged by said camera in said scene data storage unit.

Claim 8

An image data producing system according to claim 6 , further comprising: a control data storage unit in which said operation control data is stored; and a second storage processing unit for controlling operations of said camera based on said operation control data stored in said control data storage unit when said dummy object is not present, and for storing said second image data video by said camera in said background data storage unit.

Claim 9

An image data producing system according to claim 7 , further comprising: a reflection data storage unit in which a fifth image data; a third storage processing unit for controlling said operation of said camera with a fish-eye lens based on said operation control data stored in said control data storage unit when said dummy object is not present, and for storing said fifth image data imaged by said camera in said reflection data storage unit, and wherein said synthesizing unit performs mapping of said fifth image data on a portion of said fourth video data corresponding to a predetermined area of said object model.

Claim 10

An image data producing system according to claim 6 , further comprising: an operation data storage unit in which operation data indicating operations of said camera is stored; and a second storage processing unit for controlling operations of said camera based on said operation data stored in said operation data storage unit when said dummy object is not present, and for storing said second video data imaged by said camera in said background data storage unit.

Claim 11

An image data producing system according to claim 9 , further comprising : a reflection data storage unit in which a fifth image data; and a third storage processing unit for controlling said operation of said camera with a fisheye lens based on said operation data stored in said operation data storage unit when said dummy object is not present, and for storing said fifth image data imaged by said camera in said reflection data storage unit, and wherein said synthesizing unit performs mapping of said fifth image data on a portion of said fourth video data corresponding to a predetermined area of said object model.

Claim 12

An image data producing system according to claim 1 , wherein said dummy object has indicators, and wherein said calculating unit determines an object movement data indicating movement of said dummy object based on said indicators of said dummy object of said first video data.

Claim 15

A method according to claim 12 , wherein said producing step includes: providing a shape data of said model object; and producing said third video data based on said object movement data and said shape data of said object model.

Claim 16

A method according to claim 12 , wherein said object has at least three indicators, and wherein said calculating step includes calculating three-dimensional movement of said dummy object in said first video data based on positions of said at least three indicators in said first video data to produce said object movement data.

Claim 17

A method according to claim 12 , further comprising the step of providing a fifth image data of said scene imaged by use of a fisheye lens, when said dummy object is not present, and wherein said synthesizing step further includes mapping said fifth image data on a portion of said fourth video data corresponding to a predetermined area of said object model.

Claim 18

A method according to claim 12 , further comprising the step of providing a fifth image data of said scene imaged by use of a fisheye lens, when said dummy object is not present, and wherein said producing step further includes mapping said fifth image data on a portion of said second image data corresponding to a predetermined area of said object model.

Claim 19

A method according to claim 12 , further comprising: generating operation control data based on operations of a user; operating a camera in response to said operation control data such that said first video data imaged by said camera is obtained.

Claim 20

A method according to claim 17 , further comprising the step of: controlling operations of said camera based on said operation control data when said dummy object is not present such that said third video data imaged by said camera is obtained.

Claim 21

A method according to claim 18 , further comprising the steps of: controlling said operations of said camera with a fisheye lens based on said operation control data when said dummy object is not present, such that a fifth image data imaged by said camera is obtained; and mapping said fifth image data on a portion of said second image data corresponding to a predetermined area of said object model.

Claim 22

A method according to claim 17 , further comprising the step of controlling operations of said camera based on operation data indicating said operations of said camera for obtaining said first video data when said dummy object is not present such that said third video data imaged by said camera is obtained.

Claim 23

A method according to claim 20 , further comprising the steps of: controlling said operations of said camera with a fisheye lens based on said operation data when said dummy object is not present such that a fifth image data of said scene imaged by said camera with said fisheye lens is obtained; and mapping said fifth image data on a portion of said second image data corresponding to a predetermined area of said object model.

Claim 24

A method according to claim 12 , wherein said dummy object has indicators, and wherein said determining step includes: determining said object movement data indicating movement of said dummy object based on said indicators of said dummy object of said first video data from said first recording of said scene in which said dummy object is moving.

Claim 25

An image data producing system comprising: a scene data storage unit in which a first video data from a first recording with a camera of a scene in which a dummy object is moving is stored; the camera operates in response to an operation control data; an instructing unit for generating said operation control data based on operations of a user; a first storage processing unit for storing said first video data of said scene imaged by said camera when the dummy object is moving in said scene, in said scene data storage unit; a background data storage unit in which a second video data from a second recording with the camera of a scene without the dummy object is stored; a second storage processing unit for storing in said background data storage unit, said second video data of said scene imaged by said camera which is operated in a same manner as said first video data is obtained, when said object is not present in said scene; a calculating unit for determining an object movement data indicating movement of said dummy object based on said first video data; a model data producing unit for producing a third image data of an object model which has a same movement as that of said dummy object, based on said object movement data; and a synthesizing unit for synthesizing said second video data and said third image data to produce a fourth image data of said scene in which said object model moves.

Claim 26

An image data producing system comprising: a scene data storage unit in which a first video data from a first recording with a camera of a scene in which a dummy object is moving is stored; the camera operates in response to an operation control data; an instructing unit for generating said operation control data based on operations of a user; a first storage processing unit for storing said first video data of said scene imaged by said camera when the dummy object is moving in said scene, in said scene data storage unit; a background data storage unit in which a second video data from a second recording with the camera of a scene without the dummy object is stored; a second storage processing unit for storing in said background data storage unit, said second video data of said scene imaged by said camera which is operated in a same manner as said first video data is obtained, when said object is not present in said scene; a calculating unit for determining an object movement data indicating movement of said dummy object based on said first video data; a model data producing unit for producing a third image data of an object model which has a same movement as that of said dummy object, based on said object movement data; and a synthesizing unit for synthesizing said second video data and said third image data to produce a fourth image data of said scene in which said object model moves.

Claim 27

An image data producing system according to claim 23 , further comprising a reflection data storage unit in which a fifth image data of said scene in which said dummy object is not present and which is imaged by use of a fisheye lens, and wherein said synthesizing unit performs mapping of said fifth image data on a portion of said fourth image data corresponding to a predetermined area of said object model.

Claim 28

An image data producing system according to claim 23 , wherein said object has indicators, and wherein said calculating unit determines said object movement data indicating movement of said dummy object based on said indicators of said object of said first video data.