Information processing apparatus using pointing input and speech input

Claim 2

An information processing apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which has been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which has been integrated, and generating demand information based on said first and second character string information which has been syntax-analyzed; and means for preparing presentation information corresponding to said demand information, and outputting said presentation information on said display device.

Claim 3

An information processing apparatus according to claim 1, further comprising: a memory for storing knowledge used for converting said first information into said first character string information, wherein, by using said knowledge, said first information converting means converts said first information into said first character string information.

Claim 4

An information processing apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; a memory for receiving said first and second character string information from said first and second information converting means, and storing said first and second character string information so as to integrate into a character string said first and second character string information, said first and second character string information respectively corresponding to said first and second information which has been inputted until said input termination information is inputted; information analyzing means for syntax-analyzing said first and second character string information stored in said memory in relation to said input termination information, and generating demand information based on said first and second input character string information which has been syntax-analyzed; and presentation preparing means for preparing presentation information corresponding to said demand information, and outputting said presentation information on said display device.

Claim 5

An information processing apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; a memory for receiving said first and second character string information from said first and second information converting means, and storing said first and second character string information so as to integrate into a character string said first and second character string information, said first and second character string information respectively corresponding to said first and second information which has been inputted until said input termination information is inputted; information analyzing means for syntax-analyzing said first and second character string information stored in said memory in relation to said input termination information, and generating demand information based on said first and second input character string information which has been syntax-analyzed; and presentation preparing means for preparing presentation information corresponding to said demand information, and outputting said presentation information on said display device.

Claim 6

An information processing apparatus according to claim 3, further comprising: means for fetching character string information including said first and second character string information stored in said memory, when said character string information including said first and second character string information has changed; and means for outputting said changed character string information on said display device.

Claim 7

An information processing apparatus according to claim 3, wherein said presentation information generating means includes means for generating answer information in response to said first and second character string information which have been inputted and outputting said answer information to said display device based on said demand information.

Claim 8

An information processing apparatus using a pointing input and a speech input, comprising: a display device; speech output means; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which has been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which has been integrated, and generating demand information based on said first and second character string information which has been syntax-analyzed; means for preparing presentation information corresponding to said demand information; and means for determining said display device or said speech output means in order to output said presentation information, on the basis of said demand information.

Claim 9

An information processing apparatus using a pointing input and a speech input, comprising: a display device; speech output means; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which has been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which has been integrated, and generating demand information based on said first and second character string information which has been syntax-analyzed; means for preparing presentation information corresponding to said demand information; and means for determining said display device or said speech output means in order to output said presentation information, on the basis of said demand information.

Claim 10

An information processing apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which have been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which have been integrated and generating demand information based on said first and second character string information which has been syntax-analyzed; means for preparing display information to be displayed on said display device when said demand information is an information display demand; and means for preparing control data when said demand information is an operation demand.

Claim 11

An information processing apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which have been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which have been integrated and generating demand information based on said first and second character string information which has been syntax-analyzed; means for preparing display information to be displayed on said display device when said demand information is an information display demand; and means for preparing control data when said demand information is an operation demand.

Claim 12

A plant monitoring apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; means for storing measurement data measured at a plant; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which have been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which have been integrated, and generating demand information based on said first and second character string information which has been syntax-analyzed; and means for preparing presentation information corresponding to said demand information by using said measurement data, and outputting said presentation information on said display device.

Claim 13

A plant monitoring apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; means for storing measurement data measured at a plant; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which have been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which have been integrated, and generating demand information based on said first and second character string information which has been syntax-analyzed; and means for preparing presentation information corresponding to said demand information by using said measurement data, and outputting said presentation information on said display device.

Claim 14

A plant monitoring apparatus according to claim 8, wherein said presentation information preparing means includes means for generating answer information to inputted character string information and outputting said answer information to said display device based on said demand information.

Claim 15

A plant monitoring apparatus according to claim 8, wherein said display device has a system diagram display area, a trend display area, an input character string display area and an answer display area; and said preparation means includes: means for outputting a system diagram including graphic elements of a plurality of components included in said plant to said display device to display said system diagram in said system diagram display area; means for generating trend graph display information corresponding to said demand information by using said measured data and outputting said trend graph display information to said display device to display said trend graph display information in said trend display area; means for outputting character string information stored in said information integrating means to said display device to display said character string information in said input character string display area when said character string information has changed; and means for generating answer information in response to inputted string information and outputting said answer information to said display device to display said answer information in said answer display area.

Claim 16

An information processing apparatus according to claim 8, further comprising: means for fetching character string information including said first and second character string information from said information integrating means, when said character string information including said first and second character string information has changed; and means for outputting said changed character string information on said display device.

Claim 17

A plant control apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; means for storing measurement data measured at a plant; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which have been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which have been integrated, and generating demand information based on said first and second character string information which has been syntax-analyzed; means for preparing display information to be displayed on said display device when said demand information is an information display demand; and means for preparing a control demand for a corresponding component in said plant when said demand information is an operation demand.

Claim 18

A plant control apparatus using a pointing input and a speech input, comprising: a display device; pointing input means for inputting information by indicating said information among information displayed on said display device; speech input means; means for storing measurement data measured at a plant; first information converting means for converting first information inputted by said pointing input means into first character string information; second information converting means for converting second information inputted by said speech input means into second character string information; information integrating means for receiving said first and second character string information from said first and second information converting means, and integrating into a character string said first and second character string information respectively corresponding to said first and second information which have been inputted until input termination information is inputted from either said pointing input means or said speech input means; information analyzing means for syntax-analyzing said first and second character string information which have been integrated, and generating demand information based on said first and second character string information which has been syntax-analyzed; means for preparing display information to be displayed on said display device when said demand information is an information display demand; and means for preparing a control demand for a corresponding component in said plant when said demand information is an operation demand.