EP1100013A2
Expired / Lapsed
EP
⏱️ 0.0 years remaining
Methods and systems for multi-modal browsing and implementation of a conversational markup language
Assignee: International Business Machines Corp
•
Filing: 2000-10-10
•
Granted: —
•
Expires: 2020-10-10
Abstract
Abstract A new application programming language is provided which is based on user interaction with any device which a user is employing to access any type of information. The new language is referred to herein as a "Conversational Markup Language (CML). In a preferred embodiment, CML is a high level XML based language for representing "dialogs" or "conversations" the user will have with any given computing device. For example, interaction may comprise, but is not limited to, visual based (text and graphical) user interaction and speech based user interaction. Such a language allows application authors to program applications using interaction-based elements referred to herein as "conversational gestures." The present invention also provides for various embodiments of a multimodal browser capable of supporting the features of CML in accordance with various modality specific representations, e.g., HTML based graphical user interface (GUI) browser, VoiceXML based speech browser, etc.
Inventors
- 👤 Stephane Herman Maes
- 👤 Thiruvilvama Lai V. Raman
Bibliographic Details
Application Number
—
Jurisdiction
EP
Data Source
google_patents
Last Synchronized
2026-11-06 13:48
CPC Classifications
H; H04; H04M; H04M3/00; H04M3/42; H04M3/487; H04M3/493; H04M3/4938; G; G06; G06F; G06F9/00; G06F9/06; G06F9/44; G06F9/451; H04M1/00; H04M1/72; H04M1/724; H04M1/72403; H04M1/72445; H04M2203/00; H04M2203/35; H04M2203/355
Claims Analysis
Total Claims: 44
Claim 1
Independent Claim
96 words
A method of programming an application accessible by a user through one or
more computer-based devices, the method comprising the steps of: representing interactions that the user is permitted to have with the one or more
computer-based devices used to access the application by interaction-based programming
components; wherein the interaction-based programming components are independent of
content/application logic and presentation requirements associated with the application,
and further wherein the interaction-based programming components are transcoded on a
component by component basis to generate one or more modality-specific renderings of
the application on the one or more computer-based devices.
Claim 2
Dependent Claim
62 words
The method of claim 1, in a client/server arrangement wherein at least a portion
of the application is to be downloaded from a server to at least one of the one or more
computer-based devices, acting as a client, further comprising the step of including code in
the application operative to provide a connection to the content/application logic resident
at the server.
Claim 3
Dependent Claim
30 words
The method of claim 2, wherein the content/application logic connection code
expresses at least one of one or more data models, attribute constraints and validation
rules associated with the application.
Claim 4
Dependent Claim
25 words
The method of anyone of claim 1 to 3, wherein the one or more
modality-specific renderings comprise a speech-based representation of portions of the
application.
Claim 5
Dependent Claim
13 words
The method of claim 4, wherein the speech-based representation is based on
VoiceXML.
Claim 6
Dependent Claim
21 words
The method of claim 1, wherein the one or more modality-specific renderings
comprise a visual-based representation of portions of the application.
Claim 7
Dependent Claim
20 words
The method of claim 6, wherein the visual-based representation is based on at
least one of HTML, CHTML and WML.
Claim 8
Dependent Claim
21 words
The method of anyone of claim 1 to 7, wherein the user interactions are
declaratively represented by the interaction-based programming components.
Claim 9
Dependent Claim
21 words
The method of anyone of claim 1 to 8, wherein the user interactions are
imperatively represented by the interaction-based programming components.
Claim 10
Dependent Claim
26 words
The method of anyone of claim 1 to 9, wherein the representation permits
reference to dynamically generated data and supports callback mechanisms to the
content/application logic.
Claim 11
Dependent Claim
34 words
The method of anyone of claim 1 to 10, wherein the interaction-based
programming components comprise basic elements associated with a dialog that may
occur between the user and the one or more computer-based devices.
Claim 12
Dependent Claim
43 words
The method of claim 11, wherein the interaction-based programming
components comprise complex elements, the complex elements being aggregations of two
or more of the basic elements associated with the dialog that may occur between the user
and the one or more computer-based devices.
Claim 13
Dependent Claim
19 words
The method of anyone of claim 1 to 12, wherein one of the interaction-based
programming components represent conversational gestures.
Claim 14
Dependent Claim
19 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating informational messages to the user.
Claim 15
Dependent Claim
17 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating contextual help information.
Claim 16
Dependent Claim
24 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating actions to be taken upon successful completion of another
gesture.
Claim 17
Dependent Claim
19 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating yes or no based questions.
Claim 18
Dependent Claim
27 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating dialogues where the user is expected to select from a set of
choices.
Claim 19
Dependent Claim
18 words
The method of claim 18, wherein the select gesture comprises a subelement
that represents the set of choices.
Claim 20
Dependent Claim
21 words
The method of claim 18, wherein the select gesture comprises a subelement
that represents a test that the selection should pass.
Claim 21
Dependent Claim
24 words
The method of claim 20, wherein the select gesture comprises a subelement
that represents an error message to be presented if the test fails.
Claim 22
Dependent Claim
23 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating rules for validating results of a given conversational gesture.
Claim 23
Dependent Claim
17 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating grammar processing rules.
Claim 24
Dependent Claim
25 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating dialogues that help the user navigate through portions of the
application.
Claim 25
Dependent Claim
26 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating a request for at least one of user login and authentication
information.
Claim 26
Dependent Claim
20 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating a request for constrained user input.
Claim 27
Dependent Claim
20 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for encapsulating a request for unconstrained user input.
Claim 28
Dependent Claim
17 words
The method of claim 13, wherein the conversational gestures comprise a
gesture for controlling submission of information.
Claim 29
Dependent Claim
41 words
The method of anyone of claim 1 to 28, further comprising the step of
providing a mechanism for defining logical input events and the association between the
logical input events and physical input events that trigger the defined logical input events.
Claim 30
Dependent Claim
23 words
The method of anyone of claim 1 to 29, wherein the component by component
transcoding is performed in accordance with XSL transformation rules.
Claim 31
Dependent Claim
22 words
The method of anyone of claim 1 to 30, wherein the component by component
transcoding is performed in accordance with Java Bean.
Claim 32
Dependent Claim
23 words
The method of anyone of claim 1 to 31, wherein the component by component
transcoding is performed in accordance with Java Server Pages.
Claim 33
Dependent Claim
35 words
The method of anyone of claim 1 to 32, wherein representation by the
interaction-based programming components permits synchronization of the one or more
modality-specific renderings of the application on the one or more computer-based
devices.
Claim 34
Dependent Claim
23 words
The method of anyone of claim 1 to 33, wherein representation by the the
interaction-based programming components supports a natural language understanding
environment.
Claim 35
Dependent Claim
42 words
The method of anyone of claim 1 to 34, further comprising the step of
including code for permitting cosmetic altering of a presentational feature associated with
the one or more modality-specific renderings of the application on the one or more
computer-based devices.
Claim 36
Dependent Claim
47 words
The method of anyone of claim 1 to 35, further comprising the step of
including code for permitting changes to rules for transcoding on a component by
component basis to generate the one or more modality-specific renderings of the
application on the one or more computer-based devices.
Claim 37
Dependent Claim
29 words
The method of anyone of claim 1 to 36, wherein a definition of an underlying
data model being populated is separated from a markup language defining the user
interaction.
Claim 38
Dependent Claim
27 words
The method of anyone of claim 1 to 37, wherein a node_id attribute is
attached to each component and the attribute is mapped over to various outputs.
Claim 39
Dependent Claim
24 words
The method of anyone of claim 1 to 38, wherein an author is provided with a
pass through mechanism to encapsulate modality-specific markup components.
Claim 40
Dependent Claim
17 words
The method of anyone of claim 1 to 39, wherein the components may be active
in parallel.
Claim 41
Dependent Claim
16 words
The method of anyone of claim 1 to 40, wherein the representation and
transcoding is extensible.
Claim 42
Dependent Claim
17 words
The method of anyone of claim 1 to 41, wherein a state of the application is
encapsulated.
Claim 43
Dependent Claim
104 words
Apparatus for use in accessing an application in association with one or more
computer-based devices, the apparatus comprising: one or more processors operative to: (i) obtain the application from an application
server, the application being programmatically represented by interactions that the user is
permitted to have with the one or more computer-based devices by interaction-based
programming components, wherein the interaction-based programming components are
independent of content/application logic and presentation requirements associated with the
application; and (ii) transcode the interaction-based programming components on a
component by component basis to generate one or more modality-specific renderings of
the application on the one or more computer-based devices.
Claim 44
Dependent Claim
20 words
The apparatus of claim 43, wherein the one or more processors are distributed
over the one or more computer-based devices.
References Cited (Backward Citations)
WO1992017838A1
Cited
US9923008B2
Cited
USPTO Annuity & Maintenance Windows
Maintenance schedule is calculated for granted US utility patents.