US6731307B1
Expired / Lapsed
US
⏱️ 0.0 years remaining
User interface/entertainment device that simulates personal interaction and responds to user's mental state and/or personality
Assignee: Koninklijke Philips NV
•
Filing: 2000-10-30
•
Granted: 2004-05-04
•
Expires: 2020-10-30
Abstract
Abstract An interaction simulator uses computer vision, and inputs of other modalities, to analyze the user's mental state and/or personality. The mental state and/or personality are classified and this information used to guide conversation and other interaction. In a chatterbot embodiment, the substance of the conversation may be altered in response to the mental state and/or personality class, for example, by changing the topic of conversation to a favorite subject when the user is sad or by telling a joke when the user is in a good mood.
Inventors
- 👤 Hugo J. Strubbe
- 👤 Larry J. Eshelman
- 👤 Srinivas Gutta
- 👤 John Milanski
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 20:08
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/40; H04N21/45; H04N21/466; G; G06; G06N; G06N3/00; G06N3/004; G10; G10L; G10L17/00; G10L17/26; H04L; H04L51/00; H04L51/02; G10L15/00; G10L15/22
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
88 words
A conversation simulator for simulating conversational interaction with a user, comprising: a controller programmed to receive user inputs including natural language declarations and mental state data of the user; said controller being programmed to classify at least one of a mood and a personality of said user based on the mental state data to produce class data; and said controller being programmed to simulate a conversational interaction with the user by generating responses to said natural language declarations based on the natural language declarations and said class data.
Claim 2
Dependent Claim
88 words
A conversation simulator for simulating conversational interaction with a user, comprising: a controller programmed to receive user inputs including natural language declarations and mental state data of the user; said controller being programmed to classify at least one of a mood and a personality of said user based on the mental state data to produce class data; and said controller being programmed to simulate a conversational interaction with the user by generating responses to said natural language declarations based on the natural language declarations and said class data.
Claim 3
Dependent Claim
22 words
A conversation simulator as in claim 1 , wherein said mental state data includes at least one of image and audio data.
Claim 4
Dependent Claim
23 words
A conversation simulator as in claim 1 , wherein said mental state data includes an indicator of a facial expression of said user.
Claim 5
Dependent Claim
24 words
A conversation simulator as in claim 1 , wherein said mental state data includes an indicator of a level of anxiety of said user.
Claim 6
Dependent Claim
25 words
A conversation simulator as in claim 1 , wherein: the controller is programmed to determine a content of said responses based on said class data.
Claim 7
Dependent Claim
25 words
A conversation simulator as in claim 1 , wherein: the controller is programmed to determine a subject of said responses based on said class data.
Claim 8
Independent Claim
64 words
A method of generating a dialogue response in a conversation simulator, comprising the steps of: receiving a natural language declaration from a user; determining a mental state of said user; determining a subject for a response to said natural language declaration based on the determined mental state of said user; and generating the response based on the natural language declaration and the determined subject.
Claim 9
Independent Claim
64 words
A method of generating a dialogue response in a conversation simulator, comprising the steps of: receiving a natural language declaration from a user; determining a mental state of said user; determining a subject for a response to said natural language declaration based on the determined mental state of said user; and generating the response based on the natural language declaration and the determined subject.
Claim 10
Dependent Claim
19 words
A method as in claim 7 , wherein said step of receiving includes inputting speech through an audio transducer.
Claim 11
Dependent Claim
22 words
A method as in claim 7 , wherein said step of determining the mental state includes classifying image data from a camera.
Claim 12
Dependent Claim
34 words
A method as in claim 7 , wherein said step of determining the mental state includes at least one of classifying image data from a camera and classifying audio data from an audio transducer.
Claim 13
Dependent Claim
44 words
A method as in claim 7 , wherein said step of determining the mental state includes: classifying image data from a camera; classifying audio data from an audio transducer; and determining the mental state based on the classified image data and classified audio data.
Claim 14
Dependent Claim
19 words
A method as in claim 11 , wherein said step of receiving includes inputting speech through the audio transducer.
Claim 15
Dependent Claim
41 words
A method as in claim 7 , further comprising: classifying image data from a camera; and determining a physical location of said user based on the classified image data; wherein the mental state is determined based on the determined physical location.
Claim 16
Dependent Claim
39 words
A method as in claim 7 , further comprising: classifying image data from a camera; and determining an activity of said user based on the classified image data; wherein the mental state is determined based on the determined activity.
Claim 17
Dependent Claim
21 words
A method as in claim 14 , wherein: the activity includes at least one of sitting, lying prone, standing and walking.
Claim 18
Independent Claim
67 words
A method of generating a dialogue response in a conversation simulator, comprising the steps of: receiving input from a user; determining a content of said input; determining a mental state of said user; and generating a conditional response to said input to simulate a conversational interaction with the user based on the determined mental state of said user, and based on the determined content of said input.
Claim 19
Independent Claim
67 words
A method of generating a dialogue response in a conversation simulator, comprising the steps of: receiving input from a user; determining a content of said input; determining a mental state of said user; and generating a conditional response to said input to simulate a conversational interaction with the user based on the determined mental state of said user, and based on the determined content of said input.
Claim 20
Dependent Claim
25 words
A method as in claim 16 , wherein said step of determining the mental state includes classifying at least one of image and audio data.
Claim 21
Dependent Claim
24 words
A method as in claim 16 , wherein said mental state is determined based on an indicator of a facial expression of said user.
Claim 22
Dependent Claim
25 words
A method as in claim 16 , wherein said mental state is determined based on an indicator of a level of anxiety of said user.
References Cited (Backward Citations)
EP0101772A1
Cited
US5223924A
Cited
US5515173A
Cited
US5949471A
Cited
US5694558A
Cited
US5736982A
Cited
US5617855A
Cited
US5673089A
Cited
JPH10214024A
Cited
US5977968A
Cited
US6226614B1
Cited
US5892901A
Cited
US5987415A
Cited
EP0986213A2
Cited
US6054989A
Cited
US6243683B1
Cited
US6598022B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2007-05-04 | 2007-11-03 | 2008-05-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2011-05-04 | 2011-11-03 | 2012-05-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2015-05-04 | 2015-11-03 | 2016-05-04 | $7700.00 | Window Closed / Lapsed |