US6151571A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System, method and article of manufacture for detecting emotion in voice signals through analysis of a plurality of voice signal parameters
Assignee: Accenture Global Services Ltd
•
Filing: 1999-08-31
•
Granted: 2000-11-21
•
Expires: 2019-08-31
Abstract
Abstract A method and system for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers is provided. First, a voice signal is received after which a particular feature is extracted from the voice signal. Next, an emotion associated with the voice signal is determined based on the extracted feature. The emotion is screened and feedback is provided only if the emotion is determined to be a negative emotion selected from the group of negative emotions consisting of anger, sadness, and fear. Such determined negative emotion is then outputted to a third party during the conversation.
Inventors
- 👤 Valery A. Pertrushin
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 10:53
CPC Classifications
G; G10; G10L; G10L17/00; G10L17/26; G10L25/00; G10L25/90
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
207 words
A method for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising the steps of: (a) receiving a voice signal representing voices of speakers in a conversation; (b) extracting at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) determining an emotion associated with the voice signal based on the extracted feature; (d) determining whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) outputting the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 2
Independent Claim
207 words
A method for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising the steps of: (a) receiving a voice signal representing voices of speakers in a conversation; (b) extracting at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) determining an emotion associated with the voice signal based on the extracted feature; (d) determining whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) outputting the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 3
Dependent Claim
24 words
A method as recited in claim 1, wherein at least two features of the voice signal selected from the group of features are extracted.
Claim 4
Dependent Claim
28 words
A method as recited in claim 1 wherein the third party is a manager and the conversation is between a customer and an employee subordinate to the manager.
Claim 5
Dependent Claim
67 words
A method as recited in claim 1, wherein the features that are extracted are the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, and the speaking rate.
Claim 6
Dependent Claim
27 words
A method as recited in claim 4, wherein the extracted features further include the slope of the fundamental frequency and the maximum value of the first formant.
Claim 7
Dependent Claim
101 words
A method as recited in claim 1, wherein the features extracted include the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, the speaking rate, the slope of the fundamental frequency, the maximum value of the first formant, the maximum value of the energy, the range of the energy, the range of the second formant, and the range of the first formant.
Claim 8
Dependent Claim
18 words
A method as recited in claim 1, wherein the voice signal is received from an emergency response system.
Claim 9
Dependent Claim
19 words
A method as recited in claim 7, wherein the third party is a member of an emergency response team.
Claim 10
Dependent Claim
231 words
A computer program embodied on a computer readable medium for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) a code segment that receives a voice signal representing voices of speakers in a conversation; (b) a code segment that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) a code segment that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) a code segment that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 11
Dependent Claim
231 words
A computer program embodied on a computer readable medium for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) a code segment that receives a voice signal representing voices of speakers in a conversation; (b) a code segment that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) a code segment that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) a code segment that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 12
Dependent Claim
25 words
A computer program as recited in claim 9, wherein at least two features of the voice signal selected from the group of features are extracted.
Claim 13
Dependent Claim
29 words
A computer program as recited in claim 9, wherein the third party is a manager and the conversation is between a customer and an employee subordinate to the manager.
Claim 14
Dependent Claim
67 words
A computer program as recited in claim 9, the features that are extracted are the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, and the speaking rate.
Claim 15
Dependent Claim
28 words
A computer program as recited in claim 12, wherein the extracted features further include the slope of the fundamental frequency and the maximum value of the first formant.
Claim 16
Dependent Claim
102 words
A computer program as recited in claim 9, wherein the features extracted include the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, the speaking rate, the slope of the fundamental frequency, the maximum value of the first formant, the maximum value of the energy, the range of the energy, the range of the second formant, and the range of the first formant.
Claim 17
Independent Claim
216 words
A system for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) logic that receives a voice signal representing voices of speakers in a conversation; (b) logic that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) logic that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) logic that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 18
Independent Claim
216 words
A system for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) logic that receives a voice signal representing voices of speakers in a conversation; (b) logic that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) logic that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) logic that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 19
Dependent Claim
24 words
A system as recited in claim 15, wherein at least two features of the voice signal selected from the group of features are extracted.
Claim 20
Dependent Claim
28 words
A system as recited in claim 15, wherein the third party is a manager and the conversation is between a customer and an employee subordinate to the manager.
Claim 21
Dependent Claim
66 words
A system as recited in claim 15, the features that are extracted are the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, and the speaking rate.
Claim 22
Dependent Claim
27 words
A system as recited in claim 18, wherein the extracted features further include the slope of the fundamental frequency and the maximum value of the first formant.
Claim 23
Dependent Claim
101 words
A system as recited in claim 15, wherein the features extracted include the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, the speaking rate, the slope of the fundamental frequency, the maximum value of the first formant, the maximum value of the energy, the range of the energy, the range of the second formant, and the range of the first formant.
References Cited (Backward Citations)
US3971034A
Cited
US3691652A
Cited
US4093821A
Cited
US4142067A
Cited
US4602129A
Cited
US4592086A
Cited
US4490840A
Cited
US4696038A
Cited
US4931934A
Cited
US4996704A
Cited
US5163083A
Cited
US5495553A
Cited
US5860064A
Cited
US5539861A
Cited
US5704007A
Cited
US5774859A
Cited
US5734794A
Cited
US5647834A
Cited
US5903870A
Cited
US5893057A
Cited
US5909665A
Cited
US5812977A
Cited
US5884247A
Cited
US5913196A
Cited
US5987415A
Cited
US5936515A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-11-21 | 2004-05-22 | 2004-11-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-11-21 | 2008-05-22 | 2008-11-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-11-21 | 2012-05-22 | 2012-11-21 | $7700.00 | Window Closed / Lapsed |