Patent US6151571A successfully refreshed from Google Patents.
← Back to Patent Explorer
US6151571A Expired / Lapsed US ⏱️ 0.0 years remaining

System, method and article of manufacture for detecting emotion in voice signals through analysis of a plurality of voice signal parameters

Assignee: Accenture Global Services Ltd
•
Filing: 1999-08-31
•
Granted: 2000-11-21
•
Expires: 2019-08-31
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A method and system for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers is provided. First, a voice signal is received after which a particular feature is extracted from the voice signal. Next, an emotion associated with the voice signal is determined based on the extracted feature. The emotion is screened and feedback is provided only if the emotion is determined to be a negative emotion selected from the group of negative emotions consisting of anger, sadness, and fear. Such determined negative emotion is then outputted to a third party during the conversation.

Inventors

  • 👤 Valery A. Pertrushin

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 11:05
CPC Classifications
G; G10; G10L; G10L17/00; G10L17/26; G10L25/00; G10L25/90

Claims Analysis

Total Claims: 23
Claim 1
Independent Claim 207 words
A method for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising the steps of: (a) receiving a voice signal representing voices of speakers in a conversation; (b) extracting at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) determining an emotion associated with the voice signal based on the extracted feature; (d) determining whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) outputting the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 2
Independent Claim 207 words
A method for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising the steps of: (a) receiving a voice signal representing voices of speakers in a conversation; (b) extracting at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) determining an emotion associated with the voice signal based on the extracted feature; (d) determining whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) outputting the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 3
Dependent Claim 24 words
A method as recited in claim 1, wherein at least two features of the voice signal selected from the group of features are extracted.
Claim 4
Dependent Claim 28 words
A method as recited in claim 1 wherein the third party is a manager and the conversation is between a customer and an employee subordinate to the manager.
Claim 5
Dependent Claim 67 words
A method as recited in claim 1, wherein the features that are extracted are the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, and the speaking rate.
Claim 6
Dependent Claim 27 words
A method as recited in claim 4, wherein the extracted features further include the slope of the fundamental frequency and the maximum value of the first formant.
Claim 7
Dependent Claim 101 words
A method as recited in claim 1, wherein the features extracted include the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, the speaking rate, the slope of the fundamental frequency, the maximum value of the first formant, the maximum value of the energy, the range of the energy, the range of the second formant, and the range of the first formant.
Claim 8
Dependent Claim 18 words
A method as recited in claim 1, wherein the voice signal is received from an emergency response system.
Claim 9
Dependent Claim 19 words
A method as recited in claim 7, wherein the third party is a member of an emergency response team.
Claim 10
Dependent Claim 231 words
A computer program embodied on a computer readable medium for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) a code segment that receives a voice signal representing voices of speakers in a conversation; (b) a code segment that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) a code segment that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) a code segment that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 11
Dependent Claim 231 words
A computer program embodied on a computer readable medium for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) a code segment that receives a voice signal representing voices of speakers in a conversation; (b) a code segment that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) a code segment that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) a code segment that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 12
Dependent Claim 25 words
A computer program as recited in claim 9, wherein at least two features of the voice signal selected from the group of features are extracted.
Claim 13
Dependent Claim 29 words
A computer program as recited in claim 9, wherein the third party is a manager and the conversation is between a customer and an employee subordinate to the manager.
Claim 14
Dependent Claim 67 words
A computer program as recited in claim 9, the features that are extracted are the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, and the speaking rate.
Claim 15
Dependent Claim 28 words
A computer program as recited in claim 12, wherein the extracted features further include the slope of the fundamental frequency and the maximum value of the first formant.
Claim 16
Dependent Claim 102 words
A computer program as recited in claim 9, wherein the features extracted include the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, the speaking rate, the slope of the fundamental frequency, the maximum value of the first formant, the maximum value of the energy, the range of the energy, the range of the second formant, and the range of the first formant.
Claim 17
Independent Claim 216 words
A system for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) logic that receives a voice signal representing voices of speakers in a conversation; (b) logic that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) logic that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) logic that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 18
Independent Claim 216 words
A system for monitoring a conversation between a pair of speakers for detecting an emotion of at least one of the speakers using voice analysis comprising: (a) logic that receives a voice signal representing voices of speakers in a conversation; (b) logic that extracts at least one feature of the voice signal selected from a group of features consisting of a maximum value of a fundamental frequency, a standard deviation of the fundamental frequency, a range of the fundamental frequency, a mean of the fundamental frequency, a mean of a bandwidth of a first formant, a mean of a bandwidth of a second formant, a standard deviation of energy, a speaking rate, a slope of the fundamental frequency, a maximum value of the first formant, a maximum value of the energy, a range of the energy, a range of the second formant, and a range of the first formant; (c) logic that determines an emotion associated with the voice signal based on the extracted feature; (d) a code segment that determines whether the emotion matches a negative emotion selected from a predefined group of negative emotions consisting of anger, sadness and fear; and (e) logic that outputs the determined emotion to a third party during the conversation if the emotion matches one of the negative emotions.
Claim 19
Dependent Claim 24 words
A system as recited in claim 15, wherein at least two features of the voice signal selected from the group of features are extracted.
Claim 20
Dependent Claim 28 words
A system as recited in claim 15, wherein the third party is a manager and the conversation is between a customer and an employee subordinate to the manager.
Claim 21
Dependent Claim 66 words
A system as recited in claim 15, the features that are extracted are the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, and the speaking rate.
Claim 22
Dependent Claim 27 words
A system as recited in claim 18, wherein the extracted features further include the slope of the fundamental frequency and the maximum value of the first formant.
Claim 23
Dependent Claim 101 words
A system as recited in claim 15, wherein the features extracted include the maximum value of the fundamental frequency, the standard deviation of the fundamental frequency, the range of the fundamental frequency, the mean of the fundamental frequency, the mean of the bandwidth of the first formant, the mean of the bandwidth of the second formant, the standard deviation of energy, the speaking rate, the slope of the fundamental frequency, the maximum value of the first formant, the maximum value of the energy, the range of the energy, the range of the second formant, and the range of the first formant.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2003-11-21 2004-05-22 2004-11-21 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2007-11-21 2008-05-22 2008-11-21 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2011-11-21 2012-05-22 2012-11-21 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag