← Back to Patent Explorer
US5586218A Expired / Lapsed US ⏱️ 0.0 years remaining

Autonomous learning and reasoning agent

Assignee: eGain Corp
•
Filing: 1995-08-24
•
Granted: 1996-12-17
•
Expires: 2015-08-24
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A software agent which performs autonomous learning in a real-world environment, implemented in a case-based reasoning system and coupled to a sensor for gathering information from, and to an effector for manipulating, its environment. A case base which is tuned in response to an evaluation of how well the agent is operating in that environment. A memory of cases, the contents of that memory being determined by a genetic technique, including producing new cases which may never have been encountered in the environment, evaluating cases in response to a history of previous matches and in response to an external stimulus, and selecting a limited set of cases which provides a preferred model of the environment. A selection technique based on multiple measures, such as match quality, case accuracy, or case utility, which may induce experimentation by the autonomous agent, such as by employing a random or pseudorandom effect in selecting cases, and which may also distinguish between those actions which solve problems and those actions which gather further information so as to better solve problems. Multiple autonomous agents may form a collective entity and may cooperate to select an action to be performed by that collective entity.

Inventors

  • 👤 Bradley P. Allen

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-04 12:40
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/12; G06N3/126; G06N3/004; G06N5/00; G06N5/04

Claims Analysis

Total Claims: 21
Claim 1
Independent Claim 147 words
An autonomous software agent for operating in an environment, comprising a sensor for gathering information from said environment; an effector for manipulating said environment; a case base having a plurality of exemplar cases, each of said exemplar cases comprising a designated action, at least some of said actions comprising gathering information; an inference engine for performing case-based reasoning steps in response to said cases; and means for altering said case base in response to reinforcement from said environment; means for selecting a set of matching cases from said case base having a random effect or a pseudorandom effect; wherein said means for selecting a set of matching cases from said case base comprises means for selecting a first case over a second case with a likelihood that is linearly proportional to a ratio of a measure of case accuracy of said first case over said second case.
Claim 2
Dependent Claim 147 words
An autonomous software agent for operating in an environment, comprising a sensor for gathering information from said environment; an effector for manipulating said environment; a case base having a plurality of exemplar cases, each of said exemplar cases comprising a designated action, at least some of said actions comprising gathering information; an inference engine for performing case-based reasoning steps in response to said cases; and means for altering said case base in response to reinforcement from said environment; means for selecting a set of matching cases from said case base having a random effect or a pseudorandom effect; wherein said means for selecting a set of matching cases from said case base comprises means for selecting a first case over a second case with a likelihood that is linearly proportional to a ratio of a measure of case accuracy of said first case over said second case.
Claim 3
Dependent Claim 28 words
An autonomous software agent as in claim 1, wherein said means for altering comprises means for altering said case base in response to an evaluation of said agent.
Claim 4
Dependent Claim 55 words
An autonomous software agent as in claim 1, comprising wherein said case base comprises a memory of cases, at least part of said memory being determined by a genetic technique; and wherein said case-based reasoning steps comprise taking selected actions in response to said cases, and at least some of said actions comprise gathering information.
Claim 5
Dependent Claim 28 words
An autonomous software agent as in claim 3, wherein said means for altering comprises means for altering said case base in response to an evaluation of said agent.
Claim 6
Dependent Claim 25 words
An autonomous software agent as in claim 3, wherein said means for selecting a case for case-based reasoning is responsive to a plurality of measures.
Claim 7
Dependent Claim 29 words
An autonomous software agent as in claim 5, wherein said means for selecting comprises means for selecting a case in response to match quality, case accuracy, or case utility.
Claim 8
Dependent Claim 27 words
An autonomous software agent as in claim 3, wherein said means for selecting a case for case-based reasoning comprises means for inducing experimentation by the autonomous agent.
Claim 9
Dependent Claim 24 words
An autonomous software agent as in claim 7, wherein said means for selecting a case comprises means for generating a random or pseudorandom effect.
Claim 10
Dependent Claim 23 words
An autonomous software agent as in claim 8, wherein said means for selecting a case comprises means for inducing experimentation by said agent.
Claim 11
Dependent Claim 25 words
An autonomous software agent as in claim 3, comprising means for cooperating with a second autonomous software agent in selecting an action to be performed.
Claim 12
Dependent Claim 127 words
An autonomous software agent as in claim 1, comprising a receptor coupled to said environment and generating a features message; wherein said inference engine is coupled to said receptor, said inference engine comprising said case base, said means for selecting a set of matching cases from said case base, at least one case in said case base comprising a designated action including a step of gathering information, means for altering said case base using a genetic technique in response to said features message and in response to a reinforcement from said environment, and means for generating a commands message in response to said set of matching cases; and wherein said effector is coupled to said environment and operates on said environment in response to said commands message.
Claim 13
Dependent Claim 62 words
An autonomous software agent as in claim 11, wherein said means for altering comprises means for generating a case which has not been encountered in said environment; means for evaluating a case in response to (a) a set of matching cases, or (b) said reinforcement; and means for selecting a limited set of cases which provides a preferred model of said environment.
Claim 14
Dependent Claim 134 words
An autonomous software agent as in claim 1, comprising a receptor coupled to said environment and generating a features message; wherein said inference engine is coupled to said receptor, said inference engine comprising said case base, said means for selecting a set of matching cases from said case base, means for altering said case base using a genetic technique in response to said features message and in response to a reinforcement from said environment, and means for generating a commands message in response to said set of matching cases; and wherein said effector is coupled to said environment and operates on said environment in response to said commands message; wherein said means for selecting a set of matching cases from said case base comprises means for generating a random effect or a pseudorandom effect.
Claim 15
Dependent Claim 44 words
An autonomous software agent as in claim 1, wherein said means for selecting a set of matching cases from said case base comprises means for applying a random effect or a pseudorandom effect to a measure of match quality, case accuracy, or case utility.
Claim 16
Dependent Claim 41 words
An autonomous software agent as in claim 1, wherein said means for selecting a set of matching cases from said case base is more likely to select a case with a greater measure of match quality, case accuracy, or case utility.
Claim 17
Dependent Claim 40 words
An autonomous software agent as in claim 1, wherein substantially all of said cases comprise a set of matchable features; an action to be taken when said case is selected; and a plurality of measures of value for said case.
Claim 18
Dependent Claim 27 words
An autonomous software agent as in claim 16, wherein at least one of said plurality of measures of value comprises match quality, case accuracy, or case utility.
Claim 19
Dependent Claim 52 words
An autonomous software agent as in claim 1, wherein said environment comprises a carpenter's bench, a chess program, a customer service system, a graphic database, a help-desk system, a knowledge discovery system, a loan portfolio database, a music audio database, an oil refinery, a piece of office equipment, or a physical room.
Claim 20
Dependent Claim 119 words
An autonomous software agent as in claim 1, comprising a receptor coupled to said environment and generating a features message; wherein said inference engine is coupled to said receptor, said inference engine comprising said case base, said means for selecting a set of matching cases from said case base in response to a plurality of measures of case quality, means for altering said case base using a genetic technique in response to said features message and in response to a reinforcement from said environment, and means for generating a commands message in response to said set of matching cases; and wherein said effector is coupled to said environment and operates on said environment in response to said commands message.
Claim 21
Dependent Claim 22 words
An autonomous software agent as in claim 1 wherein each of said exemplar cases comprises a plurality of measures of case quality.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1999-12-17 2000-06-17 2000-12-17 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2003-12-17 2004-06-17 2004-12-17 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2007-12-17 2008-06-17 2008-12-17 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag