US5950146A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Support vector method for function estimation
Assignee: AT&T Inc
•
Filing: 1996-10-04
•
Granted: 1999-09-07
•
Expires: 2016-10-04
Abstract
Abstract A method for estimating a real function that describes a phenomenon occurring in a space of any dimensionality. The function is estimated by taking a series of measurements of the phenomenon being described and using those measurements to construct an expansion that has a manageable number of terms. A reduction in the number of terms is achieved by using an approximation that is defined as an expansion on kernel functions, the kernel functions forming an inner product in Hilbert space. By finding the support vectors for the measurements one specifies the expansion functions. The number of terms in an estimation according to the present invention is generally much less than the number of observations of the real world phenomenon that is being estimated.
Inventors
- 👤 Vladimir Vapnik
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-01 12:25
CPC Classifications
G; G06; G06F; G06F17/00; G06F17/10; G06F17/17
Claims Analysis
Total Claims: 48
Claim 1
Independent Claim
191 words
Apparatus for forming a function estimate that characterizes behavior of a system, comprising: a) an input device for receiving a plurality of measurements of said behavior of said system; b) one or more stored programs that include instructions for (i) using said measurements, a kernel function that defines an inner product in Hilbert space, and a chosen error tolerance to form a functional; (ii) minimizing said functional to find a plurality of coefficients and a plurality of support vectors, said coefficients and said support vectors corresponding on a one to one basis; and (iii) forming said function estimate in a form of an expansion from said kernel, said coefficients, and said support vectors, said expansion having a plurality of terms, each said term constituting a separate dimension of said function estimate and including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; c) a processor for executing said instructions; and d) an output module that develops output signals based on said function estimate for interacting with said system.
Claim 2
Dependent Claim
191 words
Apparatus for forming a function estimate that characterizes behavior of a system, comprising: a) an input device for receiving a plurality of measurements of said behavior of said system; b) one or more stored programs that include instructions for (i) using said measurements, a kernel function that defines an inner product in Hilbert space, and a chosen error tolerance to form a functional; (ii) minimizing said functional to find a plurality of coefficients and a plurality of support vectors, said coefficients and said support vectors corresponding on a one to one basis; and (iii) forming said function estimate in a form of an expansion from said kernel, said coefficients, and said support vectors, said expansion having a plurality of terms, each said term constituting a separate dimension of said function estimate and including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; c) a processor for executing said instructions; and d) an output module that develops output signals based on said function estimate for interacting with said system.
Claim 3
Dependent Claim
18 words
The invention of claim 1, further comprising a data source for transmitting said measurements to said input device.
Claim 4
Dependent Claim
13 words
The invention of claim 1, wherein said input device is an RS-232 port.
Claim 5
Dependent Claim
27 words
The invention of claim 1, further comprising a memory for receiving said measurements from said input device and storing said measurements for retrieval by said stored programs.
Claim 6
Dependent Claim
16 words
The invention of claim 4, wherein said memory is a Random Access Memory of a computer.
Claim 7
Dependent Claim
27 words
The invention of claim 1, wherein said output module is a display device for displaying said function estimate with respect to at least some of said dimensions.
Claim 8
Dependent Claim
13 words
The invention of claim 6, wherein said output device is a computer monitor.
Claim 9
Dependent Claim
28 words
The apparatus of claim 6 wherein said output signals are adapted to display matter on said display device that assists users to make decisions relative to said system.
Claim 10
Dependent Claim
19 words
The invention of claim 1, wherein said stored programs are stored in a Read Only Memory of a computer.
Claim 11
Dependent Claim
15 words
The apparatus of claim 1 wherein said output signals are adapted to control electrical circuitry.
Claim 12
Dependent Claim
15 words
The apparatus of claim 10 wherein said output signals are adapted to control telecommunication circuitry.
Claim 13
Dependent Claim
14 words
The apparatus of claim 11 wherein said output signals are adapted to control modems.
Claim 14
Dependent Claim
14 words
The apparatus of claim 11 wherein said output signals are adapted to perform classifications.
Claim 15
Dependent Claim
14 words
The apparatus of claim 13 wherein said output signals are adapted to classify images.
Claim 16
Dependent Claim
15 words
The apparatus of claim 13 wherein said output signals are adapted to classify electronic mail.
Claim 17
Dependent Claim
11 words
The apparatus of claim 1 where said output signals form messages.
Claim 18
Dependent Claim
19 words
The apparatus of claim 1 where said output signals form messages that are transmitted to interact with said system.
Claim 19
Dependent Claim
21 words
The apparatus of claim 1 where said output signals form messages that assist users in making decisions relative to said system.
Claim 20
Dependent Claim
26 words
The apparatus of claim 1 further comprising a second processor, responsive to said measurements and to said output signals, for performing prearranged processing on said measurements.
Claim 21
Dependent Claim
24 words
The apparatus of claim 1 further comprising means, responsive to said measurements and to said output signals, for performing prearranged processing on said measurements.
Claim 22
Dependent Claim
174 words
A function estimator for estimating a real function that describes a phenomenon in a space of any dimension, comprising: a) an input device for forming signals from measurements of the phenomenon; b) a processing unit for (i) using said measurements, a kernel function that defines an inner product in Hilbert space, and a chosen error tolerance to form a functional; (ii) minimizing said functional to find a plurality of coefficients and a plurality of support vectors, said coefficients and said support vectors corresponding on a one to one basis; and (iii) forming an expansion from said kernel, said coefficients, and said support vectors, said expansion forming said estimate of the real function and having a plurality of terns, each said term including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; and c) an output processing unit, responsive to said expansion for developing output signals for forming decisions about said phenomenon.
Claim 23
Dependent Claim
174 words
A function estimator for estimating a real function that describes a phenomenon in a space of any dimension, comprising: a) an input device for forming signals from measurements of the phenomenon; b) a processing unit for (i) using said measurements, a kernel function that defines an inner product in Hilbert space, and a chosen error tolerance to form a functional; (ii) minimizing said functional to find a plurality of coefficients and a plurality of support vectors, said coefficients and said support vectors corresponding on a one to one basis; and (iii) forming an expansion from said kernel, said coefficients, and said support vectors, said expansion forming said estimate of the real function and having a plurality of terns, each said term including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; and c) an output processing unit, responsive to said expansion for developing output signals for forming decisions about said phenomenon.
Claim 24
Dependent Claim
18 words
The invention of claim 21, further comprising a data source for transmitting said measurements to said input device.
Claim 25
Dependent Claim
13 words
The invention of claim 21, wherein said input device is an RS-232 port.
Claim 26
Dependent Claim
20 words
The invention of claim 21, further comprising one or more stored programs for controlling the operation of said processing unit.
Claim 27
Dependent Claim
14 words
The invention of claim 24, further comprising a memory for storing said stored programs.
Claim 28
Dependent Claim
16 words
The invention of claim 25, wherein said memory is a Read Only Memory of a computer.
Claim 29
Dependent Claim
23 words
The invention of claim 21, further comprising an output device responsive to said output-processing unit for displaying the results of said function estimation.
Claim 30
Dependent Claim
13 words
The invention of claim 21, wherein said output device is a computer monitor.
Claim 31
Dependent Claim
27 words
The invention of claim 27, further comprising a memory for receiving said measurements from said input device and storing said measurements for retrieval by said processing unit.
Claim 32
Dependent Claim
16 words
The invention of claim 29, wherein said memory is a Random Access Memory of a computer.
Claim 33
Independent Claim
160 words
A method for forming a function estimate that characterizes behavior or a system describable by a function in a multi-dimensional space, comprising the steps of: a) taking a plurality of measurements of said behavior; b) using said measurements, a kernel function that defines an inner product in Hilbert space, and a chosen error tolerance to form a functional; c) minimizing said functional to find a plurality of coefficients and a plurality of support vectors, said coefficients and said support vectors corresponding on a one to one basis; and d) forming an expansion from said kernel, said coefficients, and said support vectors, said expansion forming said function estimate and having a plurality of terms, each said term including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; and e) developing an output signal for interacting with said system.
Claim 34
Independent Claim
160 words
A method for forming a function estimate that characterizes behavior or a system describable by a function in a multi-dimensional space, comprising the steps of: a) taking a plurality of measurements of said behavior; b) using said measurements, a kernel function that defines an inner product in Hilbert space, and a chosen error tolerance to form a functional; c) minimizing said functional to find a plurality of coefficients and a plurality of support vectors, said coefficients and said support vectors corresponding on a one to one basis; and d) forming an expansion from said kernel, said coefficients, and said support vectors, said expansion forming said function estimate and having a plurality of terms, each said term including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; and e) developing an output signal for interacting with said system.
Claim 35
Dependent Claim
13 words
The invention of claim 31, wherein said method is implemented by a computer.
Claim 36
Dependent Claim
15 words
The method of claim 31 wherein said output signals are adapted to control electrical circuitry.
Claim 37
Dependent Claim
15 words
The method of claim 33 wherein said output signals are adapted to control telecommunication circuitry.
Claim 38
Dependent Claim
14 words
The method of claim 34 wherein said output signals are adapted to control modems.
Claim 39
Dependent Claim
11 words
The method of claim 34 where said output signals form messages.
Claim 40
Dependent Claim
19 words
The method of claim 31 where said output signals form messages that are transmitted to interact with said system.
Claim 41
Dependent Claim
21 words
The method of claim 31 where said output signals form messages that assist users in making decisions relative to said system.
Claim 42
Dependent Claim
29 words
The method of claim 31 further comprising a set of process steps operating on said measurements and responsive to said output signals, for performing prearranged processing on said measurements.
Claim 43
Dependent Claim
42 words
The method of claim 31 where said output signals are fashioned to display elements of said estimate function that assist users to make decisions relative to said system and further comprising a step of applying said output signals to a display device.
Claim 44
Dependent Claim
14 words
The method of claim 31 wherein said output signals are adapted to perform classifications.
Claim 45
Dependent Claim
14 words
The method of claim 41 wherein said output signals are adapted to classify images.
Claim 46
Dependent Claim
15 words
The method of claim 41 wherein said output signals are adapted to classify electronic mail.
Claim 47
Independent Claim
164 words
A method for forming a function estimate that characterizes behavior or a system describable by a function in a multi-dimensional space, comprising the steps of: performing measurements of activities of said system; forming a functional from a kernel function that defines an inner product in Hilbert space and a chosen error tolerance criterion that is insensitive to the error in the neighborhood of -ε to +ε, for small values of error ε; minimizing said functional for an applied plurality of measurement signals to find a plurality of coefficients and a plurality of support vectors; forming an expansion from said kernel, said coefficients, and said support vectors, said expansion forming said function estimate and having a plurality of terms, each said term including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; and developing an output signal for interacting with said system.
Claim 48
Independent Claim
164 words
A method for forming a function estimate that characterizes behavior or a system describable by a function in a multi-dimensional space, comprising the steps of: performing measurements of activities of said system; forming a functional from a kernel function that defines an inner product in Hilbert space and a chosen error tolerance criterion that is insensitive to the error in the neighborhood of -ε to +ε, for small values of error ε; minimizing said functional for an applied plurality of measurement signals to find a plurality of coefficients and a plurality of support vectors; forming an expansion from said kernel, said coefficients, and said support vectors, said expansion forming said function estimate and having a plurality of terms, each said term including a first multiplier that is said kernel function as defined by one of said support vectors and a second multiplier that is said coefficient corresponding to said one of said support vectors; and developing an output signal for interacting with said system.
References Cited (Backward Citations)
EP0690406A2
Cited
US5640492A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-09-06 | 2003-03-08 | 2003-09-07 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-09-06 | 2007-03-08 | 2007-09-07 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-09-06 | 2011-03-08 | 2011-09-07 | $7700.00 | Window Closed / Lapsed |