Patent US6128608A successfully refreshed from Google Patents.
US6128608A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Enhancing knowledge discovery using multiple support vector machines
Assignee: Health Discovery Corp
•
Filing: 1999-05-01
•
Granted: 2000-10-03
•
Expires: 2019-05-01
Abstract
Abstract A system and method for enhancing knowledge discovery from data using multiple learning machines in general and multiple support vector machines in particular. Training data for a learning machine is pre-processed in order to add meaning thereto. Pre-processing data may involve transforming the data points and/or expanding the data points. By adding meaning to the data, the learning machine is provided with a greater amount of information for processing. With regard to support vector machines in particular, the greater the amount of information that is processed, the better generalizations about the data that may be derived. Multiple support vector machines, each comprising distinct kernels, are trained with the pre-processed training data and are tested with test data that is pre-processed in the same manner. The test outputs from multiple support vector machines are compared in order to determine which of the test outputs if any represents a optimal solution. Selection of one or more kernels may be adjusted and one or more support vector machines may be retrained and retested. When it is determined that an optimal solution has been achieved, live data is pre-processed and input into the support vector machine comprising the kernel that produced the optimal solution. The live output from the learning machine may then be post-processed into a computationally derived alphanumerical classifier for interpretation by a human or computer automated process.
Inventors
- 👤 Stephen D. Barnhill
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 21:30
CPC Classifications
G; G06; G06N; G06N20/00; G06F; G06F18/00; G06F18/20; G06F18/21; G06F18/214; G06F18/24; G06F18/241; G06F18/2411; G06N20/10
Claims Analysis
Total Claims: 16
Claim 1
Independent Claim
218 words
A system for enhancing knowledge discovery using multiple support vector machines comprising: one or more storage devices for storing a training data set and a test data set; a plurality of processors each for executing one of a plurality a support vector machines, each of the support vector machines comprising a different kernel; a host processor for controlling the operation of each of the processors; the host processor further operable for: collecting the training data set from the database, pre-processing the training data set to add meaning to each of a plurality of training data points, inputting the pre-processed training data set into each of the support vector machines so as to train each of the support vector machines; in response to training of each of the support vector machines, collecting the test data set from the database, pre-processing the test data set in the same manner as was the training data set, inputting the test data set into each of the trained support vector machines in order to test each of the support vector machines, and in response to receiving each of the test outputs from each of the plurality of trained support vector machines, comparing each of the test outputs with each other to determine which if any of the test output is an optimal solution.
Claim 2
Independent Claim
218 words
A system for enhancing knowledge discovery using multiple support vector machines comprising: one or more storage devices for storing a training data set and a test data set; a plurality of processors each for executing one of a plurality a support vector machines, each of the support vector machines comprising a different kernel; a host processor for controlling the operation of each of the processors; the host processor further operable for: collecting the training data set from the database, pre-processing the training data set to add meaning to each of a plurality of training data points, inputting the pre-processed training data set into each of the support vector machines so as to train each of the support vector machines; in response to training of each of the support vector machines, collecting the test data set from the database, pre-processing the test data set in the same manner as was the training data set, inputting the test data set into each of the trained support vector machines in order to test each of the support vector machines, and in response to receiving each of the test outputs from each of the plurality of trained support vector machines, comparing each of the test outputs with each other to determine which if any of the test output is an optimal solution.
Claim 3
Dependent Claim
45 words
The system of claim 1, wherein pre-processing the training data set to add meaning to each training data point comprises: determining that the training data point is dirty; and in response to determining that the training data point is dirty, cleaning the training data point.
Claim 4
Dependent Claim
40 words
The system of claim 2, wherein each training data point comprises a vector having one or more coordinates: and wherein cleaning the training data point comprises deleting, repairing or replacing one or more of the coordinates of the data point.
Claim 5
Dependent Claim
52 words
The system of claim 1, wherein each training data point comprises a vector having one or more original coordinates; and wherein pre-processing the training data set to add meaning to each training data point comprises adding dimensionality to each training data point by adding one or more new coordinates to the vector.
Claim 6
Dependent Claim
30 words
The system of claim 4, wherein the one or more new coordinates added to the vector are derived by applying a transformation to one or more of the original coordinates.
Claim 7
Dependent Claim
13 words
The system of claim 5, wherein the transformation is based on expert knowledge.
Claim 8
Dependent Claim
11 words
The system of claim 5, wherein the transformation is computationally derived.
Claim 9
Dependent Claim
29 words
The system of claim 5, wherein the training data set comprises a continuous variable; and wherein the transformation comprises optimally categorizing the continuous variable of the training data set.
Claim 10
Dependent Claim
57 words
The system of claim 1, wherein comparing each of the test outputs with each other comprises: post-processing each of the test outputs by interpreting each of the test outputs into a common format; and comparing each of the post-processed test outputs with each other to determine which of the test outputs represents a lowest global minimum error.
Claim 11
Dependent Claim
63 words
The system of claim 1, wherein the knowledge to be discovered from the data relates to a regression or density estimation; wherein each support vector machine produces a training output comprising a continuous variable; and wherein the host processor is further operable for post-processing each of the training outputs by optimally categorizing the training output to derive cutoff points in the continuous variable.
Claim 12
Dependent Claim
70 words
The system of claim 1, wherein the host processor is further operable for: in response to comparing each of the test outputs with each other, determining that none of the test outputs is the optimal solution; adjusting the different kernels of one or more of the plurality of support vector machines; and in response to adjusting the different kernels, retraining and retesting each of the plurality of support vector machines.
Claim 13
Dependent Claim
40 words
The system of claim 11, wherein adjusting the different kernels is performed based on prior performance or historical data and is dependant on the nature of the knowledge to be discovered from the data or the nature of the data.
Claim 14
Dependent Claim
110 words
The system of claim 1, wherein the host processor is further operable for: in response to comparing each of the test outputs with each other, determining that a selected one of the test outputs is the optimal solution, the selected one of the test outputs produced by a selected one of the plurality of trained support vector machines comprising a selected kernel; collecting a live data set; pre-processing the live data set in the same manner as was the training data set; inputting the pre-processed live data set into the selected trained support vector machine comprising the selected kernel; and receiving a live output from the trained support vector machine.
Claim 15
Dependent Claim
28 words
The system of claim 13, wherein the host processor is further operable for post-processing the live output by interpreting the live output into a computationally derived alphanumerical classifier.
Claim 16
Dependent Claim
120 words
The system of claim 1, wherein the host processor is further operable for: in response to comparing each of the test outputs with each other, determining that a selected one of the test outputs is the optimal solution, the selected one of the test outputs produced by a selected one of the plurality of trained support vector machines comprising a selected kernel; collecting a live data set; pre-processing the live data set in the same manner as was the training data set; and inputting the pre-processed live data set into two or more of the plurality of support vector machines configured for parallel processing based on the selected kernel; and receiving a live output from the trained support vector machine.
References Cited (Backward Citations)
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2003-10-03 | 2004-04-03 | 2004-10-03 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2007-10-03 | 2008-04-03 | 2008-10-03 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2011-10-03 | 2012-04-03 | 2012-10-03 | $7700.00 | Window Closed / Lapsed |