Patent US3238432A successfully refreshed from Google Patents.
Patent US4972187A successfully refreshed from Google Patents.
← Back to Patent Explorer
US4972187A Expired / Lapsed US ⏱️ 0.0 years remaining

Numeric encoding method and apparatus for neural networks

Assignee: Hewlett Packard Development Co LP
•
Filing: 1989-06-27
•
Granted: 1990-11-20
•
Expires: 2009-06-27
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A numeric encoding method and apparatus for neural networks, encodes numeric input data into a form applicable to an input of a neural network by partitioning a binary input into N-bit input segments, each of which is replaced with a code having M adjacent logic ones and 2<N>-1 logic zeros, the bit position of the least significant of the M logic ones corresponding to the binary value of the input segment it replaces. The codes are concatenated to form an encoded input. A decoding method decodes an output from the neural network into a binary form by partitioning the output into output segments having 2<N>+M-1 bits each, each of which is replaced with an N-bit binary segment being a bracketed weighted average of the significances of logic ones present in the output segment. The binary segments are concatenated to form a decoded output. <IMAGE>

Inventors

  • 👤 David B. Wecker

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-10-26 04:14
CPC Classifications
G; G06; G06N; G06N3/00; G06N3/02; G06N3/04

Claims Analysis

Total Claims: 35
Claim 1
Independent Claim 96 words
A method for encoding a binary input into a form applicable to input neurons of a neural network comprising the steps of: partitioning said input into groups of three bits, the bits of each three-bit group representing an octal value; and replacing each three-bit group with a group of ten bits corresponding to said octal value, said ten-bit group consisting of three logic ones and seven logic zeros, said three logic ones occupying adjacent bit positions with the least significant of said three logic ones occupying a bit position of significance corresponding to said octal value.
Claim 2
Independent Claim 96 words
A method for encoding a binary input into a form applicable to input neurons of a neural network comprising the steps of: partitioning said input into groups of three bits, the bits of each three-bit group representing an octal value; and replacing each three-bit group with a group of ten bits corresponding to said octal value, said ten-bit group consisting of three logic ones and seven logic zeros, said three logic ones occupying adjacent bit positions with the least significant of said three logic ones occupying a bit position of significance corresponding to said octal value.
Claim 3
Independent Claim 113 words
A method for encoding a binary input into a form applicable to input neurons of a neural network comprising the steps of: partitioning said input into groups of three bits, the bits of each three-bit group representing an octal value; replacing each three-bit group with a group of ten bits corresponding to said octal value, said ten-bit group consisting of three logic ones and seven logic zeros, said three logic ones occupying adjacent bit positions with the least significant of said three logic ones occupying a bit position of significance corresponding to said octal value; and concatenating said ten-bit groups, while maintaining a relationship therebetween corresponding to that between said three-bit groups respectively.
Claim 4
Independent Claim 113 words
A method for encoding a binary input into a form applicable to input neurons of a neural network comprising the steps of: partitioning said input into groups of three bits, the bits of each three-bit group representing an octal value; replacing each three-bit group with a group of ten bits corresponding to said octal value, said ten-bit group consisting of three logic ones and seven logic zeros, said three logic ones occupying adjacent bit positions with the least significant of said three logic ones occupying a bit position of significance corresponding to said octal value; and concatenating said ten-bit groups, while maintaining a relationship therebetween corresponding to that between said three-bit groups respectively.
Claim 5
Independent Claim 67 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: partitioning the digital output into ten-bit output segments; replacing each of said ten-bit output segments with a three-bit binary segment corresponding to a bracketed weighted average of the significances of logic ones present in said output segment; and concatenating said three-bit binary segments to form the binary output.
Claim 6
Independent Claim 67 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: partitioning the digital output into ten-bit output segments; replacing each of said ten-bit output segments with a three-bit binary segment corresponding to a bracketed weighted average of the significances of logic ones present in said output segment; and concatenating said three-bit binary segments to form the binary output.
Claim 7
Independent Claim 111 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: partitioning the digital output into groups of ten-bit output segments, each bit of each group having a bit position value of from zero to nine corresponding to its significance within its group and a bit weight value equal to its bit position value minus one; converting each of said ten-bit output segments into a three-bit binary segment, said binary segment being a bracketed average of the bit weight values of all bits of said output segment that consist of logic ones; and concatenating said three-bit binary segments to form the binary output.
Claim 8
Independent Claim 111 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: partitioning the digital output into groups of ten-bit output segments, each bit of each group having a bit position value of from zero to nine corresponding to its significance within its group and a bit weight value equal to its bit position value minus one; converting each of said ten-bit output segments into a three-bit binary segment, said binary segment being a bracketed average of the bit weight values of all bits of said output segment that consist of logic ones; and concatenating said three-bit binary segments to form the binary output.
Claim 9
Independent Claim 85 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: A. partitioning the digital output into groups of ten-bit output segments, each bit of each group having a bit position value of from zero to nine corresponding to its significance within its group and a bit weight value equal to its bit position value minus one; B. converting each of said ten-bit output segments into a three-bit binary segment, said converting step comprising the steps of:
Claim 10
Independent Claim 85 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: A. partitioning the digital output into groups of ten-bit output segments, each bit of each group having a bit position value of from zero to nine corresponding to its significance within its group and a bit weight value equal to its bit position value minus one; B. converting each of said ten-bit output segments into a three-bit binary segment, said converting step comprising the steps of:
Claim 11
Dependent Claim 79 words
summing said bit weight values of all bits of said output segment that consist of logic ones; 2. dividing said summation by the number of bits of said output segment that consist of logic ones, if any, to form a quotient; 3. rounding said quotient to a nearest integer; and 4. bracketing said rounded quotient between values of zero and seven to form a three-bit binary segment; and C. concatenating said three-bit binary segments to form the binary output.
Claim 12
Dependent Claim 79 words
summing said bit weight values of all bits of said output segment that consist of logic ones; 2. dividing said summation by the number of bits of said output segment that consist of logic ones, if any, to form a quotient; 3. rounding said quotient to a nearest integer; and 4. bracketing said rounded quotient between values of zero and seven to form a three-bit binary segment; and C. concatenating said three-bit binary segments to form the binary output.
Claim 13
Independent Claim 38 words
A method for processing numeric data with a neural network comprising the steps of: A. encoding a binary input into a form directly applicable to input neurons of the neural network, said encoding step comprising the steps of:
Claim 14
Independent Claim 38 words
A method for processing numeric data with a neural network comprising the steps of: A. encoding a binary input into a form directly applicable to input neurons of the neural network, said encoding step comprising the steps of:
Claim 15
Dependent Claim 222 words
partitioning said input into input segments of N bits each, each of said input segments representing a binary value; 2. replacing each input segment with a code corresponding to said binary value and consisting of M logic ones and 2 N -1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and 3. concatenating said codes to form an encoded input; B. applying said encoded input to the input neurons of the neural network and generating an encoded output from the neural network; and C. decoding said encoded output to form a binary output, said decoding step comprising the steps of: 1. partitioning said encoded output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its output segment and a bit weight value equal to its bit position value minus (M-1)/2; 2. replacing each output segment with an N-bit binary segment, said binary segment being a bracketed average of all bits of said output segment that consist of logic ones; and 3. concatenating said N-bit binary segments to form said binary output.
Claim 16
Dependent Claim 222 words
partitioning said input into input segments of N bits each, each of said input segments representing a binary value; 2. replacing each input segment with a code corresponding to said binary value and consisting of M logic ones and 2 N -1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and 3. concatenating said codes to form an encoded input; B. applying said encoded input to the input neurons of the neural network and generating an encoded output from the neural network; and C. decoding said encoded output to form a binary output, said decoding step comprising the steps of: 1. partitioning said encoded output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its output segment and a bit weight value equal to its bit position value minus (M-1)/2; 2. replacing each output segment with an N-bit binary segment, said binary segment being a bracketed average of all bits of said output segment that consist of logic ones; and 3. concatenating said N-bit binary segments to form said binary output.
Claim 17
Independent Claim 307 words
A method for processing numeric data with a neural network comprising the steps of: A. encoding a binary input into a form directly applicable to input neurons of the neural network, said encoding step comprising the steps of: 1. partitioning said input into input segments of N bits each, each of said input segments representing a binary value; 2. replacing each input segment with a code corresponding to said binary value and consisting of M logic ones and 2 N -1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and 3. concatenating said codes to form an encoded input; B. applying said encoded input to the input neurons of the neural network and generating an encoded output from the neural network; and C. decoding said encoded output to form a binary output, said decoding step comprising the steps of: 1. partitioning said encoded output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its output segment and a bit weight value equal to its bit position value minus (M-1)/2; 2. converting each output segment into an N-bit binary segment, said converting step comprising the steps of: a. summing said bit weight values of all bits of said output segment that consist of logic ones; b. dividing said summation by the number of bits of said output segment that consist of logic ones, if any, to form a quotient; c. rounding said quotient to a nearest integer; and d. bracketing said rounded quotient between values of zero and 2 N -1, forming an N-bit binary segment; and
Claim 18
Independent Claim 307 words
A method for processing numeric data with a neural network comprising the steps of: A. encoding a binary input into a form directly applicable to input neurons of the neural network, said encoding step comprising the steps of: 1. partitioning said input into input segments of N bits each, each of said input segments representing a binary value; 2. replacing each input segment with a code corresponding to said binary value and consisting of M logic ones and 2 N -1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and 3. concatenating said codes to form an encoded input; B. applying said encoded input to the input neurons of the neural network and generating an encoded output from the neural network; and C. decoding said encoded output to form a binary output, said decoding step comprising the steps of: 1. partitioning said encoded output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its output segment and a bit weight value equal to its bit position value minus (M-1)/2; 2. converting each output segment into an N-bit binary segment, said converting step comprising the steps of: a. summing said bit weight values of all bits of said output segment that consist of logic ones; b. dividing said summation by the number of bits of said output segment that consist of logic ones, if any, to form a quotient; c. rounding said quotient to a nearest integer; and d. bracketing said rounded quotient between values of zero and 2 N -1, forming an N-bit binary segment; and
Claim 19
Dependent Claim 10 words
concatenating said N-bit binary segments to form said binary output.
Claim 20
Dependent Claim 10 words
concatenating said N-bit binary segments to form said binary output.
Claim 21
Dependent Claim 17 words
The method of claim 7 wherein N is equal to three and M is equal to three.
Claim 22
Independent Claim 108 words
A method for encoding a binary input into a form applicable to input neurons of a neural network comprising the steps of: partitioning the input into input segments of N bits each, each of said input segments representing a binary value; replacing each N-bit segment with a code corresponding to said binary value and consisting of M logic ones and 2 N -1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and concatenating said codes to form an encoded input.
Claim 23
Independent Claim 108 words
A method for encoding a binary input into a form applicable to input neurons of a neural network comprising the steps of: partitioning the input into input segments of N bits each, each of said input segments representing a binary value; replacing each N-bit segment with a code corresponding to said binary value and consisting of M logic ones and 2 N -1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and concatenating said codes to form an encoded input.
Claim 24
Independent Claim 114 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: partitioning the digital output into output segments of 2 N +M-1 bits each, each bit cf each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its segment and a bit weight value equal to its bit position value minus (M-1)/2; converting each output segment into a N-bit binary segment, said binary segment being a bracketed average of the bit weight values of all bits of said output segment that consist of logic ones; and concatenating said N-bit binary segments to form the binary output.
Claim 25
Independent Claim 114 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: partitioning the digital output into output segments of 2 N +M-1 bits each, each bit cf each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its segment and a bit weight value equal to its bit position value minus (M-1)/2; converting each output segment into a N-bit binary segment, said binary segment being a bracketed average of the bit weight values of all bits of said output segment that consist of logic ones; and concatenating said N-bit binary segments to form the binary output.
Claim 26
Independent Claim 106 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: A. partitioning the digital output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its segment and a bit weight value equal to its bit position value minus (M-1)/2; B. converting each output segment into an N-bit binary segment, said converting step comprising the steps of: 1. summing said bit weight values of all bits of said output segment that consist of logic ones;
Claim 27
Independent Claim 106 words
A method for decoding a digital output from a neural network into a binary output comprising the steps of: A. partitioning the digital output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its segment and a bit weight value equal to its bit position value minus (M-1)/2; B. converting each output segment into an N-bit binary segment, said converting step comprising the steps of: 1. summing said bit weight values of all bits of said output segment that consist of logic ones;
Claim 28
Dependent Claim 63 words
dividing said summation by the number of bits of said output segment that consist of logic ones, if any, to form a quotient; 3. rounding said quotient to a nearest integer; and 4. bracketing said rounded quotient between values of zero and 2 N -1 to form an N-bit binary segment; and C. concatenating said N-bit binary segments to form the binary output.
Claim 29
Dependent Claim 63 words
dividing said summation by the number of bits of said output segment that consist of logic ones, if any, to form a quotient; 3. rounding said quotient to a nearest integer; and 4. bracketing said rounded quotient between values of zero and 2 N -1 to form an N-bit binary segment; and C. concatenating said N-bit binary segments to form the binary output.
Claim 30
Dependent Claim 109 words
An encoder for encoding a binary input into a form applicable to input neurons of a neural network comprising: means for partitioning the input into input segments of N bits each, each of said input segments representing a binary value; means for converting each N-bit segment into a code corresponding to said binary value and consisting of M logic ones and 2N-1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and means for concatenating said codes to form an encoded input.
Claim 31
Dependent Claim 109 words
An encoder for encoding a binary input into a form applicable to input neurons of a neural network comprising: means for partitioning the input into input segments of N bits each, each of said input segments representing a binary value; means for converting each N-bit segment into a code corresponding to said binary value and consisting of M logic ones and 2N-1 logic zeros, said M logic ones occupying adjacent bit positions in said code with the least significant of said M logic ones occupying a bit position in said code of significance corresponding to said binary value; and means for concatenating said codes to form an encoded input.
Claim 32
Dependent Claim 17 words
The encoder of claim 12 wherein N is equal to three and M is equal to three.
Claim 33
Dependent Claim 117 words
A decoder for decoding a digital output from a neural network into a binary output comprising: means for partitioning the digital output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its segment and a bit weight value equal to its bit position value minus (M-1)/2; means for converting each output segment into a N-bit binary segment, said binary segment being a bracketed average of the bit weight values of all bits of said output segment that consist of logic ones; and means for concatenating said N-bit binary segments to form the binary output.
Claim 34
Dependent Claim 117 words
A decoder for decoding a digital output from a neural network into a binary output comprising: means for partitioning the digital output into output segments of 2 N +M-1 bits each, each bit of each segment having an integer bit position value of from zero to 2 N +M-2 corresponding to its significance within its segment and a bit weight value equal to its bit position value minus (M-1)/2; means for converting each output segment into a N-bit binary segment, said binary segment being a bracketed average of the bit weight values of all bits of said output segment that consist of logic ones; and means for concatenating said N-bit binary segments to form the binary output.
Claim 35
Dependent Claim 17 words
The decoder of claim 14 wherein N is equal to three and M is equal to three.

References Cited (Backward Citations)

US4773024A Cited
US4802103A Cited
US4855742A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1993-11-19 1994-05-21 1994-11-20 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1997-11-19 1998-05-21 1998-11-20 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2001-11-19 2002-05-21 2002-11-20 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag