Compact encoding of multi-lingual translation dictionaries

Claim 1

A method for making a database stored upon a computer readable medium used with a computer for use as a computerized multi-lingual dictionary for translating words and phrases in a first language into words and phrases in at least a second language, comprising the steps: (a) defining a set of abstract concept groups capable of encompassing all words and phrases to be translated of the first and second languages, each concept group containing words and phrases having related meanings and all of said words and phrases to be translated being included in at least one of the concept groups, such phrases comprising a string made up of words and punctuations, (b) providing a word-number mapper capable of inversely associating a unique first number between 0 and N-1 with each of the unique words or punctuations of the first language with N being the total number of unique words and punctuations in the first language, (c) mapping each unique word or punctuation to a unique first number using the mapper of step (b) and storing the resultant mapping, (d) separating one or more first numbers from one or more other first numbers with a second number, (e) forming a set of pairs of first and second numbers representative of each of the concept groups in said first language, (f) forming a translator file for said first language by combining the first and second number pairs of all the concept groups.

Claim 2

A method for making a database stored upon a computer readable medium used with a computer for use as a computerized multi-lingual dictionary for translating words and phrases in a first language into words and phrases in at least a second language, comprising the steps: (a) defining a set of abstract concept groups capable of encompassing all words and phrases to be translated of the first and second languages, each concept group containing words and phrases having related meanings and all of said words and phrases to be translated being included in at least one of the concept groups, such phrases comprising a string made up of words and punctuations, (b) providing a word-number mapper capable of inversely associating a unique first number between 0 and N-1 with each of the unique words or punctuations of the first language with N being the total number of unique words and punctuations in the first language, (c) mapping each unique word or punctuation to a unique first number using the mapper of step (b) and storing the resultant mapping, (d) separating one or more first numbers from one or more other first numbers with a second number, (e) forming a set of pairs of first and second numbers representative of each of the concept groups in said first language, (f) forming a translator file for said first language by combining the first and second number pairs of all the concept groups.

Claim 8

A method for making a database stored upon a computer readable medium used with a computer for use in a computerized multi-lingual dictionary for translating words and phrases in a first language into words and phrases in at least a second language, comprising the steps: storing in the database each word and word separator in a phrase as one or more first numbers paired with a second number associated with a bit-mapped sense vector for easy matching with other bit-mapped sense vectors.

Claim 9

A method for making a database stored upon a computer readable medium used with a computer for use in a computerized multi-lingual dictionary for translating words and phrases in a first language into words and phrases in at least a second language, comprising the steps: storing in the database each word and word separator in a phrase as one or more first numbers paired with a second number associated with a bit-mapped sense vector for easy matching with other bit-mapped sense vectors.

Claim 12

A method of making a compressed translator file as part of a database stored upon a computer readable medium used with a computer for use as a computerized multi-lingual dictionary for translating words and phrases in a first language into words and phrases in at least a second language, comprising the steps: (a) defining a set of abstract concept groups capable of encompassing all words and phrases to be translated of the first and second languages, each concept group containing words and phrases having related meanings and all of said words and phrases to be translated being included in at least one of the concept groups, such phrases comprising a string made up of words and punctuations, (b) establishing a collection of N unique tokens made up of each unique word or punctuation, (c) providing a word-number mapper capable of inversely associating a unique first number between 0 and (N-1) with each of the unique tokens, (d) mapping each unique token established in step (b) to a unique first number using the mapper of step (c) and storing the resultant mapping, (e) creating and storing a translation vector constituting a sequence of second numbers for each word or phrase that can be translated of the first language, each translation vector including those numbers representative of different senses in the same concept group that the word or phrase can express, the total T of said translation vectors that are unique across all the concept groups being substantially less than the total number of words and phrases, said translation vectors being constituted by fixed length bit vectors, (f) computing from each translation vector a unique translation vector indicator third number having a value between N and N+(T-1), (g) forming a temporary first file made up of a sequence of first numbers denoting words and punctuations and third numbers denoting the translation vector indicators, (h) computing the frequencies of the numbers in the temporary first file and encoding same with fourth numbers of different length such that shorter fourth numbers are used to encode higher frequency numbers in the temporary first file and longer fourth numbers are used to encode lower frequency numbers, (i) forming and storing a temporary second file made up of a sequence of the fourth numbers, (j) computing the length of each concept group represented by fourth numbers in the temporary second file, (k) storing the length of each concept group as a prefix to the sequence of fourth numbers representative of each concept group to form a final stored translator file made up solely of numbers and representing every word and phrase of the first language, (l) repeating steps (e)-(k) for each word and phrase of the second language.

Claim 13

A method of making a compressed translator file as part of a database stored upon a computer readable medium used with a computer for use as a computerized multi-lingual dictionary for translating words and phrases in a first language into words and phrases in at least a second language, comprising the steps: (a) defining a set of abstract concept groups capable of encompassing all words and phrases to be translated of the first and second languages, each concept group containing words and phrases having related meanings and all of said words and phrases to be translated being included in at least one of the concept groups, such phrases comprising a string made up of words and punctuations, (b) establishing a collection of N unique tokens made up of each unique word or punctuation, (c) providing a word-number mapper capable of inversely associating a unique first number between 0 and (N-1) with each of the unique tokens, (d) mapping each unique token established in step (b) to a unique first number using the mapper of step (c) and storing the resultant mapping, (e) creating and storing a translation vector constituting a sequence of second numbers for each word or phrase that can be translated of the first language, each translation vector including those numbers representative of different senses in the same concept group that the word or phrase can express, the total T of said translation vectors that are unique across all the concept groups being substantially less than the total number of words and phrases, said translation vectors being constituted by fixed length bit vectors, (f) computing from each translation vector a unique translation vector indicator third number having a value between N and N+(T-1), (g) forming a temporary first file made up of a sequence of first numbers denoting words and punctuations and third numbers denoting the translation vector indicators, (h) computing the frequencies of the numbers in the temporary first file and encoding same with fourth numbers of different length such that shorter fourth numbers are used to encode higher frequency numbers in the temporary first file and longer fourth numbers are used to encode lower frequency numbers, (i) forming and storing a temporary second file made up of a sequence of the fourth numbers, (j) computing the length of each concept group represented by fourth numbers in the temporary second file, (k) storing the length of each concept group as a prefix to the sequence of fourth numbers representative of each concept group to form a final stored translator file made up solely of numbers and representing every word and phrase of the first language, (l) repeating steps (e)-(k) for each word and phrase of the second language.