US6006186A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Method and apparatus for a parameter sharing speech recognition system
Assignee: Sony Corp
•
Filing: 1997-10-16
•
Granted: 1999-12-21
•
Expires: 2017-10-16
Abstract
Abstract A method and an apparatus for a parameter sharing speech recognition system are provided. Speech signals are received into a processor of a speech recognition system. The speech signals are processed using a speech recognition system hosting a shared hidden Markov model (HMM) produced by generating a number of phoneme models, some of which are shared. The phoneme models are generated by retaining as a separate phoneme model any triphone model having a number of trained frames available that exceeds a prespecified threshold. A shared phoneme model is generated to represent each of the groups of triphone phoneme models for which the number of trained frames having a common biphone exceed the prespecified threshold. A shared phoneme model is generated to represent each of the groups of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceed the prespecified threshold. A shared phoneme model is generated to represent each of the groups of triphone phoneme models having the same center context. The generated phoneme models are trained, and shared phoneme model states are generated that are shared among the phoneme models. Shared probability distribution functions are generated that are shared among the phoneme model states. Shared probability sub-distribution functions are generated that are shared among the phoneme model probability distribution functions. The shared phoneme model hierarchy is reevaluated for further sharing in response to the shared probability sub-distribution functions. Signals representative of the received speech signals are generated.
Inventors
- 👤 Ruxin Chen
- 👤 Miyuki Tanaka
- 👤 Duanpei Wu
- 👤 Lex S. Olorenshaw
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 13:47
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/08; G10L15/14; G10L15/142; G10L15/148
Claims Analysis
Total Claims: 55
Claim 1
Independent Claim
85 words
A method for recognizing speech comprising the steps of: receiving speech signals into a processor; processing the received speech signals using a speech recognition system produced by generating a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and generating signals representative of the received speech signals.
Claim 2
Independent Claim
85 words
A method for recognizing speech comprising the steps of: receiving speech signals into a processor; processing the received speech signals using a speech recognition system produced by generating a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and generating signals representative of the received speech signals.
Claim 3
Dependent Claim
54 words
The method of claim 1, wherein the speech recognition system is produced by: training the plurality of phoneme models; generating a plurality of shared probability sub-distribution functions from the trained plurality of phoneme models; and evaluating the plurality of phoneme models for further sharing in response to the plurality of shared probability sub-distribution functions.
Claim 4
Dependent Claim
99 words
The method of claim 2, wherein the plurality of shared probability sub-distribution functions are generated by: generating a plurality of phoneme model states, wherein at least one of the plurality of states are shared among the plurality of phoneme models; generating a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of states; and generating a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability distribution functions.
Claim 5
Dependent Claim
104 words
The method of claim 3, wherein the plurality of shared probability sub-distribution functions are generated by: generating a plurality of phoneme model states, wherein at least one of the plurality of phoneme model states are shared among the plurality of phoneme model states; generating a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of probability distribution functions; and generating a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability sub-distribution functions.
Claim 6
Dependent Claim
97 words
The method of claim 2, wherein the plurality of phoneme models for further sharing are evaluated by: generating a shared phoneme model probability distribution function to replace a plurality of probability distribution functions when each of the plurality of probability distribution functions has common probability sub-distribution functions; generating a shared phoneme model state to replace a plurality of states when each of the plurality of states has common phoneme model probability distribution functions; and generating a shared phoneme model to replace a plurality of models when each of the plurality of models has common phoneme model states.
Claim 7
Dependent Claim
32 words
The method of claim 2, wherein the plurality of shared probability distribution functions for a discrete hidden Markov model are generated from a continuous distribution function of a continuous hidden Markov model.
Claim 8
Dependent Claim
12 words
The method of claim 1, wherein the phoneme models are context dependent.
Claim 9
Dependent Claim
17 words
The method of claim 1, wherein the speech recognition system is based on a statistical learning approach.
Claim 10
Dependent Claim
15 words
The method of claim 8, wherein the statistical learning approach is a hidden Markov model.
Claim 11
Dependent Claim
117 words
The method of claim 1, wherein a plurality of phoneme models are generated by: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 12
Dependent Claim
34 words
The method of claim 10, wherein at least one shared phoneme model is generated comprising at least one context, the at least one context having statistical properties representative of a plurality of context phonemes.
Claim 13
Dependent Claim
18 words
The method of claim 1, wherein sharing occurs among a plurality of levels of a speech recognition model.
Claim 14
Dependent Claim
18 words
The method of claim 1, wherein sharing occurs within at least one level of a speech recognition model.
Claim 15
Dependent Claim
24 words
The method of claim 1, wherein the step of evaluating the plurality of phoneme models for further sharing is repeated at least one time.
Claim 16
Dependent Claim
19 words
The method of claim 1, wherein the plurality of phoneme models integrate discrete observation modeling and continuous observation modeling.
Claim 17
Independent Claim
109 words
An apparatus for speech recognition comprising: an input for receiving speech signals into a processor; a processor configured to recognize the received speech signals using a speech recognition system to generate a signal representative of the received speech signal, the speech recognition system produced by generating and training a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and an output for providing a signal representative of the received speech signal.
Claim 18
Independent Claim
109 words
An apparatus for speech recognition comprising: an input for receiving speech signals into a processor; a processor configured to recognize the received speech signals using a speech recognition system to generate a signal representative of the received speech signal, the speech recognition system produced by generating and training a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and an output for providing a signal representative of the received speech signal.
Claim 19
Dependent Claim
115 words
The apparatus of claim 16, wherein the speech recognition system is produced by: generating a plurality of phoneme model states, wherein at least one of the plurality of states are shared among the plurality of phoneme models; generating a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of states; generating a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability distribution functions; and evaluating the plurality of phoneme models for further sharing in response to the plurality of shared probability sub-distribution functions.
Claim 20
Dependent Claim
97 words
The apparatus of claim 17, wherein the plurality of phoneme models are evaluated for further sharing by: generating a shared phoneme model probability distribution function to replace a plurality of probability distribution functions when each of the plurality of probability distribution functions has common probability sub-distribution functions; generating a shared phoneme model state to replace a plurality of states when each of the plurality of states has common phoneme model probability distribution functions; and generating a shared phoneme model to replace a plurality of models when each of the plurality of models has common phoneme model states.
Claim 21
Dependent Claim
32 words
The apparatus of claim 16, wherein sharing occurs among a plurality of levels of a speech recognition model, and wherein sharing occurs within at least one level of a speech recognition model.
Claim 22
Dependent Claim
117 words
The apparatus of claim 16, wherein the plurality of phoneme models are generated by: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 23
Dependent Claim
77 words
A speech recognition process comprising a statistical learning technique that uses a model, the model produced by: generating and training a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes; generating a plurality of shared probability sub-distribution functions from the trained plurality of phoneme models; and evaluating the plurality of phoneme models for further sharing in response to the plurality of shared probability sub-distribution functions.
Claim 24
Dependent Claim
77 words
A speech recognition process comprising a statistical learning technique that uses a model, the model produced by: generating and training a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes; generating a plurality of shared probability sub-distribution functions from the trained plurality of phoneme models; and evaluating the plurality of phoneme models for further sharing in response to the plurality of shared probability sub-distribution functions.
Claim 25
Dependent Claim
34 words
The speech recognition process of claim 21, wherein sharing occurs among a plurality of levels of a speech recognition model, and wherein sharing occurs within at least one level of a speech recognition model.
Claim 26
Dependent Claim
33 words
The speech recognition process of claim 21, wherein the plurality of phoneme models are context dependent hidden Markov models, wherein the plurality of phoneme models integrate discrete observation modeling and continuous observation modeling.
Claim 27
Dependent Claim
119 words
The speech recognition process of claim 21, wherein the plurality of phoneme models are generated by: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 28
Dependent Claim
101 words
The speech recognition process of claim 21, wherein the plurality of shared probability sub-distribution functions are generated by: generating a plurality of phoneme model states, wherein at least one of the plurality of states are shared among the plurality of phoneme models; generating a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of states; and generating a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability distribution functions.
Claim 29
Dependent Claim
99 words
The speech recognition process of claim 21, wherein the plurality of phoneme models are evaluated for further sharing by: generating a shared phoneme model probability distribution function to replace a plurality of probability distribution functions when each of the plurality of probability distribution functions has common probability sub-distribution functions; generating a shared phoneme model state to replace a plurality of states when each of the plurality of states has common phoneme model probability distribution functions; and generating a shared phoneme model to replace a plurality of models when each of the plurality of models has common phoneme model states.
Claim 30
Independent Claim
125 words
A method for generating a plurality of phoneme models for use in a speech recognition system, the method comprising the steps of: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 31
Independent Claim
125 words
A method for generating a plurality of phoneme models for use in a speech recognition system, the method comprising the steps of: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 32
Dependent Claim
13 words
The method of claim 27, wherein the phoneme models are hidden Markov models.
Claim 33
Dependent Claim
99 words
A computer readable medium containing executable instructions which, when executed in a processing system, causes the system to perform the steps for recognizing speech comprising: receiving speech signals into a processor; processing the received speech signals using a speech recognition system comprising a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and generating signals representative of the received speech signals.
Claim 34
Dependent Claim
99 words
A computer readable medium containing executable instructions which, when executed in a processing system, causes the system to perform the steps for recognizing speech comprising: receiving speech signals into a processor; processing the received speech signals using a speech recognition system comprising a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and generating signals representative of the received speech signals.
Claim 35
Dependent Claim
117 words
The computer readable medium of claim 29, wherein the speech recognition system is produced by: generating a plurality of phoneme model states, wherein at least one of the plurality of states are shared among the plurality of phoneme models; generating a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of states; generating a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability distribution functions; and evaluating the plurality of phoneme models for further sharing in response to the plurality of shared probability sub-distribution functions.
Claim 36
Dependent Claim
34 words
The computer readable medium of claim 29, wherein sharing occurs among a plurality of levels of a speech recognition model, and wherein sharing occurs within at least one level of a speech recognition model.
Claim 37
Dependent Claim
119 words
The computer readable medium of claim 29, wherein the plurality of phoneme models are generated by: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 38
Independent Claim
81 words
A method for recognizing speech comprising the steps of: receiving speech signals into a processor; processing the received speech signals using a model comprising a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and generating signals representative of the received speech signals.
Claim 39
Independent Claim
81 words
A method for recognizing speech comprising the steps of: receiving speech signals into a processor; processing the received speech signals using a model comprising a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and generating signals representative of the received speech signals.
Claim 40
Dependent Claim
90 words
The method of claim 33, wherein the model further comprises: a plurality of phoneme model states, wherein at least one of the plurality of states are shared among the plurality of phoneme models; a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of states; and a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability distribution functions.
Claim 41
Dependent Claim
117 words
The method of claim 33, wherein the plurality of phoneme models are generated by: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 42
Dependent Claim
98 words
The method of claim 33, wherein a plurality of shared phoneme models are evaluated for further sharing by: generating a shared phoneme model probability distribution function to replace a plurality of probability distribution functions when each of the plurality of probability distribution functions has common probability sub-distribution functions; generating a shared phoneme model state to replace a plurality of states when each of the plurality of states has common phoneme model probability distribution functions; and generating a shared phoneme model to replace a plurality of models when each of the plurality of models has common phoneme model states.
Claim 43
Independent Claim
91 words
An apparatus for speech recognition comprising: an input configured to receive speech signals into a processor; a processor configured to process the received speech signals using a model comprising a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and an output configured to provide a signal representative of the received speech signal.
Claim 44
Independent Claim
91 words
An apparatus for speech recognition comprising: an input configured to receive speech signals into a processor; a processor configured to process the received speech signals using a model comprising a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and an output configured to provide a signal representative of the received speech signal.
Claim 45
Dependent Claim
90 words
The apparatus of claim 37, wherein the model further comprises: a plurality of phoneme model states, wherein at least one of the plurality of states are shared among the plurality of phoneme models; a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of states; and a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability distribution functions.
Claim 46
Dependent Claim
117 words
The apparatus of claim 37, wherein the plurality of phoneme models are generated by: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 47
Dependent Claim
100 words
A computer readable medium containing executable instructions which, when executed in a processing system, causes the system to perform the steps for recognizing speech comprising: receiving speech signals into a processor; processing the received speech signals using a model comprising a plurality of context dependent phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and providing output signals representative of the received speech signals.
Claim 48
Dependent Claim
100 words
A computer readable medium containing executable instructions which, when executed in a processing system, causes the system to perform the steps for recognizing speech comprising: receiving speech signals into a processor; processing the received speech signals using a model comprising a plurality of context dependent phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and providing output signals representative of the received speech signals.
Claim 49
Dependent Claim
92 words
The computer readable medium of claim 40, wherein the model further comprises: a plurality of phoneme model states, wherein at least one of the plurality of states are shared among the plurality of phoneme models; a plurality of phoneme model probability distribution functions, wherein at least one of the plurality of probability distribution functions are shared among the plurality of states; and a plurality of phoneme model probability sub-distribution functions, wherein at least one of the plurality of probability sub-distribution functions are shared among the plurality of phoneme model probability distribution functions.
Claim 50
Dependent Claim
119 words
The computer readable medium of claim 40, wherein the plurality of phoneme models are generated by: retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 51
Dependent Claim
100 words
The computer readable medium of claim 40, wherein a plurality of shared phoneme models are evaluated for further sharing by: generating a shared phoneme model probability distribution function to replace a plurality of probability distribution functions when each of the plurality of probability distribution functions has common probability sub-distribution functions; generating a shared phoneme model state to replace a plurality of states when each of the plurality of states has common phoneme model probability distribution functions; and generating a shared phoneme model to replace a plurality of models when each of the plurality of models has common phoneme model states.
Claim 52
Independent Claim
88 words
A system for recognizing speech comprising: means for receiving speech signals into a processor; means for processing the received speech signals using a speech recognition system produced by generating a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and means for generating signals representative of the received speech signals.
Claim 53
Independent Claim
88 words
A system for recognizing speech comprising: means for receiving speech signals into a processor; means for processing the received speech signals using a speech recognition system produced by generating a plurality of phoneme models, wherein at least one of the plurality of phoneme models are shared among a plurality of phonemes, and at least a first one of the plurality of phoneme models are shared with at least a second one of the plurality of phoneme models; and means for generating signals representative of the received speech signals.
Claim 54
Independent Claim
128 words
A system for generating a plurality of phoneme models for use in a speech recognition system, comprising: means for retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; means for generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; means for generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and means for generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
Claim 55
Independent Claim
128 words
A system for generating a plurality of phoneme models for use in a speech recognition system, comprising: means for retaining as a separate phoneme model a triphone phoneme model for which a number of trained frames exceeds a threshold; means for generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having a common biphone exceeds the threshold; means for generating at least one shared phoneme model to represent a plurality of triphone phoneme models for which the number of trained frames having an equivalent effect on a phonemic context exceeds the threshold; and means for generating at least one shared phoneme model to represent a plurality of triphone phoneme models having the same center context.
References Cited (Backward Citations)
US4592085A
Cited
US5003601A
Cited
US4803729A
Cited
US5093899A
Cited
US5027406A
Cited
US5335261A
Cited
US5566271A
Cited
US5301257A
Cited
US5355432A
Cited
US5390278A
Cited
US5390280A
Cited
US5561722A
Cited
US5469512A
Cited
US5513298A
Cited
US5615296A
Cited
US5621859A
Cited
US5583965A
Cited
US5715367A
Cited
US5765133A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2002-12-20 | 2003-06-21 | 2003-12-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2006-12-20 | 2007-06-21 | 2007-12-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2010-12-20 | 2011-06-21 | 2011-12-21 | $7700.00 | Window Closed / Lapsed |