US8121356B2
Active / In Force
US
⏱️ 1.8 years remaining
Long distance multimodal biometric system and method
Assignee: Idemia Identity and Security USA LLC
•
Filing: 2008-09-10
•
Granted: 2012-02-21
•
Expires: 2028-09-10
Abstract
Abstract A system for multimodal biometric identification has a first imaging system that detects one or more subjects in a first field of view, including a targeted subject having a first biometric characteristic and a second biometric characteristic; a second imaging system that captures a first image of the first biometric characteristic according to first photons, where the first biometric characteristic is positioned in a second field of view smaller than the first field of view, and the first image includes first data for biometric identification; a third imaging system that captures a second image of the second biometric characteristic according to second photons, where the second biometric characteristic is positioned in a third field of view which is smaller than the first and second fields of view, and the second image includes second data for biometric identification. At least one active illumination source emits the second photons.
Inventors
- 👤 Marc D. Friedman
- 👤 Nicholas A. Accomando
- 👤 Faisal Bashir
- 👤 Pablo Casaverde
- 👤 Stephen F. Daly
- 👤 David J. Hitchcock
- 👤 Romina Marie Johnson Jose
- 👤 Tim McNerney
- 👤 David Muller
- 👤 Vladimir Ruzhitsky
- 👤 Yasunari Tosa
- 👤 David Usher
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-06 10:07
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/18; G06V40/19; G06V40/16; G06V40/161; G06V40/166
Claims Analysis
Total Claims: 84
Claim 1
Independent Claim
185 words
A system for capturing biometric data from a subject, comprising: a first imaging system having a first field of view and capturing at least one first image in which a subject is detected; a second imaging system having a second field of view; a third imaging system having a third field of view; and an adjustment system coupled to the second imaging system and the third imaging system, the adjustment system being movable according to a position of the subject detected in the first field of view, movement of the adjustment system causing the subject to be positioned in at least one of the second field of view and the third field of view, the second imaging system capturing at least one second image from the subject when the subject is positioned in the second field of view, and the third imaging system capturing at least one third image from the subject when the subject is positioned in the third field of view, the at least one third image being determined from the at least one second image and providing biometric data for the subject.
Claim 2
Independent Claim
185 words
A system for capturing biometric data from a subject, comprising: a first imaging system having a first field of view and capturing at least one first image in which a subject is detected; a second imaging system having a second field of view; a third imaging system having a third field of view; and an adjustment system coupled to the second imaging system and the third imaging system, the adjustment system being movable according to a position of the subject detected in the first field of view, movement of the adjustment system causing the subject to be positioned in at least one of the second field of view and the third field of view, the second imaging system capturing at least one second image from the subject when the subject is positioned in the second field of view, and the third imaging system capturing at least one third image from the subject when the subject is positioned in the third field of view, the at least one third image being determined from the at least one second image and providing biometric data for the subject.
Claim 3
Dependent Claim
26 words
The system according to claim 1 , wherein the adjustment system pans about a vertical axis of rotation and tilts about a horizontal axis of rotation.
Claim 4
Dependent Claim
63 words
The system according to claim 2 , wherein (x, y) positions for pixels in the first field of view of the first imaging system are mapped to pan angles about the vertical axis of rotation and tilt angles about the horizontal axis of rotation such that the (x, y) positions are positioned in the second field of view of the second imaging system.
Claim 5
Dependent Claim
21 words
The system according to claim 1 , wherein the second imaging system is in fixed alignment with the third imaging system.
Claim 6
Dependent Claim
28 words
The system according to claim 1 , wherein the adjustment system includes a movable support on which the second imaging system and the third imaging system are disposed.
Claim 7
Dependent Claim
40 words
The system according to claim 1 , further comprising an illuminator that propagates an illumination beam, the illuminator being coupled to the adjustment device, the movement of the adjustment system causing the illumination beam to be directed at the subject.
Claim 8
Dependent Claim
38 words
The system according to claim 6 , wherein the illuminator propagates the illumination beam according to a vertical direction and a horizontal direction, the vertical direction and the horizontal direction being independently adjustable to move the illumination beam.
Claim 9
Dependent Claim
31 words
The system according to claim 6 , wherein the illuminator is a laser illuminator that propagates a collimated beam having a substantially uniform illumination profile over a distance to the subject.
Claim 10
Dependent Claim
67 words
The system according to claim 1 , wherein the subject is one of a plurality of subjects detected in the first field of view, and the adjustment system is moved in a sequence according to the position of each subject to position each subject in at least one of the second field of view and the third field of view, the sequence being determined by a scheduler.
Claim 11
Dependent Claim
30 words
The system according to claim 9 , wherein the scheduler determined the sequence according to one of physical characteristics, behavioral characteristics, and other biometric characteristics of the plurality of subjects.
Claim 12
Dependent Claim
18 words
The system according to claim 1 , wherein the first imaging system captures images of a fixed scene.
Claim 13
Dependent Claim
27 words
The system according to claim 11 , wherein the first imaging system includes a plurality of cameras substantially overlapping and the first field of view is 360-degrees.
Claim 14
Dependent Claim
35 words
The system according to claim 1 , wherein the second field of view is smaller than the first field of view, and the third field of view is smaller than the second field of view.
Claim 15
Dependent Claim
15 words
The system according to claim 1 , wherein the third imaging system includes dual sensors.
Claim 16
Dependent Claim
18 words
The system according to claim 14 , wherein the dual sensors reside on a single printed circuit board.
Claim 17
Dependent Claim
22 words
The system according to claim 14 , wherein the dual sensors are spaced according to a pupillary distance between the subject's eyes.
Claim 18
Dependent Claim
24 words
The system according to claim 14 , wherein the dual sensors capture iris images from the subject, and the iris images contain biometric data.
Claim 19
Dependent Claim
50 words
The system according to claim 14 , wherein the third imaging system further includes an imaging lens and two beam splitters disposed at an imaging plane of the imaging lens, the beam splitters splitting the eye images and sending each eye image to a corresponding one of the dual sensors.
Claim 20
Dependent Claim
27 words
The system according to claim 18 , wherein the third imaging system further includes relay lenses modifying a magnification of the eye images for the dual sensors.
Claim 21
Dependent Claim
29 words
The system according to claim 14 , wherein the third imaging system further includes an imaging lens and a motorized lens that modifies a focus of the imaging lens.
Claim 22
Dependent Claim
39 words
The system according to claim 14 , wherein the third imaging system further includes a rangefinder, and a long focal length zoom lens used in combination with the dual sensors, the zoom lens being controlled according to the rangefinder.
Claim 23
Dependent Claim
25 words
The system according to claim 14 , wherein the third imaging system further includes at least one illumination source providing illumination for the subject's eyes.
Claim 24
Dependent Claim
24 words
The system according to claim 22 , wherein the illumination has near-infrared wavelengths in the range of approximately 700 nm to approximately 950 nm.
Claim 25
Dependent Claim
25 words
The system according to claim 14 , wherein the third imaging system includes a focal length zoom lens used in combination with the dual sensors.
Claim 26
Dependent Claim
50 words
The system according to claim 1 , wherein the second imaging system captures a plurality of facial images from the subject, the plurality of facial images providing eye tracking information for the subject, and the third imaging system captures eye images from the subject, the eye images providing biometric data.
Claim 27
Dependent Claim
24 words
The system according to claim 25 , wherein the third imaging system captures iris images from the subject, the iris images providing biometric data.
Claim 28
Dependent Claim
18 words
The system according to claim 25 , wherein the subject's eyes are centered in the third imaging system.
Claim 29
Dependent Claim
58 words
The system according to claim 25 , wherein a subject-servo-loop tracks the movement of the adjustment system and a motion of the subject, the adjustment system being moved according to the motion of the subject to allow the second imaging system to capture the plurality of facial images and the third imaging system to capture the eye images.
Claim 30
Dependent Claim
40 words
The system according to claim 28 , wherein position data from the adjustment system is determined according to a frequency and provides input for a time-based movement model that estimates past and future positions and velocities for the adjustment system.
Claim 31
Dependent Claim
85 words
The system according to claim 25 , further comprising a rangefinder, wherein the adjustment system is further coupled to the rangefinder, the movement of the adjustment system causing the rangefinder to be directed at the subject, and the rangefinder provides range information that is used in combination with the eye tracking information to model the motion of the subject, the range information indicating the motion of the subject in a z-direction and the eye tracking information indicating the motion of the subject in x, y-directions.
Claim 32
Dependent Claim
42 words
The system according to claim 25 , wherein the third imaging system includes a camera and a long focal length zoom lens, a focus of the camera and a zoom of a camera being controlled to match the motion of the subject.
Claim 33
Dependent Claim
72 words
The system according to claim 25 , further comprising at least one set of stereo cameras, wherein the at least one set of stereo cameras provides range information that is used in combination with the eye tracking information to model the motion of the subject, the range information indicating the motion of the subject in the z-direction and the eye tracking information indicating the motion of the subject in the x, y-directions.
Claim 34
Dependent Claim
50 words
The system according to claim 32 , wherein the at least one set of stereo cameras includes a plurality of stereo cameras based on a volume of the first field of view, the plurality of stereo cameras being separated and having a magnification according to a distance to the subject.
Claim 35
Independent Claim
84 words
A system for capturing biometric data a subject, comprising: a first imaging system capturing at least one first image and detecting a subject; a second imaging system being movable to track the subject and capturing at least one facial image from the subject; a third imaging system including dual sensors, the third imaging system determining a position of the subject's eyes in the at least one facial image and the dual sensors capturing eye images from the subject, the eye images containing biometric data.
Claim 36
Independent Claim
84 words
A system for capturing biometric data a subject, comprising: a first imaging system capturing at least one first image and detecting a subject; a second imaging system being movable to track the subject and capturing at least one facial image from the subject; a third imaging system including dual sensors, the third imaging system determining a position of the subject's eyes in the at least one facial image and the dual sensors capturing eye images from the subject, the eye images containing biometric data.
Claim 37
Dependent Claim
18 words
The system according to claim 34 , wherein the dual sensors reside on a single printed circuit board.
Claim 38
Dependent Claim
22 words
The system according to claim 34 , wherein the dual sensors are spaced according to a pupillary distance between the subject's eyes.
Claim 39
Dependent Claim
24 words
The system according to claim 34 , wherein the dual sensors capture iris images from the subject, and the iris images contain biometric data.
Claim 40
Dependent Claim
50 words
The system according to claim 34 , wherein the third imaging system further includes an imaging lens and two beam splitters disposed at an imaging plane of the imaging lens, the beam splitters splitting the eye images and sending each eye image to a corresponding one of the dual sensors.
Claim 41
Dependent Claim
27 words
The system according to claim 38 , wherein the third imaging system further includes relay lenses modifying a magnification of the eye images for the dual sensors.
Claim 42
Dependent Claim
29 words
The system according to claim 34 , wherein the third imaging system further includes an imaging lens and a motorized lens that modifies a focus of the imaging lens.
Claim 43
Dependent Claim
40 words
The system according to claim 34 , wherein the third imaging system further includes a rangefinder, and a long focal length zoom lens used in combination with the dual sensor camera, the zoom lens being controlled according to the rangefinder.
Claim 44
Dependent Claim
25 words
The system according to claim 34 , wherein the third imaging system further includes at least one illumination source providing illumination for the subject's eyes.
Claim 45
Dependent Claim
24 words
The system according to claim 34 , wherein the illumination has near-infrared wavelengths in the range of approximately 700 nm to approximately 950 nm.
Claim 46
Dependent Claim
218 words
A product comprising a non-transitory machine-readable medium containing instructions for determining biometric data from one or more subjects, the instructions when executed by the machine comprising the acts of: receiving a plurality of scene images from a first field of view, each scene image including a background image and a foreground image, the foreground image containing one or more subject images, the one or more subject images including eye images having biometric data corresponding to one or more subjects; detecting, in each scene image, the foreground image relative to the background image; detecting, in each scene image, the one or more subject images in the foreground image; detecting facial images corresponding to the one or more subject images; tracking, in the plurality of scene images, the detected facial images corresponding to the one or more subject images; scheduling the tracked facial images for acquisition of the biometric data; directing a second field of view to the tracked facial images according to the act of scheduling; receiving the tracked facial images from the second field of view; locating the eye images in the tracked facial images from the second field of view; receiving the located eye images from a third field of view; and detecting the biometric data in the detected eye images from the third field of view.
Claim 47
Dependent Claim
218 words
A product comprising a non-transitory machine-readable medium containing instructions for determining biometric data from one or more subjects, the instructions when executed by the machine comprising the acts of: receiving a plurality of scene images from a first field of view, each scene image including a background image and a foreground image, the foreground image containing one or more subject images, the one or more subject images including eye images having biometric data corresponding to one or more subjects; detecting, in each scene image, the foreground image relative to the background image; detecting, in each scene image, the one or more subject images in the foreground image; detecting facial images corresponding to the one or more subject images; tracking, in the plurality of scene images, the detected facial images corresponding to the one or more subject images; scheduling the tracked facial images for acquisition of the biometric data; directing a second field of view to the tracked facial images according to the act of scheduling; receiving the tracked facial images from the second field of view; locating the eye images in the tracked facial images from the second field of view; receiving the located eye images from a third field of view; and detecting the biometric data in the detected eye images from the third field of view.
Claim 48
Dependent Claim
20 words
The product according to claim 44 , further comprising computing, in each scene image, the background representation of the scene.
Claim 49
Dependent Claim
27 words
The product according to claim 44 , wherein the plurality of scene images represent movement of the one or more subjects through the first field of view.
Claim 50
Dependent Claim
47 words
The product according to claim 44 , wherein the act of detecting the foreground image comprises modeling the background image according to per-pixel statistics associated with the plurality of scene images and detecting a binary foreground image in each scene image based on the modeled background image.
Claim 51
Dependent Claim
136 words
The product according to claim 47 , wherein the act of modeling the background comprises: determining a first-layer background image by repeatedly updating a first of the plurality of scene images with subsequent scene images; applying binary thresholding to the first-layer background image to generate a first-layer mask image; and determining a second-layer background image by repeatedly updating the first of the plurality of scene images with the subsequent scene images in combination with the first-layer mask, and the act of detecting a binary foreground image comprises: detecting first foreground pixels in each scene image that differ from the first-layer background image by a predetermined threshold; detecting second foreground pixels in each scene image that differ from the second-layer background image by the predetermined threshold; and combining the first foreground pixels and the second foreground pixels.
Claim 52
Dependent Claim
38 words
The product according to claim 48 , wherein the acts of updating comprise applying training phase learning rate parameter for a first N scene images and a detection phase learning rate parameter after the first N scene images.
Claim 53
Dependent Claim
36 words
The product according to claim 49 , wherein the training phase learning rate parameter and the detection phase learning rate parameter are different but fixed preset global values for the entire background image at different layers.
Claim 54
Dependent Claim
43 words
The product according to claim 49 , wherein the training phase learning rate parameter and the detection phase learning rate parameter are per-pixel variables adaptively updated based on the one or more subject images, the detected facial images, and the tracked facial images.
Claim 55
Dependent Claim
175 words
The product according to claim 44 , wherein the act of detecting the one or more subject images comprises: generating a horizontal projection histogram and a vertical projection histogram in the foreground image; determining at least one first mode corresponding to the horizontal projection histogram, the at least one first mode having a first width greater than a first minimum width threshold and a first maximum projection count greater than a first minimum height threshold; determining at least one second mode corresponding to the vertical projection histogram, the at least one second mode having a second width greater than a second minimum height threshold and a second maximum projection count greater than a second minimum width threshold; determining one or more regions corresponding to one or more subject images in the foreground image according to Cartesian product of the at least one first mode corresponding to the horizontal projection histogram and the at least one second mode corresponding to the vertical projection histogram; and performing width and height adjustments for the one or more regions.
Claim 56
Dependent Claim
38 words
The product according to claim 44 , wherein the act of detecting a facial image in the one or more subject images comprises applying a face classifier trained on a plurality of features with a feature selection algorithm.
Claim 57
Dependent Claim
40 words
The product according to claim 53 , wherein the act of applying a face classifier trained on a plurality of features with a feature selection algorithm comprises applying a face classifier trained on Haar-like features with Ada-boost for feature selection.
Claim 58
Dependent Claim
58 words
The product according to claim 44 , wherein the act of detecting facial images corresponding to the one or more subject images comprises: generating a list of potential facial regions for the one or more subject images; scoring the potential facial regions; and retaining, as the facial images, the potential facial regions that score above a predetermined threshold.
Claim 59
Dependent Claim
35 words
The product according to claim 55 , wherein the act of scoring the potential facial regions comprises scoring the potential facial regions according to probabilities that the potential facial regions correspond with the facial images.
Claim 60
Dependent Claim
69 words
The product according to claim 56 , wherein the act of scoring the potential facial regions comprises scoring the potential facial regions according to at least one of a first overlap of the potential facial regions with the foreground image, a second overlap of the potential facial regions with the background image, and a spatial position of the potential facial regions relative to the one or more subject images.
Claim 61
Dependent Claim
29 words
The product according to claim 56 , wherein the act of scoring the potential facial regions further comprises scoring multiple potential facial regions corresponding to a single subject image.
Claim 62
Dependent Claim
79 words
The product according to claim 58 , wherein the act of scoring multiple potential facial regions corresponding to a single subject image comprises weighting the multiple potential facial regions according to at least one of a first overlap of the multiple potential facial regions with the foreground image, a second overlap of the multiple potential facial regions with the background image, and a spatial position of the multiple potential facial regions relative to the one or more subject images.
Claim 63
Dependent Claim
40 words
The product according to claim 56 , wherein the act of scoring the potential facial regions comprises weighting the potential facial regions according to a correspondence between the potential facial regions and facial regions being tracked in previous scene images.
Claim 64
Dependent Claim
33 words
The product according to claim 55 , wherein the act of scoring the potential facial regions comprises scoring the potential facial regions according to a detection of eyes in the potential facial regions.
Claim 65
Dependent Claim
30 words
The product according to claim 44 , wherein the act of tracking the facial images comprises tracking the facial images that appear in a predetermined minimum number of scene images.
Claim 66
Dependent Claim
25 words
The product according to claim 44 , wherein the act of tracking the facial images comprises tracking the facial images that provide a frontal profile.
Claim 67
Dependent Claim
39 words
The product according to claim 44 , wherein the act of tracking the facial images comprises tracking the facial images according to a probabilistic data association for the one or more subjects in the plurality of the scene images.
Claim 68
Dependent Claim
230 words
The product according to claim 64 , wherein the act of tracking the facial images comprises: determining a first set of detected facial images from a currently processed scene image; determining a second set of potential facial images from previously processed scene images; determining a third set of tracked facial images from previously processed scene images; determining a first similarity between the first set of detected facial images and the second set of potential facial images; generating a second similarity between the first set of detected facial images and the third set of tracked facial images; marking the detected facial images from the currently processed scene image as a potential facial image, a tracked facial image, or an unmatched facial image according to the first similarity and the second similarity; adding the detected facial images marked as a potential facial image to the second set of potential images for processing of subsequent scene images; moving matured potential images from the second set of potential images to the third set of tracked facial images, the matured potential images being in the second set of potential images for a minimum number of scene images; and removing disappeared tracked facial images from the third set of tracked facial images, the disappeared tracked facial images being in the third set of tracked facial images but not in the first set of detected facial images.
Claim 69
Dependent Claim
41 words
The product according to claim 44 , wherein the act of locating eye images in the tracked facial images comprises detecting the eye images according to one or more classifiers trained on a plurality of features with a feature selection algorithm.
Claim 70
Dependent Claim
35 words
The product according to claim 66 , wherein the act of detecting the eye images according to one or more classifiers comprises applying a face classifier trained on Haar-like features with Ada-boost for feature selection.
Claim 71
Dependent Claim
31 words
The product according to claim 66 , wherein the act of detecting the eye images according to one or more classifiers comprises applying one or more classifiers trained from expanded-object training.
Claim 72
Dependent Claim
24 words
The product according to claim 44 , wherein the act of locating eye images in the tracked facial images comprises tracking the eye images.
Claim 73
Dependent Claim
20 words
The product according to claim 69 , wherein the act of tracking the eye images comprises applying mean shift analysis.
Claim 74
Dependent Claim
31 words
The product according to claim 70 , wherein the act of tracking the eye images further comprises estimating an object scale change via inter-frame scale variation of the corresponding facial image.
Claim 75
Dependent Claim
42 words
The product according to claim 70 , wherein the act of tracking the eye images further comprises determining a prior probability of object location by warping an eye location corresponding with a most recent eye detection to a current detected facial image.
Claim 76
Dependent Claim
34 words
The product according to claim 44 , wherein the act of locating eye images in the tracked facial images comprises determining a location for a second eye after a first eye has been detected.
Claim 77
Dependent Claim
30 words
The product according to claim 73 , wherein the act of determining a location for a second eye comprises applying adaptive eye template matching based on a normalized cross section.
Claim 78
Dependent Claim
49 words
The product according to claim 44 , wherein the act of locating eye images in the tracked facial images comprises applying a binary decision tree framework applying at least one of an adaptively determined sequence of Haar-based eye detection, an adaptive template-based eye detection, and a mean-shift-based eye tracking.
Claim 79
Dependent Claim
33 words
The product according to claim 44 , wherein detecting the biometric data in the detected eye images comprises segmenting iris images in the detected eye images, the iris images containing the biometric data.
Claim 80
Dependent Claim
39 words
The product according to claim 76 , wherein the act of detecting iris images in the detected eye images further comprises selecting the segmented iris images according to a focus measure and a coverage measure for the iris images.
Claim 81
Dependent Claim
32 words
The product according to claim 76 , further comprising encoding the segmented iris images into an iris signature bit pattern and matching the iris signature bit pattern against stored signature bit patterns.
Claim 82
Dependent Claim
32 words
The product according to claim 76 , wherein the act of segmenting iris images in the detected eye images comprises pattern matching according to iris and pupil models based on polarity-independent features.
Claim 83
Dependent Claim
26 words
The product according to claim 79 , wherein the iris model is based on two opposing arc and the pupil model is based on a circle.
Claim 84
Dependent Claim
155 words
The product according to claim 79 , wherein the act of pattern matching comprises: sub-sampling a first region based on the detected iris images; generating a first edge map based on the act of sub-sampling the first region; generating a list of first edge chains from the first edge map; generating a first search image by mapping edge points with appropriate orientations from the first edge chains; detecting an iris outer boundary by applying transformations of the iris model to the first search image; sub-sampling a second region based on the detected iris outer boundary; generating a second edge map based on the act of sub-sampling the second region; generating a list of second edge chains from the second edge map; generating a second search image by mapping edge points with appropriate orientations from the second edge chains; and detecting a pupil boundary by applying transformations of the pupil model to the second search image.
References Cited (Backward Citations)
US3069654A
Cited
US4641349A
Cited
US5836872A
Cited
US5291560A
Cited
US6442465B2
Cited
US5572596A
Cited
US5751836A
Cited
US6714665B1
Cited
US5729619A
Cited
US6208379B1
Cited
US5991429A
Cited
US6597377B1
Cited
US6215891B1
Cited
US6144754A
Cited
US6229907B1
Cited
US6285780B1
Cited
US5859686A
Cited
US6373968B2
Cited
US5953440A
Cited
US6011624A
Cited
US6152563A
Cited
US6850631B1
Cited
US6529630B1
Cited
US6546121B1
Cited
US6526160B1
Cited
US6542624B1
Cited
US6753919B1
Cited
US6532298B1
Cited
US6614919B1
Cited
US6944318B1
Cited
US6760467B1
Cited
US6247813B1
Cited
US6700998B1
Cited
US6571002B1
Cited
US6778698B1
Cited
US6785406B1
Cited
US6526161B1
Cited
US20030085992A1
Cited
US20030118217A1
Cited
US6992717B2
Cited
US7277561B2
Cited
US7099495B2
Cited
US20030108224A1
Cited
US20030012413A1
Cited
US20030020828A1
Cited
US6591064B2
Cited
US20030103139A1
Cited
US7715595B2
Cited
US7155035B2
Cited
US7227569B2
Cited
US20060187305A1
Cited
US7197166B2
Cited
US20060140453A1
Cited
US20040197011A1
Cited
US20040227693A1
Cited
US7421097B2
Cited
WO2005008567A1
Cited
US20050084179A1
Cited
US20080075334A1
Cited
US20060147094A1
Cited
US20050078868A1
Cited
US7428314B2
Cited
US20070110284A1
Cited
US20050251347A1
Cited
US20060008124A1
Cited
US20060140454A1
Cited
US20060165266A1
Cited
US20070036397A1
Cited
US20070047772A1
Cited
US20070047773A1
Cited
US20070160266A1
Cited
US20070160267A1
Cited
US20080112596A1
Cited
US20100183199A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2015-02-20 | 2015-08-22 | 2016-02-21 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2019-02-20 | 2019-08-22 | 2020-02-21 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2023-02-20 | 2023-08-22 | 2024-02-21 | $7700.00 | Window Closed / Lapsed |