Patent US7917286B2 successfully refreshed from Google Patents.
US7917286B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Database assisted OCR for street scenes and other images
Assignee: Google LLC
•
Filing: 2005-12-16
•
Granted: 2011-03-29
•
Expires: 2025-12-16
Abstract
Abstract Optical character recognition (OCR) for images such as a street scene image is generally a difficult problem because of the variety of fonts, styles, colors, sizes, orientations, occlusions and partial occlusions that can be observed in the textual content of such scenes. However, a database query can provide useful information that can assist the OCR process. For instance, a query to a digital mapping database can provide information such as one or more businesses in a vicinity, the street name, and a range of possible addresses. In accordance with an embodiment of the present invention, this mapping information is used as prior information or constraints for an OCR engine that is interpreting the corresponding street scene image, resulting in much greater accuracy of the digital map data provided to the user.
Inventors
- 👤 Bret Taylor
- 👤 Luc Vincent
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-09 15:44
CPC Classifications
G; G06; G06V; G06V20/00; G06V20/10; G06V20/60; G06V20/62; G06V20/63; G06V30/00; G06V30/10; G06V30/26; G06V30/262
Claims Analysis
Total Claims: 47
Claim 1
Independent Claim
226 words
A method for constructing a database storing one or more street scene images, each street scene image associated with GPS location data identifying an actual location of the street scene image, the method executed by a computer system and comprising: storing in the database of the computer system, a plurality business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image of the street scene images using the GPS location data associated with that street scene image; identifying a target address range based on the estimated street address; querying the database to identify a business name associated with a street address in the target address range and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the street scene image to recognize text contained in the street scene image, wherein the optical character recognition of the street scene is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the street scene image corresponds to at least one of the identified keywords; updating the estimated street address in the database including the GPS location data in response to a determination that the recognized text corresponds to at least one of the identified keywords.
Claim 2
Independent Claim
226 words
A method for constructing a database storing one or more street scene images, each street scene image associated with GPS location data identifying an actual location of the street scene image, the method executed by a computer system and comprising: storing in the database of the computer system, a plurality business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image of the street scene images using the GPS location data associated with that street scene image; identifying a target address range based on the estimated street address; querying the database to identify a business name associated with a street address in the target address range and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the street scene image to recognize text contained in the street scene image, wherein the optical character recognition of the street scene is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the street scene image corresponds to at least one of the identified keywords; updating the estimated street address in the database including the GPS location data in response to a determination that the recognized text corresponds to at least one of the identified keywords.
Claim 3
Dependent Claim
33 words
The method of claim 1 , further comprising performing image analysis of the street scene image to determine if features associated with the identified business name are present in the street scene image.
Claim 4
Dependent Claim
14 words
The method of claim 1 wherein the street scene image includes one street address.
Claim 5
Dependent Claim
21 words
The method of claim 1 wherein the street scene image is a panoramic image that includes a plurality of street addresses.
Claim 6
Dependent Claim
13 words
The method of claim 1 wherein the database includes a business listings directory.
Claim 7
Dependent Claim
35 words
The method of claim 1 , wherein estimating the street address for the street scene comprises determining a target GPS location for the street scene image using GPS data associated with that street scene image.
Claim 8
Dependent Claim
23 words
The method of claim 6 wherein the GPS data includes GPS locations for at least two locations captured in the street scene image.
Claim 9
Independent Claim
204 words
A method for performing image analysis of a street scene image, the street scene image associated with GPS location data identifying an actual location of the street scene image, the method executed by a computer system, and comprising: querying a database comprising a plurality of street addresses, each street address associated with image features, to identify an image feature that is present in a street scene image of a street address, the street scene image comprising a plurality of address locations and at least two of the plurality of address locations having known GPS data; performing image analysis of the street scene image to recognize features in the street scene image, wherein the image analysis of the street scene is constrained by the identified image feature from querying the database, and the identified image feature is associated with a street address from the database; determining if the recognized features in the street scene image correspond to the identified image feature associated with the street address from the database; and in response to determining that the recognized features correspond to the identified image feature associated with the street address from querying the database, updating the street address in the database including the GPS location data.
Claim 10
Independent Claim
204 words
A method for performing image analysis of a street scene image, the street scene image associated with GPS location data identifying an actual location of the street scene image, the method executed by a computer system, and comprising: querying a database comprising a plurality of street addresses, each street address associated with image features, to identify an image feature that is present in a street scene image of a street address, the street scene image comprising a plurality of address locations and at least two of the plurality of address locations having known GPS data; performing image analysis of the street scene image to recognize features in the street scene image, wherein the image analysis of the street scene is constrained by the identified image feature from querying the database, and the identified image feature is associated with a street address from the database; determining if the recognized features in the street scene image correspond to the identified image feature associated with the street address from the database; and in response to determining that the recognized features correspond to the identified image feature associated with the street address from querying the database, updating the street address in the database including the GPS location data.
Claim 11
Dependent Claim
17 words
The method of claim 8 wherein querying the database identifies a number of textual and non-textual features.
Claim 12
Dependent Claim
22 words
The method of claim 9 further comprising: performing image analysis of the street scene image to determine if non-textual features are present.
Claim 13
Dependent Claim
14 words
The method of claim 8 wherein the street scene image includes one street address.
Claim 14
Dependent Claim
21 words
The method of claim 8 wherein the street scene image is a panoramic image that includes a plurality of street addresses.
Claim 15
Dependent Claim
25 words
The method of claim 8 wherein the known GPS data includes known GPS locations for at least two locations captured in the street scene image.
Claim 16
Independent Claim
167 words
A method for performing optical character recognition (OCR) of an image, the image associated with GPS location data identifying an actual location of the image, the method executed by a computer and comprising: storing in a database a plurality of images, each image associated with one or more keywords; querying the database to select at least one image; performing optical character recognition of the selected image to recognize text that may be contained in the image, wherein the optical character recognition of the image is constrained by at least one of the keywords associated with the image in the database; determining if the recognized text contained in the image corresponds to the at least one of the keywords associated with the image; and in response to determining that the recognized text contained in the image corresponds to at least one of the keywords associated with the image, updating a street address to be associated with the GPS location data, the street address being associated with the image.
Claim 17
Independent Claim
167 words
A method for performing optical character recognition (OCR) of an image, the image associated with GPS location data identifying an actual location of the image, the method executed by a computer and comprising: storing in a database a plurality of images, each image associated with one or more keywords; querying the database to select at least one image; performing optical character recognition of the selected image to recognize text that may be contained in the image, wherein the optical character recognition of the image is constrained by at least one of the keywords associated with the image in the database; determining if the recognized text contained in the image corresponds to the at least one of the keywords associated with the image; and in response to determining that the recognized text contained in the image corresponds to at least one of the keywords associated with the image, updating a street address to be associated with the GPS location data, the street address being associated with the image.
Claim 18
Dependent Claim
19 words
The method of claim 14 wherein the keyword is further associated with a street address or a key event.
Claim 19
Dependent Claim
22 words
The method of claim 14 wherein querying the database identifies a number of textual and non-textual features that is in the image.
Claim 20
Dependent Claim
20 words
The method of claim 16 further comprising: performing image analysis of the image to determine if non-textual features are present.
Claim 21
Dependent Claim
16 words
The method of claim 14 wherein the image is one of a photograph or video frame.
Claim 22
Dependent Claim
33 words
The method of claim 14 wherein the image is associated with GPS location data, and in response to determining that the keyword is present, determining an actual GPS location associated with that keyword.
Claim 23
Dependent Claim
227 words
A computer program product, comprising a computer-readable storage medium containing computer executable instructions for controlling a computer system to perform the operations of: storing in a database of the computer system a plurality of business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image using data associated with that street scene image, the street scene image associated with GPS location data identifying an actual location of the street scene image; identifying a target address range based on the estimated street address of the target GPS location; querying the database with the target address range to identify a business name associated with a street address in the target address range and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the street scene image to recognize text contained in the street scene image, wherein the optical character recognition of the street scene is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the street scene image corresponds to at least one of the identified keywords; updating the estimated street address including the GPS location data in response to a determination that the recognized text corresponds to at least one of the identified keywords.
Claim 24
Dependent Claim
227 words
A computer program product, comprising a computer-readable storage medium containing computer executable instructions for controlling a computer system to perform the operations of: storing in a database of the computer system a plurality of business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image using data associated with that street scene image, the street scene image associated with GPS location data identifying an actual location of the street scene image; identifying a target address range based on the estimated street address of the target GPS location; querying the database with the target address range to identify a business name associated with a street address in the target address range and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the street scene image to recognize text contained in the street scene image, wherein the optical character recognition of the street scene is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the street scene image corresponds to at least one of the identified keywords; updating the estimated street address including the GPS location data in response to a determination that the recognized text corresponds to at least one of the identified keywords.
Claim 25
Dependent Claim
35 words
The computer program product of claim 20 , further comprising performing image analysis of the street scene image to determine if features associated with the identified business name are present in the street scene image.
Claim 26
Dependent Claim
24 words
The computer program product of claim 20 , wherein the street scene image is a panoramic image that includes a plurality of street addresses.
Claim 27
Dependent Claim
26 words
The computer program product of claim 20 , wherein the GPS data includes GPS locations for at least two locations captured in the street scene image.
Claim 28
Dependent Claim
16 words
The computer program product of claim 20 , wherein the database includes a business listings directory.
Claim 29
Dependent Claim
47 words
The computer program product of claim 20 , wherein the computer executable instructions for estimating the street address for the street scene further comprises computer executable instructions for determining a target GPS location for the street scene image using GPS data associated with that street scene image.
Claim 30
Dependent Claim
209 words
A computer program product, comprising a computer-readable storage medium containing computer executable instructions for controlling a computer system to perform the operations of: querying a database comprising a plurality of street addresses, each street address associated with image features, to identify an image feature that is present in a street scene image of a street address of the street addresses, the street scene image comprising a plurality of address locations and at least two of the plurality of address locations having known GPS data; performing image analysis of the street scene image to recognize features in the street scene image, wherein the image analysis of the street scene is constrained by the identified image feature from querying the database, and the identified image feature is associated with a street address from the database; determining if the recognized features in the street scene image correspond to the identified image feature associated with the street address from the database; and in response to determining that the recognized features correspond to the identified image feature associated with the street address from querying the database, updating the street address in the database including GPS location data associated with GPS location data, the GPS location data identifying an actual location of the street stress.
Claim 31
Dependent Claim
209 words
A computer program product, comprising a computer-readable storage medium containing computer executable instructions for controlling a computer system to perform the operations of: querying a database comprising a plurality of street addresses, each street address associated with image features, to identify an image feature that is present in a street scene image of a street address of the street addresses, the street scene image comprising a plurality of address locations and at least two of the plurality of address locations having known GPS data; performing image analysis of the street scene image to recognize features in the street scene image, wherein the image analysis of the street scene is constrained by the identified image feature from querying the database, and the identified image feature is associated with a street address from the database; determining if the recognized features in the street scene image correspond to the identified image feature associated with the street address from the database; and in response to determining that the recognized features correspond to the identified image feature associated with the street address from querying the database, updating the street address in the database including GPS location data associated with GPS location data, the GPS location data identifying an actual location of the street stress.
Claim 32
Dependent Claim
20 words
The computer program product of claim 26 , wherein querying the database identifies a number of textual and non-textual features.
Claim 33
Dependent Claim
24 words
The computer program product of claim 27 further comprising: performing image analysis of the street scene image to determine if non-textual features are present.
Claim 34
Dependent Claim
169 words
A computer program product, comprising a computer-readable storage medium containing computer executable instructions for controlling a computer system to perform the operations of: storing in a database a plurality of images, each image associated with one or more keywords and GPS location data identifying an actual location of the image; querying the database to select at least one image; performing optical character recognition of the selected image to recognize text that may be contained in the image, wherein the optical character recognition of the image is constrained by at least one of the keywords associated with the image in the database; determining if the recognized text contained in the image corresponds to the at least one of the keywords associated with the image; and in response to determining that the recognized text contained in the image corresponds to at least one of the keywords associated with the image, updating a street address in the database to be associated with the GPS data, the street address being associated with image.
Claim 35
Dependent Claim
169 words
A computer program product, comprising a computer-readable storage medium containing computer executable instructions for controlling a computer system to perform the operations of: storing in a database a plurality of images, each image associated with one or more keywords and GPS location data identifying an actual location of the image; querying the database to select at least one image; performing optical character recognition of the selected image to recognize text that may be contained in the image, wherein the optical character recognition of the image is constrained by at least one of the keywords associated with the image in the database; determining if the recognized text contained in the image corresponds to the at least one of the keywords associated with the image; and in response to determining that the recognized text contained in the image corresponds to at least one of the keywords associated with the image, updating a street address in the database to be associated with the GPS data, the street address being associated with image.
Claim 36
Dependent Claim
21 words
The computer program product of claim 29 wherein the keyword is further associated with a street address or a key event.
Claim 37
Dependent Claim
298 words
A computer system for constructing a database storing one or more street scenes, each street scene image associated with GPS location data identifying an actual location of the street scene image, comprising: a database storing a plurality of business names and street addresses, each business name associated with a street address of the street addresses and one or more keywords; a target address range estimator module coupled to the database and adapted to: estimate a street address of the street addresses for the street scene image using data associated with that street scene image; a target GPS calculator module coupled to the target address range estimator module and adapted to identify a target address range based on the estimated street address of the target GPS location; an image registration module coupled to the database and the target address range estimator module and adapted to query the database to identify a business name associated with a street address in the target address range and to identify the one or more keywords associated with the identified business name; an optical character recognition module coupled to the target address range estimator module and the image registration module and adapted to: perform optical character recognition of the street scene image to recognize text contained in the street scene image, wherein the optical character recognition of the street scene is constrained by at least one of the identified keywords resulting from querying the database; and determining if the recognized text contained in the street scene image corresponds to at least one of the identified keywords; and the image registration module adapted to update the estimated street address in the database including the GPS location data in response to a determination that the recognized text corresponds to at least one of the identified keywords.
Claim 38
Dependent Claim
298 words
A computer system for constructing a database storing one or more street scenes, each street scene image associated with GPS location data identifying an actual location of the street scene image, comprising: a database storing a plurality of business names and street addresses, each business name associated with a street address of the street addresses and one or more keywords; a target address range estimator module coupled to the database and adapted to: estimate a street address of the street addresses for the street scene image using data associated with that street scene image; a target GPS calculator module coupled to the target address range estimator module and adapted to identify a target address range based on the estimated street address of the target GPS location; an image registration module coupled to the database and the target address range estimator module and adapted to query the database to identify a business name associated with a street address in the target address range and to identify the one or more keywords associated with the identified business name; an optical character recognition module coupled to the target address range estimator module and the image registration module and adapted to: perform optical character recognition of the street scene image to recognize text contained in the street scene image, wherein the optical character recognition of the street scene is constrained by at least one of the identified keywords resulting from querying the database; and determining if the recognized text contained in the street scene image corresponds to at least one of the identified keywords; and the image registration module adapted to update the estimated street address in the database including the GPS location data in response to a determination that the recognized text corresponds to at least one of the identified keywords.
Claim 39
Dependent Claim
36 words
The computer system of claim 31 , wherein the target address range estimator is further adapted to determine a target GPS location for the street scene image using GPS data associated with that street scene image.
Claim 40
Dependent Claim
236 words
A computer system for performing image analysis of a street scene image using a database, the street scene image associated with GPS location data identifying an actual location of the street scene image, comprising: an image registration module adapted to query the database comprising a plurality of street addresses, each street address associated with image features, to identify an image feature that is present in the street scene image of the street address, the street scene image comprising a plurality of address locations and at least two of the plurality of address locations having known GPS data; an optical character recognition module coupled to the image registration module and adapted to: perform image analysis of the street scene image to recognize features in the street scene image, wherein the image analysis of the street scene is constrained by the identified image feature from querying the database, and the identified image feature is associated with the street address from the database; and determine if the recognized features in the street scene image correspond to the identified image feature associated with the street address from the database; and the image registration module, in response to determining that the recognized features correspond to the identified image feature associated with the street address from querying the database, adapted to update the street address in the database including the GPS location data, the street address associated with the identified image feature.
Claim 41
Dependent Claim
236 words
A computer system for performing image analysis of a street scene image using a database, the street scene image associated with GPS location data identifying an actual location of the street scene image, comprising: an image registration module adapted to query the database comprising a plurality of street addresses, each street address associated with image features, to identify an image feature that is present in the street scene image of the street address, the street scene image comprising a plurality of address locations and at least two of the plurality of address locations having known GPS data; an optical character recognition module coupled to the image registration module and adapted to: perform image analysis of the street scene image to recognize features in the street scene image, wherein the image analysis of the street scene is constrained by the identified image feature from querying the database, and the identified image feature is associated with the street address from the database; and determine if the recognized features in the street scene image correspond to the identified image feature associated with the street address from the database; and the image registration module, in response to determining that the recognized features correspond to the identified image feature associated with the street address from querying the database, adapted to update the street address in the database including the GPS location data, the street address associated with the identified image feature.
Claim 42
Dependent Claim
195 words
A computer system for performing optical character recognition (OCR) of an image using a database, comprising: the database storing a plurality of images, each image associated with one or more keywords, and GPS location data to identifying an actual location of the images; an image registration module coupled to the database and adapted to query the database to select at least one image; and an OCR module coupled to the image registration module and adapted to: perform OCR of the selected image to recognize text that may be contained in the image, wherein the OCR of the image is constrained by at least one of the keywords associated with the image in the database; determine if the recognized text contained in the image corresponds to the at least one of the keywords associated with the image; and in response to determining that the recognized text contained in the image corresponds to at least one of the keywords associated with the image, assigning an actual GPS location to a street address associated with an image of the plurality of images; and updating the street address in the database to be associated with the GPS location data.
Claim 43
Dependent Claim
195 words
A computer system for performing optical character recognition (OCR) of an image using a database, comprising: the database storing a plurality of images, each image associated with one or more keywords, and GPS location data to identifying an actual location of the images; an image registration module coupled to the database and adapted to query the database to select at least one image; and an OCR module coupled to the image registration module and adapted to: perform OCR of the selected image to recognize text that may be contained in the image, wherein the OCR of the image is constrained by at least one of the keywords associated with the image in the database; determine if the recognized text contained in the image corresponds to the at least one of the keywords associated with the image; and in response to determining that the recognized text contained in the image corresponds to at least one of the keywords associated with the image, assigning an actual GPS location to a street address associated with an image of the plurality of images; and updating the street address in the database to be associated with the GPS location data.
Claim 44
Independent Claim
245 words
A method for constructing a database storing one or more street scene images, each street scene image associated with GPS location data identifying an actual location of the one or more street scene images, the method executed by a computer system, comprising: storing in the database of the computer system, a plurality business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image of the one or more street scene images using the GPS location data associated with the one or more street scene images; identifying a target address range based on the estimated street address; querying the database to identify a business name of the plurality of business names associated with a street address in the target address range, and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the one or more street scene images to recognize text contained in the one or more street scene images, wherein the optical character recognition of the one or more street scene images is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the one or more street scene images corresponds to at least one of the identified keywords; and updating the business name associated with the street address in the database including the GPS location data of the street scene image.
Claim 45
Independent Claim
245 words
A method for constructing a database storing one or more street scene images, each street scene image associated with GPS location data identifying an actual location of the one or more street scene images, the method executed by a computer system, comprising: storing in the database of the computer system, a plurality business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image of the one or more street scene images using the GPS location data associated with the one or more street scene images; identifying a target address range based on the estimated street address; querying the database to identify a business name of the plurality of business names associated with a street address in the target address range, and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the one or more street scene images to recognize text contained in the one or more street scene images, wherein the optical character recognition of the one or more street scene images is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the one or more street scene images corresponds to at least one of the identified keywords; and updating the business name associated with the street address in the database including the GPS location data of the street scene image.
Claim 46
Independent Claim
259 words
A method for constructing a database storing one or more street scene images, each street scene image associated with GPS location data identifying an actual location of the one or more street scene images, the method executed by a computer system, comprising: storing in the database of the computer system, a plurality business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image of the one or more street scene images using the GPS location data associated with the one or more street scene images; identifying a target address range based on the estimated street address; querying the database to identify a business name of the plurality of business names associated with a street address in the target address range, and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the one or more street scene images to recognize text contained in the one or more street scene images, wherein the optical character recognition of the one or more street scene images is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the one or more street scene images corresponds to at least one of the identified keywords; and updating the one or more street scene images in database including the business name associated with the street address in response to determination that the recognized text corresponds to at least on of the identified keywords.
Claim 47
Independent Claim
259 words
A method for constructing a database storing one or more street scene images, each street scene image associated with GPS location data identifying an actual location of the one or more street scene images, the method executed by a computer system, comprising: storing in the database of the computer system, a plurality business names, each business name associated with a street address and one or more keywords; estimating a street address for a street scene image of the one or more street scene images using the GPS location data associated with the one or more street scene images; identifying a target address range based on the estimated street address; querying the database to identify a business name of the plurality of business names associated with a street address in the target address range, and to identify the one or more keywords associated with the identified business name; performing optical character recognition of the one or more street scene images to recognize text contained in the one or more street scene images, wherein the optical character recognition of the one or more street scene images is constrained by at least one of the identified keywords resulting from querying the database; determining if the recognized text contained in the one or more street scene images corresponds to at least one of the identified keywords; and updating the one or more street scene images in database including the business name associated with the street address in response to determination that the recognized text corresponds to at least on of the identified keywords.
References Cited (Backward Citations)
US4972319A
Cited
US5051928A
Cited
US6388684B1
Cited
US5579471A
Cited
US6002809A
Cited
US5724579A
Cited
US5615324A
Cited
US5802492A
Cited
US5559707A
Cited
US20030182052A1
Cited
US6321158B1
Cited
US5848373A
Cited
US5613051A
Cited
US6031963A
Cited
CA2169421A1
Cited
US5646751A
Cited
US6252608B1
Cited
US5737533A
Cited
US5760783A
Cited
US6148105A
Cited
US6100897A
Cited
US5926116A
Cited
US5910805A
Cited
US6098015A
Cited
US6055536A
Cited
US6054990A
Cited
US5768633A
Cited
US5884247A
Cited
US5938709A
Cited
US6470264B2
Cited
US6202026B1
Cited
US6111583A
Cited
US6496189B1
Cited
US6233523B1
Cited
US6181817B1
Cited
EP0920179A2
Cited
US6266614B1
Cited
US6278938B1
Cited
EP0944019A2
Cited
US6247019B1
Cited
US6262741B1
Cited
US6144338A
Cited
US6301370B1
Cited
US6393147B2
Cited
US6504571B1
Cited
US6167382A
Cited
EP0967556A2
Cited
US20070154067A1
Cited
US6272231B1
Cited
US6023241A
Cited
US6208626B1
Cited
US6208934B1
Cited
US6182010B1
Cited
US6346938B1
Cited
US6421053B1
Cited
WO2001004790A1
Cited
US6307573B1
Cited
US6573905B1
Cited
US6538656B1
Cited
US20020187774A1
Cited
US6826472B1
Cited
US20020184203A1
Cited
US6473691B1
Cited
US20010032070A1
Cited
US20010034661A1
Cited
US7136915B2
Cited
US7542882B2
Cited
US20050216448A1
Cited
US20010044837A1
Cited
US20030041087A1
Cited
US20030050065A1
Cited
US7210119B2
Cited
US20020099613A1
Cited
US20020095328A1
Cited
US20020002478A1
Cited
US20030061211A1
Cited
US20020049728A1
Cited
US20040128215A1
Cited
US20030078897A1
Cited
US20020102966A1
Cited
US7016532B2
Cited
US20020103813A1
Cited
US20020055957A1
Cited
US20020067353A1
Cited
US6724382B2
Cited
US20020067374A1
Cited
US20020067379A1
Cited
US20020089524A1
Cited
US20020101568A1
Cited
DE10110979A1
Cited
US20020140988A1
Cited
US20020156866A1
Cited
US20020159657A1
Cited
US20040153434A1
Cited
WO2003001435A1
Cited
US20030044068A1
Cited
US20030044608A1
Cited
US20040208372A1
Cited
WO2003041000A1
Cited
US7580045B2
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2014-03-28 | 2014-09-27 | 2015-03-29 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2018-03-28 | 2018-09-27 | 2019-03-29 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2022-03-28 | 2022-09-27 | 2023-03-29 | $7700.00 | Window Closed / Lapsed |