US6466694B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Document image processing device and method thereof
Assignee: Fujitsu Ltd
•
Filing: 1998-04-16
•
Granted: 2002-10-15
•
Expires: 2018-04-16
Abstract
Abstract A processing device performs region identification of an input image, and then performs an intra-region recognition process. The type code of each region and the individual code of a recognition result are then displayed, so that a user can modify both of the results of the region identification and the recognition process at one time. Furthermore, the processing device displays an original image close to the recognition result. If no correct answer exists among recognition candidates, code is added to the original image, and the original image with the code added is handled as a recognition result.
Inventors
- 👤 Hiroshi Kamada
- 👤 Katsuhito Fujimoto
- 👤 Koji Kurokawa
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-07 07:41
CPC Classifications
G; G06; G06V; G06V30/00; G06V30/40; G06V30/41; G06V30/413; G06V10/00; G06V10/98; G06V10/987; Y; Y10; Y10S; Y10S707/00; Y10S707/99931; Y10S707/99933; Y10S707/99936
Claims Analysis
Total Claims: 39
Claim 1
Independent Claim
243 words
An image processing device for performing a recognition process of an input image, comprising: an identifying device identifying a pattern region of the input image, the pattern region including a pattern in the input image, and determining a type of the pattern region according to whether the pattern region has an internal structure of pattern regions; a recognizing device performing an image recognition process of the pattern included in the pattern region; an outputting device displaying type code information indicating the determined type of the pattern region as a recognition result candidate of an image constituent element structuring the input image when the pattern region has the internal structure, and outputting the type code information and individual code information indicating the pattern as the recognition result candidate when the pattern region does not have the internal structure; and a modifying device modifying the recognition result candidate, wherein if said identifying device determines a first candidate of the type of the pattern region to be a character, said recognizing device performs a character recognition process of the pattern included in the pattern region and said outputting device displays a list of recognition result candidates, which includes individual code information of one or more candidate characters of a recognition result as upper recognition result candidates and type code information other than the character as a lower recognition result candidate; and a user modifies the displayed list of the recognition result candidates using said modifying device.
Claim 2
Dependent Claim
243 words
An image processing device for performing a recognition process of an input image, comprising: an identifying device identifying a pattern region of the input image, the pattern region including a pattern in the input image, and determining a type of the pattern region according to whether the pattern region has an internal structure of pattern regions; a recognizing device performing an image recognition process of the pattern included in the pattern region; an outputting device displaying type code information indicating the determined type of the pattern region as a recognition result candidate of an image constituent element structuring the input image when the pattern region has the internal structure, and outputting the type code information and individual code information indicating the pattern as the recognition result candidate when the pattern region does not have the internal structure; and a modifying device modifying the recognition result candidate, wherein if said identifying device determines a first candidate of the type of the pattern region to be a character, said recognizing device performs a character recognition process of the pattern included in the pattern region and said outputting device displays a list of recognition result candidates, which includes individual code information of one or more candidate characters of a recognition result as upper recognition result candidates and type code information other than the character as a lower recognition result candidate; and a user modifies the displayed list of the recognition result candidates using said modifying device.
Claim 3
Dependent Claim
58 words
The image processing device according to claim 1 , wherein: the input image includes as the pattern region a region corresponding to one of a text, a table, a graphic, a frame, and a character, and the type code information indicates a type corresponding to one of the text, the table, the graphic, the frame, and the character.
Claim 4
Dependent Claim
27 words
The image processing device according to claim 2 , wherein: if the type code information indicates the character, the individual code information indicates a corresponding character pattern.
Claim 5
Dependent Claim
27 words
The image processing device according to claim 1 , wherein: said modifying device designates an image constituent element to be modified by using a corresponding pixel region.
Claim 6
Dependent Claim
31 words
The image processing device according to claim 1 , wherein: said modifying device designates an image constituent element to be modified by using a circumscribed rectangle of a corresponding pixel region.
Claim 7
Dependent Claim
48 words
The image processing device according to claim 1 , wherein: said outputting device includes a displaying device displaying the image constituent element on a screen; and said modifying device regards an innermost image constituent element including a position instructed on the screen as an instructed image constituent element.
Claim 8
Dependent Claim
48 words
The image processing device according to claim 1 , wherein: said outputting device includes a displaying device displaying the image constituent element on a screen; and said modifying device regards a largest image constituent element including a position instructed on the screen as an instructed image constituent element.
Claim 9
Dependent Claim
52 words
The image processing device according to claim 1 , wherein: said outputting device includes a displaying device displaying the image constituent element on a screen; and said modifying device regards an image constituent element having a circumscribed frame closest to a position instructed on the screen as an instructed image constituent element.
Claim 10
Dependent Claim
62 words
The image processing device according to claim 1 , wherein: said outputting device includes a displaying device displaying the image constituent element on a screen; and said modifying device includes an instructing device instructing an image constituent element on the screen, and regards an innermost image constituent element including a previously instructed image constituent element as a newly instructed image constituent element.
Claim 11
Dependent Claim
71 words
The image processing device according to claim 1 , wherein: said outputting device includes a displaying device displaying the image constituent element on a screen; and said modifying device includes an instructing device instructing an image constituent element on the screen, and regards a largest image constituent element which includes an instructed coordinate among image constituent elements in a previously instructed image constituent element as a newly instructed image constituent element.
Claim 12
Dependent Claim
83 words
The image processing device according to claim 1 , wherein: if said identifying device determines a first candidate of the type of the pattern region to be a character, said recognizing device performs a character recognition process of the pattern included in the pattern region, and said outputting device outputs individual code information of one or more candidate characters of a recognition result as upper recognition result candidates and outputs type code information other than the character as a lower recognition result candidate.
Claim 13
Dependent Claim
63 words
The image processing device according to claim 1 , wherein: if said identifying device determines a first candidate of the type of the pattern region to be a particular type other than a character, said outputting device outputs type code information of the particular type as an upper recognition result candidate, and outputs other type code information as a lower recognition result candidate.
Claim 14
Dependent Claim
69 words
The image processing device according to claim 1 , wherein: if said modifying device modifies type code information of an output recognition result candidate to a character, said recognizing device performs a character recognition process of the pattern included in the pattern region depending on need, and said outputting device outputs individual code information of one or more candidate characters of a recognition result as upper recognition result candidates.
Claim 15
Dependent Claim
51 words
The image processing device according to claim 1 , wherein: said modifying device modifies type code information of an output recognition result candidate to a particular type other than a character, said recognizing device performs a recognition process of the pattern included in the pattern region according to the particular type.
Claim 16
Dependent Claim
114 words
An image processing device, comprising: an extracting device extracting a partial image structuring an input image from the input image; a code adding device adding new code information to image data corresponding to the partial image, the new code information representing the image data; an outputting device outputting document information where the image data corresponding to the partial image and a character pattern corresponding to existing code information are mixed; and an editing device editing the document information with the image data and the character pattern mixed by using the new code information as an operation target for the image data and the existing code information as an operation target for the character pattern.
Claim 17
Dependent Claim
114 words
An image processing device, comprising: an extracting device extracting a partial image structuring an input image from the input image; a code adding device adding new code information to image data corresponding to the partial image, the new code information representing the image data; an outputting device outputting document information where the image data corresponding to the partial image and a character pattern corresponding to existing code information are mixed; and an editing device editing the document information with the image data and the character pattern mixed by using the new code information as an operation target for the image data and the existing code information as an operation target for the character pattern.
Claim 18
Dependent Claim
25 words
The image processing device according to claim 15 , wherein: said outputting device outputs image data obtained by changing a size of the partial image.
Claim 19
Dependent Claim
25 words
The image processing device according to claim 15 , wherein: said outputting device outputs image data obtained by vectorizing an outline of the partial image.
Claim 20
Dependent Claim
142 words
An image processing device, comprising: an extracting device extracting a partial image structuring an input image from the input image; a recognizing device performing an image recognition process of the partial image; an outputting device separating image data corresponding to the partial image from the input image, and displaying the partial image data together with a plurality of candidates of a recognition result of the partial image within a candidate display region, the candidates corresponding to different image recognition results for a same image element; a selecting device selecting any of the one or more candidates and the image data; and an editing device adding new code information to a partial image corresponding to the image data when the image data is selected, and editing a document where the image data and a character pattern corresponding to existing code information are mixed.
Claim 21
Dependent Claim
142 words
An image processing device, comprising: an extracting device extracting a partial image structuring an input image from the input image; a recognizing device performing an image recognition process of the partial image; an outputting device separating image data corresponding to the partial image from the input image, and displaying the partial image data together with a plurality of candidates of a recognition result of the partial image within a candidate display region, the candidates corresponding to different image recognition results for a same image element; a selecting device selecting any of the one or more candidates and the image data; and an editing device adding new code information to a partial image corresponding to the image data when the image data is selected, and editing a document where the image data and a character pattern corresponding to existing code information are mixed.
Claim 22
Dependent Claim
21 words
The image processing device according to claim 18 , wherein: said recognizing device adds type code information to the partial image.
Claim 23
Dependent Claim
30 words
The image processing device according to claim 19 , wherein: said recognizing device adds type code information corresponding to a first candidate of the recognition result to the partial image.
Claim 24
Dependent Claim
23 words
The image processing device according to claim 19 , further comprising: a modifying device modifying the type code information of the partial image.
Claim 25
Dependent Claim
63 words
The image processing device according to claim 18 , wherein: said recognizing device obtains a degree of certainty of the one or more candidates; and said outputting device provides a predetermined degree of certainty to the image data corresponding to the image constituent element, and ranking the one or more candidates and the image data in descending order of the degree of certainty.
Claim 26
Dependent Claim
29 words
The image processing device according to claim 22 , further comprising: an inputting device inputting the degree of certainty of the image data corresponding to the image constituent element.
Claim 27
Dependent Claim
48 words
The image processing device according to claim 23 , wherein: said outputting device outputs information of the first rank among the one or more candidates and the image data, and changing the information of the first rank according to the degree of certainty input from said inputting device.
Claim 28
Dependent Claim
180 words
A computer-readable storage medium storing a program, which is intended for a computer performing a recognition process of an input image, for directing the computer to execute: displaying type code information indicating a type of a pattern region of the input image as a recognition result candidate of a partial image structuring the input image when the pattern region has an internal structure; displaying the type code information and individual code information indicating a pattern included in the pattern region as the recognition result candidate when the pattern region does not have the internal structure; performing a character recognition process of the pattern included in the pattern region and displaying a list of recognition result candidates if a first candidate of the type of the pattern region is a character, the list including individual code information of one or more candidate characters of a recognition result as upper recognition result candidates and type code information other than the character as a lower recognition result candidate; and modifying the displayed list of the recognition result candidates according to a user instruction.
Claim 29
Dependent Claim
180 words
A computer-readable storage medium storing a program, which is intended for a computer performing a recognition process of an input image, for directing the computer to execute: displaying type code information indicating a type of a pattern region of the input image as a recognition result candidate of a partial image structuring the input image when the pattern region has an internal structure; displaying the type code information and individual code information indicating a pattern included in the pattern region as the recognition result candidate when the pattern region does not have the internal structure; performing a character recognition process of the pattern included in the pattern region and displaying a list of recognition result candidates if a first candidate of the type of the pattern region is a character, the list including individual code information of one or more candidate characters of a recognition result as upper recognition result candidates and type code information other than the character as a lower recognition result candidate; and modifying the displayed list of the recognition result candidates according to a user instruction.
Claim 30
Dependent Claim
116 words
A computer-readable storage medium storing a program, which is intended for a computer, for directing the computer to execute: extracting a partial image structuring an input image from the input image; adding new code information to image data corresponding to the partial image , the new code information representing the image data; outputting document information where the image data corresponding to the partial image and a character pattern corresponding to existing code information are mixed; and editing the document information with the image data and the character pattern mixed by using the new code information as an operating target for the image data and the existing code information as an operation target for the character pattern.
Claim 31
Dependent Claim
116 words
A computer-readable storage medium storing a program, which is intended for a computer, for directing the computer to execute: extracting a partial image structuring an input image from the input image; adding new code information to image data corresponding to the partial image , the new code information representing the image data; outputting document information where the image data corresponding to the partial image and a character pattern corresponding to existing code information are mixed; and editing the document information with the image data and the character pattern mixed by using the new code information as an operating target for the image data and the existing code information as an operation target for the character pattern.
Claim 32
Dependent Claim
147 words
A computer-readable storage medium storing a program, which is intended for a computer, for directing the computer to execute: extracting a partial image structuring an input image from the input image; performing an image recognition process of the partial image; separating image data corresponding to the partial image from the input image, and displaying the partial image data together with a plurality of candidates of a recognition result of the partial image within a candidate display region, the candidates corresponding to different image recognition results for the same partial image; a selecting process selecting any of the one or more candidates and the image data; and an editing process adding new code information to a partial image corresponding to the image data when the image data is selected, and editing a document where the image data and a character pattern corresponding to existing code information are mixed.
Claim 33
Dependent Claim
147 words
A computer-readable storage medium storing a program, which is intended for a computer, for directing the computer to execute: extracting a partial image structuring an input image from the input image; performing an image recognition process of the partial image; separating image data corresponding to the partial image from the input image, and displaying the partial image data together with a plurality of candidates of a recognition result of the partial image within a candidate display region, the candidates corresponding to different image recognition results for the same partial image; a selecting process selecting any of the one or more candidates and the image data; and an editing process adding new code information to a partial image corresponding to the image data when the image data is selected, and editing a document where the image data and a character pattern corresponding to existing code information are mixed.
Claim 34
Dependent Claim
198 words
An image processing method, comprising: inputting an image to a computer; identifying a pattern region of an input image, the pattern region including a pattern in the input image, and determining a type of the pattern region according to whether the pattern region has an internal structure of pattern regions; displaying type code information indicating the determined type of the pattern region on a screen as a recognition result candidate of a partial image structuring the input image when the pattern region has the internal structure; displaying the type code information and individual code information indicating the pattern as the recognition result candidate when the pattern region does not have the internal structure; performing a character recognition process of the pattern included in the pattern region and displaying a list of recognition result candidates if a first candidate of the type of the pattern region is a character, the list including individual code information of one or more candidate characters of a recognition result as upper recognition result candidates and type code information other than the character as a lower recognition result candidate; and modifying the displayed list of the recognition result candidates according to a user instruction.
Claim 35
Dependent Claim
198 words
An image processing method, comprising: inputting an image to a computer; identifying a pattern region of an input image, the pattern region including a pattern in the input image, and determining a type of the pattern region according to whether the pattern region has an internal structure of pattern regions; displaying type code information indicating the determined type of the pattern region on a screen as a recognition result candidate of a partial image structuring the input image when the pattern region has the internal structure; displaying the type code information and individual code information indicating the pattern as the recognition result candidate when the pattern region does not have the internal structure; performing a character recognition process of the pattern included in the pattern region and displaying a list of recognition result candidates if a first candidate of the type of the pattern region is a character, the list including individual code information of one or more candidate characters of a recognition result as upper recognition result candidates and type code information other than the character as a lower recognition result candidate; and modifying the displayed list of the recognition result candidates according to a user instruction.
Claim 36
Dependent Claim
110 words
An image processing method, comprising: inputting an image to a computer; extracting a partial image structuring an input image from the input image; adding new code information to image data corresponding to the partial image, the new code information representing the image data; displaying document information where the image data corresponding to the partial image and a character pattern corresponding to existing code information are mixed on a screen; and editing the document information with the image data and the character pattern mixed by using the new code information as an operation target for the image data and the existing code information as an operation target for the character pattern.
Claim 37
Dependent Claim
110 words
An image processing method, comprising: inputting an image to a computer; extracting a partial image structuring an input image from the input image; adding new code information to image data corresponding to the partial image, the new code information representing the image data; displaying document information where the image data corresponding to the partial image and a character pattern corresponding to existing code information are mixed on a screen; and editing the document information with the image data and the character pattern mixed by using the new code information as an operation target for the image data and the existing code information as an operation target for the character pattern.
Claim 38
Dependent Claim
143 words
An image processing method, comprising: inputting an image to a computer; extracting a partial image structuring an input image from the input image; performing an image recognition process of the partial image; separating image data corresponding to the partial image from the input image, and displaying the partial image data together with a plurality of candidates of a recognition result of the image constituent element within a candidate display region on a screen, the candidates corresponding to different image recognition results for the same partial image; a selecting process selecting any of the one or more candidates and the image data; and an editing process adding new code information to a partial image corresponding to the image data when the image data is selected, and editing a document where the image data and a character pattern corresponding to existing code information are mixed.
Claim 39
Dependent Claim
143 words
An image processing method, comprising: inputting an image to a computer; extracting a partial image structuring an input image from the input image; performing an image recognition process of the partial image; separating image data corresponding to the partial image from the input image, and displaying the partial image data together with a plurality of candidates of a recognition result of the image constituent element within a candidate display region on a screen, the candidates corresponding to different image recognition results for the same partial image; a selecting process selecting any of the one or more candidates and the image data; and an editing process adding new code information to a partial image corresponding to the image data when the image data is selected, and editing a document where the image data and a character pattern corresponding to existing code information are mixed.
References Cited (Backward Citations)
US5113492A
Cited
US5394484A
Cited
US5231579A
Cited
US5271067A
Cited
US5257328A
Cited
US5841901A
Cited
US5509092A
Cited
US5455875A
Cited
US5717794A
Cited
US6043823A
Cited
US5917942A
Cited
US5933531A
Cited
US5889897A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2005-10-14 | 2006-04-15 | 2006-10-15 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2009-10-14 | 2010-04-15 | 2010-10-15 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2013-10-14 | 2014-04-15 | 2014-10-15 | $7700.00 | Window Closed / Lapsed |