Document image processing method and system having function of determining body text region reading order

Claim 2

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into: (b1) in-order reading regions of text which are to be successively read in a predetermined order and (b2) different-attribute regions of text; c) detect a construction of said in-order reading regions but not of said different-attribute regions; and d) determine the reading order, in which said in-order reading regions are to be read, using said construction.

Claim 3

The computer-readable medium of claim 1, causing said processor to: detect said construction in a manner that is the same whether said input document image comprises a vertically typeset document or a horizontally typeset document.

Claim 4

The computer-readable medium of claim 1, causing said processor to: form a tree graph representing said construction including modes respectively representing said in-order reading regions.

Claim 5

The computer-readable medium of claim 1, causing said processor to: classify said text regions into in-order reading regions enclosed by a box frame which is included in said input document image and in-order reading regions enclosed by no box frame; and determine the reading order in which said in-order reading regions enclosed by a box frame are to be read and further determine the reading order in which said in-order reading regions enclosed by no box frame are to be read.

Claim 6

The computer-readable medium of claim 4, wherein: said box frame is formed of four sides consisting of a top side, a bottom side, a right side and a left side.

Claim 7

The computer-readable medium of claim 1, causing said processor to: e) check whether said reading order is correct or incorrect; and f) re-determine the reading order if a result of incorrect is obtained.

Claim 8

The computer-readable medium of claim 6, wherein said check causes said processor to: check the reading order, in which the in-order reading regions are to be read, for the in-order reading regions enclosed in a box frame which is included in said input document image; and said re-determine causes said processor to re-determine the reading order for said in-order reading regions enclosed in said box frame.

Claim 9

The computer-readable medium of claim 7, wherein: said box frame is formed of four sides consisting of a top side, a bottom side, a right side and a left side.

Claim 10

The computer-readable medium of claim 1, causing said processor to: g) read the characters constituting said in-order reading regions in accordance with said reading order.

Claim 11

The computer-readable medium of claim 1, causing said processor to: detect said construction using imaginary ruled lines, which may be generated depending on contents of an original image and then added to said original image so as to control the detection operation.

Claim 12

The computer-readable medium of claim 10, wherein said imaginary ruled lines are generated for blank regions having a predetermined shape/predetermined dimensions and/or for figure/table regions.

Claim 13

The computer-readable medium of claim 1, causing said processor to: detect said construction using scopes of influence, assigned to appropriate regions, for searching subsequent regions; and each of said scopes of influence assigned to a respective one of said appropriate regions represents a scope on which said respective one of said appropriate regions has influence.

Claim 14

The computer-readable medium of claim 1, causing said processor to: prevent said different-attribute regions from affecting the determination of the reading order.

Claim 15

The computer-readable medium of claim 1, wherein said different-attribute regions include, a series of characters which are provided as footers and/or headers in said input document image.

Claim 16

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be successively read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if lines formed as the result of the connection intersect.

Claim 17

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be successively read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if lines formed as the result of the connection intersect.

Claim 18

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be successively read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if a number of intersections of the lines formed as a result of the connection exceeds a predetermined value.

Claim 19

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be successively read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if a number of intersections of the lines formed as a result of the connection exceeds a predetermined value.

Claim 20

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into: (b1) in-order reading regions of text which are to be read in a predetermined order and (b2) different-attribute regions of text; c) detect a construction of said in-order reading regions but not of said different-attribute regions; and d) determine the reading order, in which said in-order reading regions are to be read, using said construction.

Claim 21

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into: (b1) in-order reading regions of text which are to be read in a predetermined order and (b2) different-attribute regions of text; c) detect a construction of said in-order reading regions but not of said different-attribute regions; and d) determine the reading order, in which said in-order reading regions are to be read, using said construction.

Claim 22

The computer-readable medium of claim 17, causing said processor to: detect said construction in a manner that is the same whether said input document image comprises a vertically typeset document or a horizontally typeset document.

Claim 23

The computer-readable medium of claim 17, causing said processor to: form a tree graph representing said construction including nodes respectively representing said in-order reading regions.

Claim 24

The computer-readable medium of claim 17, causing said processor to: classify said text regions into in-order reading regions enclosed by a box frame which is included in said input document image and in-order reading regions enclosed by no box frame; and determine the reading order of said in-order reading regions enclosed by a box frame and further determine the reading order of said in-order reading regions enclosed by no box frame.

Claim 25

The computer-readable medium of claim 20, wherein: said box frame is formed of four sides consisting of a top side, a bottom side, a right side and a left side.

Claim 26

The computer-readable medium of claim 17, causing said processor to: check whether said reading order is correct or incorrect; and re-determine the reading order of said in-order reading regions using another predetermined procedure if a result of incorrect is obtained.

Claim 27

The computer-readable medium of claim 22, wherein said check causes said processor to: check the reading order of the in-order reading regions for the in-order reading regions enclosed in a box frame which is included in said input document image; and said re-determine causes said processor to re-determine the reading order for said in-order reading regions enclosed in said box frame.

Claim 28

The computer-readable medium of claim 23, wherein: said box frame is formed of four sides consisting of a top side, a bottom side, a right side and a left side.

Claim 29

The computer-readable medium of claim 17, causing said processor to read the characters constituting said in-order reading regions in accordance with said reading order.

Claim 30

The computer-readable medium of claim 17, causing said processor to: detect said construction using imaginary ruled lines, which may be generated depending on contents of an original image and then added to said original image so as to control the detection operation.

Claim 31

The computer-readable medium of claim 26, wherein said imaginary ruled lines are generated for blank regions having a predetermined shape/predetermined dimensions and/or for figure/table regions.

Claim 32

The computer-readable medium of claim 17, causing said processor to: detect said construction using scopes of influence, assigned to appropriate regions, for searching subsequent regions; and each of said scopes of influence assigned to a respective one of said appropriate regions represents a scope on which said respective one of said appropriate regions has influence.

Claim 33

The computer-readable medium of claim 17, causing said processor to: prevent said different-attribute regions from affecting the determination of said reading order.

Claim 34

The computer-readable medium of claim 17, wherein said different-attribute regions include: a series of characters which are provided as footers and/or headers in said input document image.

Claim 35

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order of said in-order reading regions using another predetermined procedure if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if lines formed as the result of the connection intersect.

Claim 36

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order of said in-order reading regions using another predetermined procedure if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if lines formed as the result of the connection intersect.

Claim 37

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order of said in-order reading regions using another predetermined procedure if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if intersections of lines formed as the result of the connection exceeds a predetermined threshold value.

Claim 38

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into in-order reading regions which are to be read in a predetermined order and into different-attribute regions; c) detect a construction of said in-order reading regions; d) determine the reading order, in which said in-order reading regions are to be read, using said construction; e) check whether said reading order is correct or incorrect; and f) re-determine the reading order of said in-order reading regions using another predetermined procedure if a result of incorrect is obtained; wherein said check causes said processor to: e1) provide reference points to the respective in-order reading regions; e2) connect said reference points in accordance with a relevant reading order; and e3) determine said reading order to be incorrect if intersections of lines formed as the result of the connection exceeds a predetermined threshold value.

Claim 39

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into: (b1) body regions of text which are to be successively read in a predetermined order and (b2) different-attribute regions of text; c) detect a construction of said body regions but not of said different-attribute regions; and d) determine the reading order, in which said body regions are to be read, using said construction.

Claim 40

A computer-readable medium having stored thereon a plurality of sequences of instructions, said plurality of sequences of instructions including sequences of instructions which, when executed by a processor, cause said processor to: a) extract text regions from an input document image; b) classify said text regions into: (b1) body regions of text which are to be successively read in a predetermined order and (b2) different-attribute regions of text; c) detect a construction of said body regions but not of said different-attribute regions; and d) determine the reading order, in which said body regions are to be read, using said construction.