Voice-output reading system with gesture-based navigation

Claim 3

A method as defined in claim 1, wherein the pointer is comprised of a finger on the user's hand.

Claim 4

A method as defined in claim 1, wherein a portion of the spatial configurations are comprised of the relative locations and orientations of two or more pointers.

Claim 5

A method as defined in claim 1, wherein a portion of the spatial configurations are comprised of the locations of the pointer relative to the text.

Claim 6

A method as defined in claim 1, wherein the pointer is attached to the user's hand.

Claim 7

A method as defined in claim 1, wherein the spatial configurations of the pointer are determined from the digital image.

Claim 8

A method as defined in claim 1, wherein the digital image is obtained from a means attached to the user's hand.

Claim 9

A method as defined in claim 7, wherein determining command signals comprises analyzing the relative location of text within the digital image from successive frames in order to determine the location and motion of the means of obtaining the digital image relative to the text.

Claim 10

A method as defined in claim 1, wherein a camera is used to obtain digital images and a second camera is used to capture temporal sequences of digital images.

Claim 11

A method as defined in claim 9, wherein the cameras have substantially different sized fields of view.

Claim 12

A method as defined in claim 1, wherein a single camera is used to both obtain the first digital image and to capture the temporal sequence of digital images.

Claim 13

A method as defined in claim 1, wherein the operation of feeding back includes providing feedback directly on the text to be read.

Claim 14

A method as defined in claim 1, wherein the operation of feeding back includes providing feedback through an electronic display of at least a portion of the digital image.

Claim 15

A method as defined in claim 1, wherein a flatbed scanner is used to obtain digital images.

Claim 16

A method as defined in claim 1, wherein digital images are obtained from an internal computer video buffer of a screen image.

Claim 17

A method as defined in claim 1, wherein the spatial configurations of the pointer are determined from the interaction of a proximity-sensitive display with the pointer.

Claim 18

A method as defined in claim 1, wherein the act of obtaining digital images can be accomplished via an imaging device worn by the user.

Claim 19

A method as defined in claim 17, wherein the imaging device is incorporated into glasses worn by the user.

Claim 20

A method as defined in claim 1, including additionally displaying enhanced images of the text to the user.

Claim 21

A method as defined in claim 19, wherein the degree of enhancement is controlled by the user.

Claim 22

A method as defined in claim 20, wherein the degree of image enhancement is controlled by the command signal.

Claim 23

A method as defined in claim 19, wherein the image enhancement is a magnification of the text.

Claim 24

A method as defined in claim 19, wherein the image enhancement comprises affecting a property of the image chosen from the group consisting of contrast, brightness, bit-depth, and color polarity.

Claim 25

A method as defined in claim 1, including additionally providing the user feedback information about the layout of text within the digital image.

Claim 26

A method as defined in claim 1, wherein the spatial information is fed back via tactile information.

Claim 27

A method as defined in claim 25, wherein the tactile information is transduced by vibrating pins.

Claim 28

A method as defined in claim 25, wherein the tactile information is transduced by a force-feedback mouse.

Claim 29

A method as defined in claim 1, wherein the spatial information is fed back via visual information.

Claim 30

A method as defined in claim 28, wherein the visual information is displayed on the text using a laser scanner.

Claim 31

A method as defined in claim 1, wherein the spatial information is fed back via audible information.

Claim 32

An electronic reading apparatus for converting text to spoken words for a user, comprising: a pointer that is operated by the user to indicate commands, wherein commands are encoded in the location and movement of the pointer relative to the text; a digital imaging device that converts text to a digital imaging signal and which additionally captures a temporal sequence of digital images of the pointer, wherein the temporal sequence of images contains information about the location and movement of the pointer relative to the text; a character recognizer receptive of the digital imaging signal, the recognizer generating a recognized character signal comprising the symbolic identity of the recognized text and the location of the recognized text relative to the digital imaging signal; a pointer tracker that determines the pointer location and movement, the tracker generating a pointer location and movement signal relative to the text; a command interpreter receptive of the pointer location and movement signal and the recognized character signal, the interpreter generating a command signal indicating the text to be converted to spoken words; a feedback device receptive of the command signal, and providing feedback to the user about the location of the text to be converted to spoken words and the location of the pointer relative to recognized text; a controller receptive of the command signal and the recognized character signal, the controller generating an output signal representative of at least portions of the text recognized; and a transducer receptive of the output signal for converting the output signal to speech.

Claim 33

An electronic reading apparatus for converting text to spoken words for a user, comprising: a pointer that is operated by the user to indicate commands, wherein commands are encoded in the location and movement of the pointer relative to the text; a digital imaging device that converts text to a digital imaging signal and which additionally captures a temporal sequence of digital images of the pointer, wherein the temporal sequence of images contains information about the location and movement of the pointer relative to the text; a character recognizer receptive of the digital imaging signal, the recognizer generating a recognized character signal comprising the symbolic identity of the recognized text and the location of the recognized text relative to the digital imaging signal; a pointer tracker that determines the pointer location and movement, the tracker generating a pointer location and movement signal relative to the text; a command interpreter receptive of the pointer location and movement signal and the recognized character signal, the interpreter generating a command signal indicating the text to be converted to spoken words; a feedback device receptive of the command signal, and providing feedback to the user about the location of the text to be converted to spoken words and the location of the pointer relative to recognized text; a controller receptive of the command signal and the recognized character signal, the controller generating an output signal representative of at least portions of the text recognized; and a transducer receptive of the output signal for converting the output signal to speech.

Claim 34

A device as defined in claim 31, wherein the feedback device is additionally receptive of the recognized character signal and provides feedback to the user about the location of recognized text.