Man machine interfaces for entering data into a computer

Claim 3

A method according to claim 1 wherein steps (b) and (c) occur substantially simultaneously for a plurality of separate discrete areas of input on said front surface.

Claim 4

A method according to claim 1 wherein electro-optical image forming step (b) is accomplished with a TV camera.

Claim 5

A method according to claim 3 wherein an image of substantially the entire area of said back surface is formed on said camera.

Claim 6

A method according to claim 3 wherein an image of a grid on said back surface is formed on said camera.

Claim 7

A method according to claim 3 wherein said image forming step (b) comprises stroboscopically illuminating said back surface.

Claim 8

A method according to claim 3 wherein said image-forming step (b) comprises detecting light retro-reflected to said back surface.

Claim 9

A method according to claim 1 wherein step (c) includes determining from said image a vector along a longitudinal axis of distortion of said back surface.

Claim 10

A method according to claim 1 wherein said extensive material comprises a display screen for TV images.

Claim 11

A method according to claim 1 wherein step (c) comprises comparing instant data to a previously recorded electro-optical image of the back surface prior to said temporary disturbance or distortion.

Claim 12

A method according to claim 1 wherein step (d) comprises generating said data entry signal with respect to a previous condition of the surfaces.

Claim 13

A method according to claim 1 wherein step (c) comprises obtaining a signature of said back surface.

Claim 14

A method according to claim 12 wherein said signature comprises a distortion or disturbance of said back surface at a plurality of points.

Claim 15

A method according to claim 12 further comprising utilizing a characteristic of said signature to identify at least a portion of a distortion or disturbance for generating said data entry signal.

Claim 16

A method according to claim 1 further comprising providing tactile feedback in response to said disturbance or distortion generating step (a).

Claim 17

A method according to claim 1 wherein the input of step (a) comprises applying a force to said front surface, said force being produced by at least one of pressure, vacuum, heat, electromagnetism, and weight.

Claim 18

A method according to claim 1 wherein the input of step (a) comprises striking said front surface with an object.

Claim 19

A method according to claim 1 wherein said extensive material comprises a single membrane element.

Claim 20

A method according to claim 1 wherein said extensive material comprises multiple substantially independently movable elements.

Claim 21

A method according to claim 1 wherein said image-forming step (b) comprises forming an image of substantially the entire area of said back surface simultaneously.

Claim 22

A method according to claim 1 wherein said extensive material is contoured when undistorted.

Claim 23

A method according to claim 1 wherein said determining step (c) comprises determining the location of said temporary distortion or disturbance and determining an intensity centroid of light reflected from said back surface.

Claim 24

A method according to claim 1 wherein said determining step (c) comprises detecting light above or below a given threshold intensity.

Claim 25

A method according to claim 1 wherein, in step (a), transmission of light through said material occurs simultaneously with said distortion due to photoelastic properties of said material under stress of said distortion.

Claim 26

A method according to claim 1 wherein, in step (c), said at least one characteristic comprises the location of said input, and wherein step (c) includes determining the source of said input from said location characteristic.

Claim 27

A method according to claim 1 wherein said extensive material is large with respect to the temporary distortion or disturbance.

Claim 28

A method according to claim 1 wherein the image formed in step (b) comprises a "D Sight" image.

Claim 29

A method according to claim 1 wherein the image formed in step (b) comprises a triangulation image.

Claim 30

A method according to claim 1 wherein said temporary distortion or disturbance comprises a convex distortion of said back surface.

Claim 31

Apparatus for entering data to a computer or a data storage device, comprising: (a) a video monitor having an extensive video display screen for viewing video images, said screen having a front surface and a back surface; (b) means for generating, via an input on said front surface, a temporary disturbance or distortion on said back surface of said screen; (c) image-forming means for electro-optically forming thereon an image of at least a substantial portion of said back surface, said image including an image of said temporary disturbance or distortion of said back surface; (d) determining means for determining from said image of said back surface at least one characteristic of said input and generating at least one data entry signal representative of the determined characteristic of said input; and (f) means for entering said data entry signal to said computer or data storage device.

Claim 32

Apparatus for entering data to a computer or a data storage device, comprising: (a) a video monitor having an extensive video display screen for viewing video images, said screen having a front surface and a back surface; (b) means for generating, via an input on said front surface, a temporary disturbance or distortion on said back surface of said screen; (c) image-forming means for electro-optically forming thereon an image of at least a substantial portion of said back surface, said image including an image of said temporary disturbance or distortion of said back surface; (d) determining means for determining from said image of said back surface at least one characteristic of said input and generating at least one data entry signal representative of the determined characteristic of said input; and (f) means for entering said data entry signal to said computer or data storage device.

Claim 33

Apparatus according to claim 30 further comprising means for actuating said image-forming means and said determining means substantially simultaneously for a plurality of discrete areas of input on said front surface.

Claim 34

Apparatus according to claim 30 wherein said image forming means comprises a TV camera.

Claim 35

Apparatus according to claim 32 wherein the field of view of said TV camera includes substantially the entire area of said back surface of said screen.

Claim 36

Apparatus according to claim 33 further comprising a grid on said back surface.

Claim 37

Apparatus according to claim 30 wherein said determining means comprises means for determining a vector along a longitudinal axis of a distortion of said back surface.

Claim 38

Apparatus according to claim 30 wherein said determining means comprises means for comparing said image to a previously recorded electro-optical image of the back surface.

Claim 39

Apparatus according to claim 30 further comprising means for providing tactile feedback in response to said input on said front surface.

Claim 40

Apparatus according to claim 30 wherein said image-forming means comprises means for forming an image of substantially the entire area of said back surface simultaneously.

Claim 41

Apparatus according to claim 30 wherein said screen is contoured when distorted.

Claim 42

Apparatus according to claim 30 wherein said image-forming means comprises means for stroboscopically illuminating said back surface.

Claim 43

Apparatus according to claim 30 wherein said image-forming means comprises means for detecting light retro-reflected to said back surface.

Claim 44

Apparatus according to claim 30 wherein said characteristic determining means comprises means for determining the location of said temporary distortion and comprises means for determining an intensity centroid of light reflected from said back surface.

Claim 45

Apparatus according to claim 30 wherein said image forming means comprises means for forming a "D sight" image.

Claim 46

Apparatus according to claim 30 wherein said image forming means comprises means for forming a triangulation image.

Claim 47

An interactive video system comprising; (a) a plurality of targets connectable to a user; (b) detector means for monitoring the location and motion of said targets and for outputting target data based on the monitored location and motion of said targets; (c) a user activity processor for receiving said target data and for outputting user data; (d) a video monitor having an extensive display screen for displaying video images, said screen having a front surface and a back surface; (e) means for generating, via an input on said front surface of said screen, a temporary disturbance or distortion on said back surface; (f) image-forming means for electro-optically forming thereon an image of at least a substantial portion of said back surface of said screen, said image including an image of said temporary disturbance or distortion of said back surface; (g) determining means for determining from said image of said back surface at least one characteristic of said input and generating at least one data entry signal representative of the determined characteristic of said input; (h) means for entering said data entry signal into a control processor; and (i) a control processor for receiving said data entry signal and said user data, and for providing an output in accordance with said data entry signal and said user data.

Claim 48

An interactive video system comprising; (a) a plurality of targets connectable to a user; (b) detector means for monitoring the location and motion of said targets and for outputting target data based on the monitored location and motion of said targets; (c) a user activity processor for receiving said target data and for outputting user data; (d) a video monitor having an extensive display screen for displaying video images, said screen having a front surface and a back surface; (e) means for generating, via an input on said front surface of said screen, a temporary disturbance or distortion on said back surface; (f) image-forming means for electro-optically forming thereon an image of at least a substantial portion of said back surface of said screen, said image including an image of said temporary disturbance or distortion of said back surface; (g) determining means for determining from said image of said back surface at least one characteristic of said input and generating at least one data entry signal representative of the determined characteristic of said input; (h) means for entering said data entry signal into a control processor; and (i) a control processor for receiving said data entry signal and said user data, and for providing an output in accordance with said data entry signal and said user data.

Claim 49

An interactive video system as recited in claim 45, wherein said output from said control processor comprises a video image displayed on said front surface.

Claim 50

An interactive video system as recited in claim 45, wherein said targets comprise reflectors and said detector means comprise video cameras.

Claim 51

An interactive video system as recited in claim 45, further comprising storage means for storing said user data.