Placing and monitoring transparent user interface elements in a live video stream as a method for user input

Claim 3

The method of claim 1 , further comprising changing the appearance of the at least one transparent user interface element on the display when the input signal is generated.

Claim 4

The method of claim 1 , wherein the at least one transparent user interface element comprises at least one transparent control.

Claim 5

The method of claim 3 , wherein the input signal indicates activation of the at least one transparent control.

Claim 6

The method of claim 3 , wherein the at least one transparent control comprises at least one of a button, check box, radio button, menu, hyperlink, and a slider bar.

Claim 7

The method of claim 1 , wherein the scene includes a user of the system and the rendered scene comprises a reflected image of the user.

Claim 8

The method of claim 1 , wherein the detected object comprises at least one body part of a user of the system.

Claim 9

The method of claim 1 , wherein the detected object comprises at least one prop.

Claim 10

In a system having a source of live video data and a display, an apparatus comprising: means for capturing live video data signals in real-time by the video source, the video data signals representing a scene in the physical world; means for inserting at least one transparent user interface element into the video data signals; means for rendering the video data signals such that the scene and the at least one transparent user interface element are transparently visible on the display along with non-transparent output data of the application program; means for analyzing the video data signals to detect an object in the scene as rendered on the display as appearing over or at least partially coinciding with a location of the at least one transparent user interface element as rendered on the display; and means for generating an input signal for the application program in response to detecting the object of the scene as rendered on the display as appearing over or at least partially coinciding with the at least one transparent user interface element as rendered on the display.

Claim 11

In a system having a source of live video data and a display, an apparatus comprising: means for capturing live video data signals in real-time by the video source, the video data signals representing a scene in the physical world; means for inserting at least one transparent user interface element into the video data signals; means for rendering the video data signals such that the scene and the at least one transparent user interface element are transparently visible on the display along with non-transparent output data of the application program; means for analyzing the video data signals to detect an object in the scene as rendered on the display as appearing over or at least partially coinciding with a location of the at least one transparent user interface element as rendered on the display; and means for generating an input signal for the application program in response to detecting the object of the scene as rendered on the display as appearing over or at least partially coinciding with the at least one transparent user interface element as rendered on the display.

Claim 12

The apparatus of claim 9 , further comprising means for changing the appearance of the at least one transparent user interface element on the display when the input signal is generated.

Claim 13

In a system having a source of live video data signals and a display, the live video data signals representing a scene in the physical world captured in real-time, an apparatus comprising: a filter to insert at least one transparent user interface element into the video data signals, to render the video data signals such that the scene and the at least one transparent user interface element are transparently visible on the display along with non-transparent output data of the application program, to analyze the video data signals to detect an object in the scene as rendered on the display as appearing over or at least partially coinciding with a location of the at least one transparent user interface element as rendered on the display, and to generate an input signal for the application program in response to detecting the object of the scene as rendered on the display as appearing over or at least partially coinciding with the at least one transparent user interface element as rendered on the display.

Claim 14

In a system having a source of live video data signals and a display, the live video data signals representing a scene in the physical world captured in real-time, an apparatus comprising: a filter to insert at least one transparent user interface element into the video data signals, to render the video data signals such that the scene and the at least one transparent user interface element are transparently visible on the display along with non-transparent output data of the application program, to analyze the video data signals to detect an object in the scene as rendered on the display as appearing over or at least partially coinciding with a location of the at least one transparent user interface element as rendered on the display, and to generate an input signal for the application program in response to detecting the object of the scene as rendered on the display as appearing over or at least partially coinciding with the at least one transparent user interface element as rendered on the display.

Claim 15

The apparatus of claim 11 , further comprising video capture circuitry to capture live video data signals generated by the live video data source.

Claim 16

The apparatus of claim 11 , further comprising video render circuitry to render the scene and the at least one transparent user interface element on the display such that the scene and the at least one transparent user interface element are transparently visible on the display.

Claim 17

The apparatus of claim 11 , further comprising a controlling application to send commands to the filter to insert the at least one transparent user interface element and to receive the generated input signal.

Claim 18

The apparatus of claim 11 , wherein the at least one transparent user interface element comprises at least one transparent control.

Claim 19

The apparatus of claim 15 , wherein the input signal indicates activation of the at least one transparent control.

Claim 20

The apparatus of claim 15 , wherein the at least one transparent control comprises at least one of a button, check box, radio button, menu, hyperlink, and a slider bar.

Claim 21

An article comprising a machine readable medium having a plurality of machine readable instructions, wherein when the instructions are executed by a processor, the instructions cause a system to capture in real-time live video data signals generated by a video source, the video data signals representing a scene, insert at least one transparent user interface element into the video data signals, to render the video data signals such that the scene and the at least one transparent user interface element are transparently visible on the display along with non-transparent output data of the application program, to analyze the video data signals to detect an object in the scene as rendered on the display as appearing over or at least partially coinciding with a location of the at least one transparent user interface element as rendered on the display, and to generate an input signal for the application program in response to detecting the object of the scene as rendered on the display as appearing over or at least partially coinciding with the at least one transparent user interface element as rendered on the display.

Claim 22

An article comprising a machine readable medium having a plurality of machine readable instructions, wherein when the instructions are executed by a processor, the instructions cause a system to capture in real-time live video data signals generated by a video source, the video data signals representing a scene, insert at least one transparent user interface element into the video data signals, to render the video data signals such that the scene and the at least one transparent user interface element are transparently visible on the display along with non-transparent output data of the application program, to analyze the video data signals to detect an object in the scene as rendered on the display as appearing over or at least partially coinciding with a location of the at least one transparent user interface element as rendered on the display, and to generate an input signal for the application program in response to detecting the object of the scene as rendered on the display as appearing over or at least partially coinciding with the at least one transparent user interface element as rendered on the display.

Claim 23

The article of claim 18 , wherein the machine readable medium further comprises instructions to change the appearance of the at least one transparent user interface element on the display when the input signal is generated.