← Back to Patent Explorer
US6002808A Expired / Lapsed US ⏱️ 0.0 years remaining

Hand gesture control system

Assignee: Mitsubishi Electric Research Laboratories Inc
•
Filing: 1996-07-26
•
Granted: 1999-12-14
•
Expires: 2016-07-26
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A system is provided for rapidly recognizing hand gestures for the control of computer graphics, in which image moment calculations are utilized to determine an overall equivalent rectangle corresponding to hand position, orientation and size, with size in one embodiment correlating to the width of the hand. In a further embodiment, a hole generated through the utilization of the touching of the forefinger with the thumb provides a special trigger gesture recognized through the corresponding hole in the binary representation of the hand. In a further embodiment, image moments of images of other objects are detected for controlling or directing onscreen images.

Inventors

  • 👤 William T. Freeman

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 13:29
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/017; G06V; G06V40/00; G06V40/20; A; A63; A63F; A63F2300/00; A63F2300/10; A63F2300/1087; A63F2300/1093; A63F2300/60; A63F2300/6045; A63F2300/80; A63F2300/8041; G06V40/10; G06V40/18

Claims Analysis

Total Claims: 37
Claim 1
Independent Claim 107 words
A system for rapidly recognizing non-regular objects in space for the control of computer graphics, comprising: means for scanning an area at which said object is expected to exist and for generating an electronic image in the form of a pixel representation of said object; means for detecting and calculating image moments from pixel intensities of pixels in said pixel representation; means for determining, based upon the calculated image moments, an overall rectangle equivalent to the object and having a position, orientation, length and width corresponding to object position, orientation, length and width; and, means for identifying parameters of said rectangle and generating a corresponding control signal.
Claim 2
Independent Claim 107 words
A system for rapidly recognizing non-regular objects in space for the control of computer graphics, comprising: means for scanning an area at which said object is expected to exist and for generating an electronic image in the form of a pixel representation of said object; means for detecting and calculating image moments from pixel intensities of pixels in said pixel representation; means for determining, based upon the calculated image moments, an overall rectangle equivalent to the object and having a position, orientation, length and width corresponding to object position, orientation, length and width; and, means for identifying parameters of said rectangle and generating a corresponding control signal.
Claim 3
Independent Claim 113 words
A system for rapidly recognizing hand gestures for the control computer graphics, comprising: means for scanning an area at which a hand is expected to exist and for generating an electronic image in the form of a pixel representation of said hand; means for calculating image moments from pixel intensities of pixels in said pixel representation; means for determining, based upon the calculated image moments, an overall rectangle equivalent to the hand and having a position, orientation, length and width corresponding to a position, orientation, length and width of the hand; and, means for correlating said rectangle with a predetermined hand gesture and for providing a signal representing the result of said correlation.
Claim 4
Independent Claim 113 words
A system for rapidly recognizing hand gestures for the control computer graphics, comprising: means for scanning an area at which a hand is expected to exist and for generating an electronic image in the form of a pixel representation of said hand; means for calculating image moments from pixel intensities of pixels in said pixel representation; means for determining, based upon the calculated image moments, an overall rectangle equivalent to the hand and having a position, orientation, length and width corresponding to a position, orientation, length and width of the hand; and, means for correlating said rectangle with a predetermined hand gesture and for providing a signal representing the result of said correlation.
Claim 5
Dependent Claim 45 words
The system of claim 2 wherein the correlating means responds to at least one of the position, the orientation, the length and the width of the rectangle exceeding a predetermined threshold by generating the control signal to control said computer graphics in a predetermined manner.
Claim 6
Dependent Claim 19 words
The system of claim 2, wherein said size corresponds to the width of the hand making said hand gesture.
Claim 7
Dependent Claim 48 words
The system of claim 2, wherein said correlating means responds to the existence of a hole within a region of said pixels generated through touching of a finger and a thumb of said hand by providing a predetermined signal upon correlating the corresponding rectangle to that hand gesture.
Claim 8
Dependent Claim 24 words
The system of claim 5 further comprising means for determining that the hole exist by counting a number of holes in said pixel representation.
Claim 9
Independent Claim 84 words
A system for rapidly recognizing a non-regular image, comprising: means for generating a representation of said image; means for detecting and calculating image moments from pixel intensities of pixels in said pixel representation; means for determining, based on the calculated image moments, an overall geometric structure equivalent to the image and having length, width and height characteristics corresponding to parameters of said image; and, means for correlating said structure with a predetermined structure and for providing a signal representing the result of said correlating.
Claim 10
Independent Claim 84 words
A system for rapidly recognizing a non-regular image, comprising: means for generating a representation of said image; means for detecting and calculating image moments from pixel intensities of pixels in said pixel representation; means for determining, based on the calculated image moments, an overall geometric structure equivalent to the image and having length, width and height characteristics corresponding to parameters of said image; and, means for correlating said structure with a predetermined structure and for providing a signal representing the result of said correlating.
Claim 11
Dependent Claim 42 words
The system of claim 7 wherein the correlating means responds to at least one of the length, the width and the height characteristics of the structure exceeding a predetermined threshold by providing the signal to control computer graphics in a particular manner.
Claim 12
Dependent Claim 115 words
The system of claim 7, wherein said image is that of a hand, wherein said pixel generating means includes means for generating an electronic binary pixel image corresponding to said hand; and further comprising; means for determining a change in image topology corresponding to the exact time a portion of said image is in the form of a completed circle corresponding to that time at which a hole generated through touching of a finger of with a thumb of the hand is completed; and means for providing a predetermined signal upon detection of said completed circle, whereby said completed circle can be used as a staccato button-like-push to effectuate a hand generated on/off control action.
Claim 13
Dependent Claim 13 words
The system of claim 9 wherein said predetermined signal is a trigger signal.
Claim 14
Dependent Claim 26 words
The system of claim 10, wherein said trigger signal is generated in response to the detection of a hole within a region of said generated pixels.
Claim 15
Dependent Claim 21 words
The system of claim 11, wherein said hole is detected by counting the number of holes in said binary pixel image.
Claim 16
Independent Claim 109 words
A method of controlling a digital representation, comprising the steps of: imaging an object to generate object images; determining a movement of the object based upon at least one of an orientation and a position of a first geometric configuration having a contour different than a contour of the object and corresponding to image intensities of a first of the object images and at least one of an orientation and a position of a second geometric configuration having a contour different than a contour of the object and corresponding to image intensities of a second of the object images; and controlling a digital representation based upon the determined movement.
Claim 17
Independent Claim 109 words
A method of controlling a digital representation, comprising the steps of: imaging an object to generate object images; determining a movement of the object based upon at least one of an orientation and a position of a first geometric configuration having a contour different than a contour of the object and corresponding to image intensities of a first of the object images and at least one of an orientation and a position of a second geometric configuration having a contour different than a contour of the object and corresponding to image intensities of a second of the object images; and controlling a digital representation based upon the determined movement.
Claim 18
Dependent Claim 67 words
The method of claim 13, further comprising the steps of: computing a first spatially weighted average intensity of the generated first image in its entirety; computing a second spatially weighted average intensity of the generated second image in its entirety; generating the first geometric configuration based upon the computed first spatially weighted average; and generating the second geometric configuration based upon the computed second spatially weighted average.
Claim 19
Dependent Claim 25 words
The method of claim 13, wherein: the imaged object is a hand; the geometric configuration is a rectangle; and the movement corresponds to a gesture.
Claim 20
Dependent Claim 44 words
The method of claim 15, wherein: the gesture is a circle formed with a thumb and a finger of the hand; and the digital representation is controlled such that an action is triggered responsive to the thumb contacting the finger to form the circle.
Claim 21
Dependent Claim 144 words
The method of claim 13, further comprising the steps of: computing a first spatially weighted average intensity of the generated first image; computing a second spatially weighted average intensity of the generated second image; generating the first geometric configuration based upon the computed first spatially weighted average intensity, wherein the center of mass of the object in the first image corresponds to the center of the first geometric configuration; and generating the second geometric configuration based upon the computed second spatially weighted average intensity, wherein the center of mass of the object in the second image corresponds to the center of the second geometric configuration; wherein the orientation and the position of the second geometric configuration is determined based on a difference in a location of the center of the first geometric configuration and a location of the center of the second geometric configuration.
Claim 22
Dependent Claim 81 words
The method of claim 13, further comprising the steps of: computing first summations respectively summing intensities of the generated first image in an x direction, in a y direction and in a diagonal direction; computing second summations respectively summing intensities of the generated second image in the x direction, in the y direction and in the diagonal direction; generating the first geometric configuration based upon the computed first summations; and generating the second geometric configuration based upon the computed second summations.
Claim 23
Dependent Claim 67 words
The method of claim 13, further comprising the steps of: determining another movement of the object in a third of the object images based upon a distance between (i)a third geometric configuration having a contour different than a contour of the object and corresponding to the object in the third image and (ii) a fixed reference; and controlling the digital representation based upon the determined other movement.
Claim 24
Dependent Claim 33 words
The method of claim 19, wherein: the distance is a vertical distance and exceeds a threshold; and the digital representation is controlled to perform a jump sequence based upon the determined other movement.
Claim 25
Independent Claim 92 words
A system for controlling a digital representation, comprising: an imager configured to generate image intensity data representing an object in an orientation; and at least one processor configured (i) to process the generated image intensity data to generate a geometric configuration, corresponding to the generated image intensity data, representing the object, and having a contour different than a contour of the represented object and an orientation corresponding to the orientation of the represented object, and (ii) to generate signals to control a digital representation based upon the orientation of the geometric configuration.
Claim 26
Independent Claim 92 words
A system for controlling a digital representation, comprising: an imager configured to generate image intensity data representing an object in an orientation; and at least one processor configured (i) to process the generated image intensity data to generate a geometric configuration, corresponding to the generated image intensity data, representing the object, and having a contour different than a contour of the represented object and an orientation corresponding to the orientation of the represented object, and (ii) to generate signals to control a digital representation based upon the orientation of the geometric configuration.
Claim 27
Dependent Claim 12 words
The system of claim 21, wherein the object is a body part.
Claim 28
Dependent Claim 12 words
The system of claim 21, wherein the geometric configuration is a rectangle.
Claim 29
Dependent Claim 53 words
The system of claim 21, wherein: the represented object has a position; the generated geometric configuration has a position corresponding to the position of the represented object; and the at least one processor is further configured to generate the signals to control the digital representation based upon the position of the geometric configuration.
Claim 30
Dependent Claim 159 words
The system of claim 21, wherein: the orientation of the represented object is a first object orientation, the image data is first image data, and the geometric configuration is a first geometric configuration and the orientation of the first geometric configuration is a first orientation; the imager is further configured to generate second image data representing the object in a second object orientation; and the at least one processor is further configured (i) to process the generated second image data to generate a second geometric configuration representing the object, and having a contour different than the contour of the object represented by the second image data and a second orientation corresponding to the second object orientation of the object, (ii) to determine a movement of the object from the second object orientation to the first object orientation based upon the first orientation, and (iii) to generate the signals to control the digital representation in accordance with the determined movement.
Claim 31
Dependent Claim 41 words
The system of claim 21, wherein said at least one processor is further configured to: compute a spatially weighted average intensity of the generated image data in its entirety; and generate the geometric configuration based upon the computed spatially weighted average.
Claim 32
Dependent Claim 56 words
The system of claim 21, wherein: the object is a hand; the image data represents a circle formed with a thumb and a finger of the hand; and the at least one processor is configured to generate the control signal to thereby trigger an action responsive to the thumb contacting the finger to form the circle.
Claim 33
Dependent Claim 38 words
The system of claim 21, wherein the object has a center of mass and the geometric configuration has a center point; and the center point of the geometric configuration corresponds to the center of mass of the object.
Claim 34
Dependent Claim 49 words
The system of claim 21, wherein: the at least one processor is further configured to compute summations respectively summing intensities of the generated image data in an x direction, in a y direction and in a diagonal direction and to generate the geometric configuration based upon the computed summations.
Claim 35
Dependent Claim 65 words
The system of claim 21, wherein: the represented object has a position; the generated geometric configuration has a position corresponding to the position of the represented object; the at least one processor is further configured to determine a distance between the position of the geometric configuration and a fixed reference, and to generate the signals to control the digital representation based upon the determined distance.
Claim 36
Dependent Claim 27 words
The system of claim 30, wherein: the distance is a vertical distance and exceeds a threshold; and the digital representation is controlled to perform a jump sequence.
Claim 37
Dependent Claim 26 words
The system of claim 21, wherein: the at least one processor is two processors; and the imager and one of the processors form an artificial retina.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2002-12-13 2003-06-14 2003-12-14 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2006-12-13 2007-06-14 2007-12-14 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2010-12-13 2011-06-14 2011-12-14 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag