Patent US7340077B2 successfully refreshed from Google Patents.
US7340077B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Gesture recognition system using depth perceptive sensors
Assignee: Microsoft Technology Licensing LLC
•
Filing: 2003-02-18
•
Granted: 2008-03-04
•
Expires: 2023-02-18
Abstract
Abstract Three-dimensional position information is used to identify the gesture created by a body part of interest. At one or more instances of an interval, the posture of a body part is recognized, based on the shape of the body part and its position and orientation. The posture of the body part over each of the one or more instances in the interval are recognized as a combined gesture. The gesture is classified for determining an input into a related electronic device.
Inventors
- 👤 Salih Burak Gokturk
- 👤 Carlo Tomasi
- 👤 Fahri Sürücü
- 👤 Abbas Rafii
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-26 17:17
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/017; G06V; G06V40/00; G06V40/10; G06V40/107; G06V40/11; G06V40/20; A; A63; A63F; A63F2300/00; A63F2300/10; A63F2300/1087; A63F2300/1093; H; H04; H04L; H04L12/00; H04L12/28; H04L12/2803; H04L2012/284; H04L2012/2841
Claims Analysis
Total Claims: 22
Claim 1
Independent Claim
153 words
A method to enable a person to interact with an electronic device by way of a gesture by a body part of said person, the method including the following steps: (a) obtaining position information for a plurality of discrete regions on said body part, said position information indicating a depth of each discrete region on said body part relative to a reference, said position information obtained at a plurality of instances during a given time duration interval; (b) detecting from position information obtained at step (a) start time and end time of a dynamic gesture by said body part, wherein said given time duration interval is defined between said start time and said end time; and (c) classifying said dynamic gesture formed by said body part as an input for interacting with said electronic device using position information obtained during said given time duration interval at each instance in said plurality of instances.
Claim 2
Independent Claim
153 words
A method to enable a person to interact with an electronic device by way of a gesture by a body part of said person, the method including the following steps: (a) obtaining position information for a plurality of discrete regions on said body part, said position information indicating a depth of each discrete region on said body part relative to a reference, said position information obtained at a plurality of instances during a given time duration interval; (b) detecting from position information obtained at step (a) start time and end time of a dynamic gesture by said body part, wherein said given time duration interval is defined between said start time and said end time; and (c) classifying said dynamic gesture formed by said body part as an input for interacting with said electronic device using position information obtained during said given time duration interval at each instance in said plurality of instances.
Claim 3
Dependent Claim
39 words
The method of claim 1 , wherein step (a) includes providing a pixel array to capture an image of a scene including said body part, wherein each pixel in said array corresponds to a discrete region of said scene.
Claim 4
Dependent Claim
90 words
The method of claim 2 , further including segmenting said body part from a remainder of said scene, wherein segmenting is carried out in a manner selected from a group consisting of (i) using position information to cluster together pixels representing portions of said body part, (ii) using position information to cluster together pixels representing portions of said body part based on similar depth information, and (iii) clustering together pixels representing portions of said body part based at least partially on a depth of a discrete region from said reference.
Claim 5
Dependent Claim
93 words
The method of claim 2 , further including performing a statistical analysis on said image in a manner selected from a group consisting of (I) identifying a shape of said body part, and (II) performing a statistical analysis on an image portion including said body part segmented from said scene; wherein performing a statistical analysis includes at least one of (i) creating a histogram using coordinates that identify pixels in said pixel array, and (ii) creating a histogram using coordinates that identity pixels in said pixel array on a boundary of said image.
Claim 6
Dependent Claim
22 words
The method of claim 1 , further including segmenting said body part from a remainder of a scene including said body part.
Claim 7
Dependent Claim
52 words
The method of claim 1 , further comprising identifying at least one of (i) a shape of said body part, (ii) a shape of said body part identified by performing statistical analysis on said image, (iii) a pose of said body part, and (iv) a pose and orientation of said body part.
Claim 8
Dependent Claim
58 words
The method of claim 1 , wherein step (c) includes classifying said gesture based on at least one of (i) shape of said body part, (ii) pose of said body part, and (iii) classifying a series of body postures occurring at multiple instances of said time duration interval wherein a combination of said body postures forms said gesture.
Claim 9
Dependent Claim
39 words
The method of claim 1 , wherein said body part includes at least one of said person's hands, and step (c) includes using said position information to classify a gesture created by at least one of said person's hands.
Claim 10
Dependent Claim
47 words
The method of claim 1 , wherein step (c) includes using position information to classify a gesture formed by at least one of a finger, a hand, an arm, a shoulder, an eye ball, an eye lid, a head, a foot, and a leg of said person.
Claim 11
Dependent Claim
44 words
The method of claim 1 , wherein step (c) classifies said gesture as input for an electronic device selected from a group consisting of a portable computer, a television system, an audio system, a game console, a mobile phone, a robot, and an appliance.
Claim 12
Dependent Claim
25 words
The method of claim 1 , wherein step (a) includes obtaining position information at a plurality of instances during a given said time duration interval.
Claim 13
Dependent Claim
32 words
The method of claim 11 , wherein step (c) includes using position information obtained at each instance to classify a gesture formed by movement of said body part during said time duration.
Claim 14
Dependent Claim
29 words
The method of claim 1 , wherein at step (b), detecting start of a gesture includes detecting an occurrence of a first delimiter action signifying when a gesture starts.
Claim 15
Dependent Claim
29 words
The method of claim 1 , wherein at step (b), detecting when a gesture ends includes detecting an occurrence of a second delimiter action signifying when a gesture ends.
Claim 16
Dependent Claim
35 words
The method of claim 1 , wherein at step (b), detecting at least one of start and end of a gesture includes detecting an occurrence of a delimiter action that creates a designated audible sound.
Claim 17
Dependent Claim
44 words
The method of claim 15 , wherein at least one of said first delimiter action and said second delimiter action corresponds to formation of a specific posture of one of the said body part of said person and another body part of said person.
Claim 18
Dependent Claim
21 words
The method of claim 1 , further including indicating gesture classification to said person before classifying said gesture as said input.
Claim 19
Dependent Claim
23 words
The method of claim 17 , further including receiving confirmation from said person that said input is what said person intended to enter.
Claim 20
Dependent Claim
11 words
The method of claim 18 , further including detecting said confirmation.
Claim 21
Dependent Claim
38 words
The method of claim 19 , wherein detecting said confirmation includes detecting at least one of another gesture by said person, an audible signal created by said person, and a manual entry by said person into said device.
Claim 22
Dependent Claim
37 words
The method of claim 1 , wherein at least one of step (a) and step (c) is provided as instructions on a computer-readable medium, said instructions being executable by at least one processor to perform such step.
References Cited (Backward Citations)
GB1073503A
Cited
US3610754A
Cited
US4686655A
Cited
US4312053A
Cited
US3857022A
Cited
US4187492A
Cited
US4333170A
Cited
US4294544A
Cited
US4376301A
Cited
WO1984000427A1
Cited
US4541722A
Cited
US4688933A
Cited
US4716542A
Cited
EP0233464A1
Cited
US5102223A
Cited
US4980870A
Cited
US5174759A
Cited
EP0370770A1
Cited
US4986662A
Cited
US4956824A
Cited
EP0420500A2
Cited
US5056791A
Cited
US5003166A
Cited
US5099456A
Cited
US5573077A
Cited
US5166905A
Cited
US5381235A
Cited
US5442573A
Cited
US6412813B1
Cited
US6422595B1
Cited
US6325414B2
Cited
EP0629964A1
Cited
EP0626636A2
Cited
US5454043A
Cited
US5946407A
Cited
US5835616A
Cited
US5969822A
Cited
US6281878B1
Cited
US5617371A
Cited
US5733031A
Cited
US5842194A
Cited
US6002435A
Cited
US5802208A
Cited
US5825033A
Cited
US6111517A
Cited
US5983147A
Cited
US20010043719A1
Cited
US6005958A
Cited
US6252598B1
Cited
US6188777B1
Cited
US6075605A
Cited
US6480616B1
Cited
US6137896A
Cited
US6108437A
Cited
US6195104B1
Cited
US20030048930A1
Cited
DE29802435U1
Cited
US6421042B1
Cited
EP0982676A1
Cited
US6266048B1
Cited
WO2000019705A1
Cited
WO2000021024A1
Cited
US6690357B1
Cited
US6463163B1
Cited
US6734879B2
Cited
EP1039365A2
Cited
EP1045586A2
Cited
US6791700B2
Cited
US6614422B1
Cited
US7095881B2
Cited
US6710770B2
Cited
US6961443B2
Cited
US6788809B1
Cited
US20020024676A1
Cited
WO2002021502A1
Cited
US6801662B1
Cited
US6650318B1
Cited
US20020140949A1
Cited
US6564144B1
Cited
US7003136B1
Cited
US20040153229A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2011-03-04 | 2011-09-03 | 2012-03-04 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2015-03-04 | 2015-09-03 | 2016-03-04 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2019-03-04 | 2019-09-03 | 2020-03-04 | $7700.00 | Window Closed / Lapsed |