US7295904B2
Expired / Lapsed
US
⏱️ 0.0 years remaining
Touch gesture based interface for motor vehicle
Assignee: Google LLC
•
Filing: 2004-08-31
•
Granted: 2007-11-13
•
Expires: 2024-08-31
Abstract
Abstract An improved apparatus and method is provided for operating devices and systems in a motor vehicle, while at the same time reducing vehicle operator distractions. One or more touch sensitive pads are mounted on the steering wheel of the motor vehicle, and the vehicle operator touches the pads in a pre-specified synchronized pattern, to perform functions such as controlling operation of the radio or adjusting a window. At least some of the touch patterns used to generate different commands may be selected by the vehicle operator. Usefully, the system of touch pad sensors and the signals generated thereby are integrated with speech recognition and/or facial gesture recognition systems, so that commands may be generated by synchronized multi-mode inputs.
Inventors
- 👤 Dimitri Kanevsky
- 👤 Roberto Sicconi
- 👤 Mahesh Viswanathan
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-25 14:55
CPC Classifications
G; G06; G06F; G06F3/00; G06F3/01; G06F3/016; B; B60; B60K; B60K35/00; B60K35/10; B60K35/20; B60K35/21; B60K35/22; B60K35/23; B60K35/26; B60K35/28; B60K35/50; B60K35/60; B60K35/80; B60K35/90; G06F3/03; G06F3/033; G06F3/038; G06F3/048; G06F3/0487; G06F3/0488; G06F3/04883; B60K2360/00; B60K2360/143; B60K2360/1438; B60K2360/20; B60K2360/21; G06F2203/00; G06F2203/048; G06F2203/04809
Claims Analysis
Total Claims: 37
Claim 1
Independent Claim
150 words
Apparatus for selectively controlling one or more systems included with a motor vehicle driven by a vehicle operator, said apparatus comprising: one or more touch pad devices respectively mounted to receive a specified touch gesture pattern from said operator while said vehicle is being driven, said touch pad devices responsive to said received touch gesture pattern to generate a corresponding pattern of touch pad signals; an interpretation module adapted to recognize that said corresponding pattern of touch pad signals is associated with a pre-specified command for selectively operating a particular one of said systems; an execution module disposed to receive said pre-specified command from said interpretation module, and to operate said particular system in accordance with said pre-specified command; and means for detecting occurrences of an extreme situation and for causing said execution module to disregard any commands until said apparatus is positively informed that said extreme situation has ended.
Claim 2
Dependent Claim
150 words
Apparatus for selectively controlling one or more systems included with a motor vehicle driven by a vehicle operator, said apparatus comprising: one or more touch pad devices respectively mounted to receive a specified touch gesture pattern from said operator while said vehicle is being driven, said touch pad devices responsive to said received touch gesture pattern to generate a corresponding pattern of touch pad signals; an interpretation module adapted to recognize that said corresponding pattern of touch pad signals is associated with a pre-specified command for selectively operating a particular one of said systems; an execution module disposed to receive said pre-specified command from said interpretation module, and to operate said particular system in accordance with said pre-specified command; and means for detecting occurrences of an extreme situation and for causing said execution module to disregard any commands until said apparatus is positively informed that said extreme situation has ended.
Claim 3
Dependent Claim
47 words
The apparatus of claim 1 , wherein: said extreme situation is indicated by the occurrence of one of a number of pre-specified actions of said operator, wherein said pre-specified actions include, at least, rapidly applying the brakes and rapidly turning the steering wheel of said vehicle, selectively.
Claim 4
Dependent Claim
74 words
The apparatus of claim 1 , wherein: at least one device having a mode of operation different from the mode of operation of said touch pad devices is provided for use by said operator to generate one or more multi-mode signals; and said interpretation module is disposed to route said pre-specified command to said execution module upon receiving both said corresponding pattern of touch pad signals, and a specified one of said multi-mode signals.
Claim 5
Dependent Claim
35 words
The apparatus of claim 3 , wherein: said apparatus includes a speech recognition device disposed to encode a spoken instruction of said operator in a signal, in order to provide one of said multi-mode signals.
Claim 6
Dependent Claim
43 words
The apparatus of claim 4 , wherein: said apparatus further includes a facial gesture recognition device disposed to analyze a viewed facial gesture of said operator, and to encode the analyzed facial gesture in a signal to provide another of said multi-mode signals.
Claim 7
Dependent Claim
32 words
The apparatus of claim 5 , wherein: said speech and facial gesture recognition devices respectively provide confidence correlation scores of low, mid range or high value for each of said multi-mode signals.
Claim 8
Dependent Claim
56 words
The apparatus of claim 6 , wherein: said interpretation module stops further action to execute a command associated with a multi-mode signal of low correlation score, arranges for execution of a command associated with a multi-mode signal of high correlation score, and requests the operator to confirm a command associated with a mid range correlation score.
Claim 9
Dependent Claim
37 words
The apparatus of claim 1 , wherein: at least two of said touch pad devices are mounted on the steering wheel of said vehicle to collectively receive a pre-specified pattern of synchronized touch gestures from said operator.
Claim 10
Dependent Claim
17 words
The apparatus of claim 8 , wherein: each touch pad is provided with a touch sensitive surface.
Claim 11
Dependent Claim
30 words
The apparatus of claim 9 wherein: said pattern of synchronized touch gestures is produced by touching each of said touch pads in a specified sequence during a specified time window.
Claim 12
Dependent Claim
39 words
The apparatus of claim 9 , wherein: said touch gesture pattern is produced at least in part by moving a selected object along a specified path in contact with the touch sensitive surface of one of said touch pads.
Claim 13
Dependent Claim
24 words
The apparatus of claim 9 , wherein: tactile reference indicia are placed at pre-specified locations on at least one of said touch sensitive surfaces.
Claim 14
Dependent Claim
41 words
The apparatus of claim 9 , wherein: said touch gesture pattern is produced at least in part by enabling said operator to simultaneously apply pressure at two spatially separated locations on one of said touch sensitive surfaces, using two different fingers.
Claim 15
Dependent Claim
33 words
The apparatus of claim 9 , wherein: each of said touch pads is mounted to receive touch gestures from a thumb of said operator while said operator continues to hold said steering wheel.
Claim 16
Dependent Claim
34 words
The apparatus of claim 1 , wherein: said apparatus includes a feedback device coupled to said interpretation module for requesting that said operator confirm an intent to generate and execute one of said commands.
Claim 17
Dependent Claim
18 words
The apparatus of claim 15 , wherein: said feedback device is disposed to electronically generate a vocal statement.
Claim 18
Dependent Claim
22 words
The apparatus in claim 1 , wherein: said apparatus includes means for acknowledging that it has received said specified touch gesture pattern.
Claim 19
Dependent Claim
32 words
The apparatus of claim 17 , wherein: said acknowledging means comprises an electronic device for producing a vocal statement indicating that said specified touch gesture pattern has been received by said apparatus.
Claim 20
Dependent Claim
38 words
The apparatus of claim 17 , wherein: said acknowledging means comprises one or more vibrators mounted on said steering wheel, and further includes means for actuating said vibrators in response to receipt of said specified touch gesture pattern.
Claim 21
Dependent Claim
25 words
The apparatus of claim 19 , wherein: one of said vibrators is placed adjacent to each of said touch pad devices on said steering wheel.
Claim 22
Dependent Claim
24 words
The apparatus of claim 20 , wherein: one of said vibrators is placed underneath each of said touch pad devices on said steering wheel.
Claim 23
Dependent Claim
34 words
The apparatus of claim 17 , wherein: said acknowledging means comprises a visual indicator, and further includes means for actuating said visual indicator in response to said receipt of said specified touch gesture pattern.
Claim 24
Dependent Claim
28 words
The apparatus of claim 22 , wherein: said visual indicator comprises a light disposed to flash in a specified pattern in response to said specified touch gesture pattern.
Claim 25
Dependent Claim
32 words
The apparatus of claim 1 , wherein: a comparator is provided to compare a command received from said interpretation module with the current status of a vehicle system associated with said command.
Claim 26
Dependent Claim
37 words
The apparatus of claim 1 , wherein: a training module is connected to said interpretation module for use by said operator to enter operator selected touch gesture patterns, and commands respectively associated therewith, into said interpretation module.
Claim 27
Dependent Claim
36 words
The apparatus of claim 1 , wherein: said apparatus includes means for determining whether or not a set of received touch gestures has been provided by a person who is allowed to operate said motor vehicle.
Claim 28
Independent Claim
113 words
A method for selectively controlling one or more systems included with a motor vehicle driven by a vehicle operator comprising the steps of: applying a touch gesture pattern to one or more touch pad devices, while said vehicle is being driven, to generate a corresponding pattern of touch pad signals; analyzing said corresponding pattern of touch pad signals to identify an associated pre-specified command for selectively operating a particular one of said systems; generating a signal to operate said particular system in accordance with said associated pre-specified command; and detecting occurrences of an extreme situation, and in response thereto causing said particular system to disregard any commands until said extreme situation has ended.
Claim 29
Independent Claim
113 words
A method for selectively controlling one or more systems included with a motor vehicle driven by a vehicle operator comprising the steps of: applying a touch gesture pattern to one or more touch pad devices, while said vehicle is being driven, to generate a corresponding pattern of touch pad signals; analyzing said corresponding pattern of touch pad signals to identify an associated pre-specified command for selectively operating a particular one of said systems; generating a signal to operate said particular system in accordance with said associated pre-specified command; and detecting occurrences of an extreme situation, and in response thereto causing said particular system to disregard any commands until said extreme situation has ended.
Claim 30
Dependent Claim
60 words
The method of claim 27 , further including: operating at least one device having a mode of operation different from the mode of operation of said touch pad devices to generate one or more multi-mode signals; and executing said pre-specified command in response to both said corresponding pattern of touch pad signals, and a specified one of said multi-mode signals.
Claim 31
Dependent Claim
30 words
The method of claim 27 , wherein: said touch gesture pattern is applied to at least two of said touch pad devices mounted on the steering wheel of said vehicle.
Claim 32
Dependent Claim
28 words
The method of claim 27 , wherein: a feedback device is operated to request that said operator confirm an intent to generate and execute one of said commands.
Claim 33
Dependent Claim
119 words
Apparatus for selectively controlling one or more systems included with a motor vehicle having a steering wheel and driven by a vehicle operator, said apparatus comprising: at least two touch pad devices respectively mounted on the steering wheel of said vehicle, wherein each touch pad receives at least one touch gesture from said operator to generate a specified pattern comprising multiple touch pad signals; an interpretation module adapted to recognize that said specified pattern of touch pad signals is associated with a pre-specified command for selectively operating a particular one of said systems; and an execution module disposed to receive said pre-specified command from said interpretation module, and to operate said particular system in accordance with said pre-specified command.
Claim 34
Dependent Claim
119 words
Apparatus for selectively controlling one or more systems included with a motor vehicle having a steering wheel and driven by a vehicle operator, said apparatus comprising: at least two touch pad devices respectively mounted on the steering wheel of said vehicle, wherein each touch pad receives at least one touch gesture from said operator to generate a specified pattern comprising multiple touch pad signals; an interpretation module adapted to recognize that said specified pattern of touch pad signals is associated with a pre-specified command for selectively operating a particular one of said systems; and an execution module disposed to receive said pre-specified command from said interpretation module, and to operate said particular system in accordance with said pre-specified command.
Claim 35
Dependent Claim
37 words
The apparatus of claim 31 , wherein: a training module is connected to said interpretation module for use by said operator to enter operator selected touch gesture patterns, and commands respectively associated therewith, into said interpretation module.
Claim 36
Dependent Claim
74 words
The apparatus of claim 31 , wherein: at least one device having a mode of operation different from the mode of operation of said touch pad devices is provided for use by said operator to generate one or more multi-mode signals; and said interpretation module is disposed to route said pre-specified command to said execution module upon receiving both said specified pattern of touch pad signals, and a specified one of said multi-mode signals.
Claim 37
Dependent Claim
40 words
The apparatus of claim 31 , wherein: said apparatus includes means for detecting occurrences of an extreme situation and for causing said execution module to disregard any command until said apparatus is positively informed that said extreme situation has ended.
References Cited (Backward Citations)
US5809267A
Cited
US6111580A
Cited
EP0813989A1
Cited
WO1999057648A1
Cited
US7158871B1
Cited
GB2355055A
Cited
WO2001045080A1
Cited
WO2001060650A1
Cited
US6703999B1
Cited
US20020135618A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2010-11-12 | 2011-05-14 | 2011-11-13 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2014-11-12 | 2015-05-14 | 2015-11-13 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2018-11-12 | 2019-05-14 | 2019-11-13 | $7700.00 | Window Closed / Lapsed |