Patent US7999857B2 successfully refreshed from Google Patents.
← Back to Patent Explorer
US7999857B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Voice, lip-reading, face and emotion stress analysis, fuzzy logic intelligent camera system

Assignee: Stresscam Operations and Systems Ltd
•
Filing: 2003-07-25
•
Granted: 2011-08-16
•
Expires: 2023-07-25
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract Revealed is an intelligent camera security monitoring, fuzzy logic analyses and information reporting system that includes video/audio camera, integrated local controller, interfaced plurality of sensors, and input/output means, that collects and analyses data and information observations from a viewed scene and communicates these to a central controller. The central controller with fuzzy logic processor receives, stores these observations, conducts a plurality of computer analyses techniques and technologies including face, voice, lip reading, emotion, movement, pattern recognition and stress analysis to determine responses and potential threat of/by a person, crowd, animal, action, activity or thing. This invention recognizes possible terrorists, criminals, enraged or dangerous persons and also can identify a person's level of intoxication or impairment by alcohol or drugs via a new “Visual Response Measure”. The invention provides an intelligent tool to assist security systems and personnel, improving capability to record, display and share information and maintain security.

Inventors

  • 👤 Frank E. Bunn
  • 👤 Richard D. Adair
  • 👤 Robert N. Peterson
  • 👤 David D. Adair

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 11:24
CPC Classifications
G; G10; G10L; G10L15/00; G10L15/24; G10L15/25; G10L17/00; G10L17/26; H; H04; H04N; H04N7/00; H04N7/18; H04N7/181

Claims Analysis

Total Claims: 22
Claim 1
Independent Claim 242 words
A security camera means observational system comprising: a) a local controller, hardware, software, firmware and fuzzy logic including wireless or wired communications interface for communicating with a central controller facility; b) a camera audio and video recording device connected to said local controller for observing and recording and communicating to said central controller; c) a central controller with hardware, software, firmware and fuzzy logic for database storage and analyses of images and sounds from observed actions, appearances, activities, speech and movements of objects, animals, persons and surroundings within view and listening of the said camera device as communicated from said camera devices; d) a central controller with hardware, software, firmware and fuzzy logic for accessing both real-time data and historic data from related databases from sources of governments, of multimedia news agencies, of associated data for the purpose of conducting analyses for assessment and detection of threat or potential threat; e) an input device connected to said local controller for reading from or writing to magnetic or electronic storage data means and/or a manually entering data means for input to said local controller; f) an output device associated with said local controller for displaying visually or audibly or in printed means for presenting a selection of information and threat analysis results received from said central facility controller; g) a camera movement device and interface to the local controller for three axis pointing, focusing/zooming and turn on/off control of the said camera device.
Claim 2
Dependent Claim 242 words
A security camera means observational system comprising: a) a local controller, hardware, software, firmware and fuzzy logic including wireless or wired communications interface for communicating with a central controller facility; b) a camera audio and video recording device connected to said local controller for observing and recording and communicating to said central controller; c) a central controller with hardware, software, firmware and fuzzy logic for database storage and analyses of images and sounds from observed actions, appearances, activities, speech and movements of objects, animals, persons and surroundings within view and listening of the said camera device as communicated from said camera devices; d) a central controller with hardware, software, firmware and fuzzy logic for accessing both real-time data and historic data from related databases from sources of governments, of multimedia news agencies, of associated data for the purpose of conducting analyses for assessment and detection of threat or potential threat; e) an input device connected to said local controller for reading from or writing to magnetic or electronic storage data means and/or a manually entering data means for input to said local controller; f) an output device associated with said local controller for displaying visually or audibly or in printed means for presenting a selection of information and threat analysis results received from said central facility controller; g) a camera movement device and interface to the local controller for three axis pointing, focusing/zooming and turn on/off control of the said camera device.
Claim 3
Dependent Claim 55 words
The security camera means as defined in claim 1 , said input device including a “closed circuit” security camera and microphones, with magnetic tape recording and computer database data storage means, and a plurality of sensors, coupled to the local controller for providing information on a plurality of parameters related to the local area observed.
Claim 4
Dependent Claim 45 words
The security camera means as defined in claim 2 , said sensors including a plurality of motion, heat, sound, vibration and air quality sensors for detection of people, animals, things or actions that are not of the regular normal occurrence or could pose a threat.
Claim 5
Dependent Claim 62 words
The security camera means as defined in claim 3 , said actions are such as not to normally occur and thus are unusual and in the security sense, warrant examination more closely, and said threat is a thing, person, animal, action, sound, speech or perpetrated act that could be interpreted as a danger to a place, person, thing, entity, government or country.
Claim 6
Dependent Claim 39 words
The security camera means as defined in claim 2 , said local controller including an input keyboard, key pad, touch screen manual device, a magnetic card or smart card reader/writer, a display, a voice I/O interface, and interface means.
Claim 7
Dependent Claim 61 words
The security camera means as defined in claim 2 , said local controller including an output device being a computer video screen and speaker and indicator lights and printing means, magnetic or smart card recorder means, for providing or indicating information regarding validity or acceptance of a request for entrance or access or purchase based on analyses by said central controller.
Claim 8
Dependent Claim 44 words
The security camera means as defined in claim 1 , said central controller monitoring and storing in databases the information communicated by the local controller, the data from the local camera and sensor means and analyzing this information and comparative information from related databases.
Claim 9
Dependent Claim 87 words
The security camera means as defined in claim 1 , said central controller analyses includes a plurality of analyses logic including the use of fuzzy logic and comparisons accessing related databases of stored previous visual data such as faces of persons, and/or audio data such as speech, voice to text conversion, and/or text data such as key words or phrases from which the system using fuzzy logic matches those aspects of the current observations for the purpose of assessing the existence of a threat or potential threat.
Claim 10
Dependent Claim 88 words
The security camera means as defined in claim 1 , said central controller analyses includes a plurality of analyses logic including the use of fuzzy logic and comparisons accessing “live” real-time related database sources of visual data such as faces of persons, and/or audio data such as speech, voice to text conversion, and/or text data such as key words or phrases from which the system using fuzzy logic matches those aspects of the current observations for the purpose of assessing the existence of a threat or potential threat.
Claim 11
Dependent Claim 123 words
A system as defined in claim 1 , said central controller analyses includes a plurality of analyses methods including voice stress, emotion stress, actions and movement interpretation, image matching, speech/voice to text conversions, lip reading to text conversion, deep extraction of information from text, facial identity matching, voice identity matching and personal data matching and comparisons accessing live real-time related database sources of visual data such as faces of persons, and/or audio data such as speech, and/or text data such as key words or phrases from which the system using fuzzy logic matches those aspects of the current observations for the purpose of identifying people, animals, things, actions, speech, and stress that indicate the existence of a threat or potential of a threat.
Claim 12
Dependent Claim 38 words
The security camera means as defined in claim 1 , said central controller can communicate to the local controller of said camera means commands for said pointing focusing/zooming, viewing direction, viewing zoom magnification and turning on/off camera controls.
Claim 13
Dependent Claim 49 words
The security camera means as defined in claim 1 , said local controller incorporates part or all of said central controller functions and capabilities such that the said camera means could be a stand alone complete Camera System means utilizing microelectronic designs, circuitry miniaturization and solid state memory systems.
Claim 14
Dependent Claim 63 words
The security camera means as defined in claim 1 , said local controller utilizing fuzzy logic and microelectronic designs, circuitry miniaturization and solid state memory systems, incorporates part or much of the said central controller functions and capabilities such that the said camera means becomes more independent from the central controller and capable of conducting much of the analyses and response function directly.
Claim 15
Dependent Claim 98 words
The security camera means as defined in claim 1 , said input device including a camera and/or a “closed circuit” security camera which said camera can observe and record said observation in a spectral range including but not limited to the visible, the near infrared, the infrared, the far thermal or heat range infrared, and the ultraviolet regions of the electromagnetic spectrum, and microphones, with magnetic tape recording and computer database data storage means, and a plurality of sensors, coupled to the local controller for providing information on a plurality of parameters related to the local area observed.
Claim 16
Dependent Claim 242 words
A security camera means observational system comprising: a. a local controller, hardware, software, firmware and fuzzy logic including wireless or wired communications interface for communicating with a central controller facility; b. a camera audio and video recording device connected to said local controller for observing and recording and communicating to said central controller; c. a central controller with hardware, software, firmware and fuzzy logic for database storage and analyses of images and sounds from observed actions, appearances, activities, speech and movements of objects, animals, persons and surroundings within view and listening of the said camera device as communicated from said camera devices; d. a central controller with hardware, software, firmware and fuzzy logic for accessing both real-time data and historic data from related databases from sources of governments, of multimedia news agencies, of associated data for the purpose of conducting analyses for assessment and detection of threat or potential threat; e. an input device connected to said local controller for reading from or writing to magnetic or electronic storage data means and/or a manually entering data means for input to said local controller; f. an output device associated with said local controller for displaying visually or audibly or in printed means for presenting a selection of information and threat analysis results received from said central facility controller; g. a camera movement device and interface to the local controller for three axis pointing, focusing/zooming and turn on/off control of the said camera device.
Claim 17
Dependent Claim 242 words
A security camera means observational system comprising: a. a local controller, hardware, software, firmware and fuzzy logic including wireless or wired communications interface for communicating with a central controller facility; b. a camera audio and video recording device connected to said local controller for observing and recording and communicating to said central controller; c. a central controller with hardware, software, firmware and fuzzy logic for database storage and analyses of images and sounds from observed actions, appearances, activities, speech and movements of objects, animals, persons and surroundings within view and listening of the said camera device as communicated from said camera devices; d. a central controller with hardware, software, firmware and fuzzy logic for accessing both real-time data and historic data from related databases from sources of governments, of multimedia news agencies, of associated data for the purpose of conducting analyses for assessment and detection of threat or potential threat; e. an input device connected to said local controller for reading from or writing to magnetic or electronic storage data means and/or a manually entering data means for input to said local controller; f. an output device associated with said local controller for displaying visually or audibly or in printed means for presenting a selection of information and threat analysis results received from said central facility controller; g. a camera movement device and interface to the local controller for three axis pointing, focusing/zooming and turn on/off control of the said camera device.
Claim 18
Dependent Claim 99 words
The security camera means as defined in claim 15 , said central controller analyses includes a plurality of analyses logic including the use of fuzzy logic and comparisons accessing related databases of stored previous visual data such as faces of persons, and/or audio data such as speech, voice to text conversion, and/or text data such as key words or phrases from which the system using fuzzy logic matches those aspects of the current observations for the purpose of assessing the level of sobriety due to drug or alcohol use and the existence of a resulting threat or potential threat.
Claim 19
Dependent Claim 139 words
The security camera means as defined in claim 15 , said central controller analyses includes a plurality of analyses methods including voice stress, emotion stress, actions and movement interpretation, image matching, speech/voice to text conversions, lip reading to text conversion, deep extraction of information from text, facial identity matching, voice identity matching and personal data matching and comparisons accessing stored related database sources of stored previously of visual data such as faces of persons, and/or audio data such as speech, and/or text data such as key words or phrases from which the system using fuzzy logic matches those aspects of the current observations for the purpose of identifying people, animals, things, actions, speech, and stress that indicate the level of sobriety due to drug or alcohol use and the existence of a resulting threat or potential of a threat.
Claim 20
Dependent Claim 47 words
The security camera means as defined in claim 15 , for the detection and analyzes of alcohol or drug intoxication or impairment of a person or persons for the detection of person or persons as a potential threat to the public and/or to property and/or to themselves.
Claim 21
Dependent Claim 77 words
The security camera means as defined in claim 18 , said analyzes determining a level of intoxication or impairment so as to assign a numerical value to said level, as an indication within a standard set of said levels as to the said intoxication or impairment of the person or persons similar to the application of breathalyzer standards used to describe the level of alcohol intoxication as determined by chemical measure of the breath of a person.
Claim 22
Dependent Claim 32 words
The security camera means as defined in claim 15 for the detection of health related problems such as heart attack, diabetic or epileptic seizure, drug use or abuse, drunkenness and the like.

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2014-08-15 2015-02-14 2015-08-16 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2018-08-15 2019-02-14 2019-08-16 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2022-08-15 2023-02-14 2023-08-16 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag