Method for personal computer-based home surveillance

Claim 2

In a personal computer-based home security system implemented as a software program that runs on commercially available personal computers that include a modem, a microphone, and a video camera, a method for monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the method comprising: sampling data collected by the microphone and video camera to detect threshold events that represent a change in the environment; detecting threshold events that represent a change in the environment; conducting a close surveillance following the detection of a threshold event by more frequently sampling data collected by the microphone and video camera in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; using data patterns that define and categorize types of events; during close surveillance, monitoring and recording audio data input from the microphone and video data input from the video camera, detecting differences in the input data from expected background, comparing the detected differences with input patterns to determine the type of event that produced the differences, and computing a metric that describes a suspicion level corresponding to the detected events; and when the close surveillance component has detected sufficient events, initiating an appropriate remedial action.

Claim 3

The method of claim 1 wherein monitoring threshold events further comprises comparing audio data input from the microphone and video data input from the video camera to expected background audio and video data for the environment and detecting as a threshold event a discrepancy between the input data and expected background data greater than a threshold value.

Claim 4

The method of claim 2 wherein an increase in the amplitude of input audio data above the amplitude of the expected background audio data over a short time interval is a discrepancy between the input data and expected background data.

Claim 5

The method of claim 2 wherein detection of movement within in the input video data is a discrepancy between the input data and expected background data.

Claim 6

The method of claim 2 wherein an increase in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

Claim 7

The method of claim 2 wherein a decrease in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

Claim 8

The method of claim 2 wherein a decrease in the contrast of input video data above the contrast of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

Claim 9

The method of claim 2 wherein the input audio data and input video data are correlated with the time of day of input and compared to audio data and video data expected for that time of day.

Claim 10

The method of claim 2 wherein the input audio data and input video data are correlated with the time of day and the day of the week of input and compared to audio data and video data expected for that time of day and day of the week.

Claim 11

The method of claim 2 wherein the personal computer-based home security system is first trained by exposing it to the environment so that the personal computer-based home security system can detect and store a representation of the expected background input for the environment.

Claim 12

The method of claim 1 where the computed metric that describes a suspicion level is a sum of the number of different events detected by the close surveillance component.

Claim 13

The method of claim 1 including the use of an event collection that contains information for each type of event that indicates how to compute a severity metric for that event, the information used to compute a severity metric in the indicated manner for each detected event.

Claim 14

The method of claim 1 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected during close surveillance.

Claim 15

The method of claim 1 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected during close surveillance along with a sum of correlations between pairs of events.

Claim 16

The method of claim 1 wherein during close surveillance, indications of detected events are stored into detected event collections.

Claim 17

The method of claim 1, further including the use of a diagnosis collection that contains indications of different types of diagnoses correlated with different event and event sequences.

Claim 18

The method of claim 16 wherein event sequences are lists of events ordered by time of occurrence.

Claim 19

The method of claim 16, further including the use of a remedy collection that contains indications of remedial actions that should be initiated following determination of a particular diagnosis of events that have occurred in the environment and that have been detected during close surveillance.

Claim 20

The method of claim 18 wherein initiating appropriate remedial action further includes comparing the events that have been detected during close surveillance to the different event and event sequences stored in the diagnosis collection in order to match the detected events with a most likely diagnosis, selecting actions from the remedy collection consistent with the most likely diagnosis, and initiating the selected actions.

Claim 21

The method of claim 1 wherein a remedial action directs the personal computer-based home security system to call a specific telephone number via the modem and send a specific message through the modem to a receiving party, the remedy collection storing an indication of the type of receiving party to expect for each telephone number, including a human, a fax machine, and another modem.

Claim 22

In a personal computer-based home security system implemented as a software program that runs on commercially available personal computers that include a modem and a microphone, a method for monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the method comprising: sampling data collected by the microphone to detect threshold events that represent a change in the environment; detecting threshold events that represent a change in the environment; conducting a close surveillance following the detection of a threshold event by more frequently sampling data collected by the microphone in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; using data patterns that define and categorize types of events; during close surveillance, monitoring and recording audio data input from the microphone, detecting differences in the input data from expected background, comparing the detected differences with input patterns to determine the type of event that produced the differences, and computing a metric that describes a suspicion level corresponding to the detected events, the computed metric being a sum of the number of different events detected by the close surveillance component; and when the close surveillance component has detected sufficient events, initiating an appropriate remedial action.

Claim 23

In a personal computer-based home security system implemented as a software program that runs on commercially available personal computers that include a modem and a microphone, a method for monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the method comprising: sampling data collected by the microphone to detect threshold events that represent a change in the environment; detecting threshold events that represent a change in the environment; conducting a close surveillance following the detection of a threshold event by more frequently sampling data collected by the microphone in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; using data patterns that define and categorize types of events; during close surveillance, monitoring and recording audio data input from the microphone, detecting differences in the input data from expected background, comparing the detected differences with input patterns to determine the type of event that produced the differences, and computing a metric that describes a suspicion level corresponding to the detected events, the computed metric being a sum of the number of different events detected by the close surveillance component; and when the close surveillance component has detected sufficient events, initiating an appropriate remedial action.

Claim 24

The method of claim 21 wherein the monitoring threshold events comprises comparing audio data input from the microphone to expected background audio data for the environment and detecting as a threshold event a discrepancy between the input audio data and expected background audio data greater than a threshold value.

Claim 25

The method of claim 21 wherein an increase in the amplitude of input audio data above the amplitude of the expected background audio data over a short time interval is a discrepancy between the input data and expected background data.

Claim 26

The method of claim 21 wherein the input audio data is correlated with the time of day of input and compared to audio data expected for that time of day.

Claim 27

The method of claim 21 wherein the input audio data is correlated with the time of day and the day of the week of input and compared to audio data expected for that time of day and day of the week.

Claim 28

The method of claim 21 wherein the personal computer-based home security system is first trained by exposing it to the environment so that the personal computer-based home security system can detect and store a representation of the expected background input for the environment.

Claim 29

The method of claim 21 including the use of an event collection that contains information for each type of event that indicates how to compute a severity metric for that event, the information used to compute a severity metric in the indicated manner for each detected event.

Claim 30

The method of claim 21 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component.

Claim 31

The method of claim 21 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected during close surveillance along with a sum of correlations between pairs of events.

Claim 32

The method of claim 21 wherein the close surveillance component stores indications of detected events into a detected event collection.

Claim 33

The method of claim 21, further including the use of a diagnosis collection that contains indications of different types of diagnoses correlated with different event and event sequences.

Claim 34

The method of claim 31 wherein event sequences are lists of events ordered by time of occurrence.

Claim 35

The method of claim 31, further including the use of a remedy collection that contains indications of remedial actions that should be initiated following determination of a particular diagnosis of events that have occurred in the environment and that have been detected during close surveillance.

Claim 36

The method of claim 33 wherein initiating appropriate remedial action further includes comparing the events that have been detected during close surveillance to the different event and event sequences stored in the diagnosis collection in order to match the detected events with a most likely diagnosis, selecting actions from the remedy collection consistent with the most likely diagnosis, and initiating the selected actions.

Claim 37

The method of claim 21 wherein a remedial action directs the personal computer-based home security system to call a specific telephone number via the modem and send a specific message through the modem to a receiving party, the remedy collection storing an indication of the type of receiving party to expect for each telephone number, including a human, a fax machine, and another modem.

Claim 38

In a personal computer-based home security system implemented as a software program that runs on commercially available personal computers that include a modem and a video camera, a method for monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the method comprising: sampling data collected by the video camera to detect threshold events that represent a change in the environment; detecting threshold events that represent a change in the environment; conducting a close surveillance following the detection of a threshold event by more frequently sampling data collected by the video camera in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; using data patterns that define and categorize types of events; during close surveillance, monitoring and recording video data input from the video camera, detecting differences in the input data from expected background, comparing the detected differences with input patterns to determine the type of event that produced the differences, and computing a metric that describes a suspicion level corresponding to the detected events; and when the close surveillance component has detected sufficient events, initiating an appropriate remedial action.

Claim 39

In a personal computer-based home security system implemented as a software program that runs on commercially available personal computers that include a modem and a video camera, a method for monitoring an environment to detect and remedy unusual circumstances that occur in the environment, the method comprising: sampling data collected by the video camera to detect threshold events that represent a change in the environment; detecting threshold events that represent a change in the environment; conducting a close surveillance following the detection of a threshold event by more frequently sampling data collected by the video camera in order to detect, characterize, and record events that represent differences between the sampled data and data normally collected from the environment; using data patterns that define and categorize types of events; during close surveillance, monitoring and recording video data input from the video camera, detecting differences in the input data from expected background, comparing the detected differences with input patterns to determine the type of event that produced the differences, and computing a metric that describes a suspicion level corresponding to the detected events; and when the close surveillance component has detected sufficient events, initiating an appropriate remedial action.

Claim 40

The method of claim 36 wherein monitoring threshold events further comprises comparing video data input from the video camera to expected background video data for the environment and detecting as a threshold event a discrepancy between the input video data and expected background video data greater than a threshold value.

Claim 41

The method of claim 36 wherein detection of movement within in the input video data is a discrepancy between the input data and expected background data.

Claim 42

The method of claim 37 wherein an increase in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

Claim 43

The method of claim 37 wherein a decrease in the brightness of input video data above the brightness of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

Claim 44

The method of claim 37 wherein a decrease in the contrast of input video data above the contrast of the expected background video data over a short time interval is a discrepancy between the input data and expected background data.

Claim 45

The method of claim 37 wherein the input video data is correlated with the time of day of input and compared to video data expected for that time of day.

Claim 46

The method of claim 37 wherein the input video data is correlated with the time of day and the day of the week of input and compared to video data expected for that time of day and day of the week.

Claim 47

The method of claim 36 where the computed metric that describes a suspicion level is a sum of the number of different events detected by the close surveillance component.

Claim 48

The method of claim 36 including the use of an event collection that contains information for each type of event that indicates how to compute a severity metric for that event, the information used to compute a severity metric in the indicated manner for each detected event.

Claim 49

The method of claim 36 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected by the close surveillance component.

Claim 50

The method of claim 36 where the computed metric that describes a suspicion level is a sum of the of the severity metrics computed for the different events detected during close surveillance along with a sum of correlations between pairs of events.

Claim 51

The method of claim 36 wherein during close surveillance, indications of detected events are stored into detected event collections.

Claim 52

The method of claim 48, further including the use of a diagnosis collection that contains indications of different types of diagnoses correlated with different event and event sequences.

Claim 53

The method of claim 49 wherein event sequences are lists of events ordered by time of occurrence.

Claim 54

The method of claim 49, further including the use of a remedy collection that contains indications of remedial actions that should be initiated following determination of a particular diagnosis of events that have occurred in the environment and that have been detected during close surveillance.

Claim 55

The method of claim 51 wherein initiating appropriate remedial action further includes comparing the events that have been detected during close surveillance to the different event and event sequences stored in the diagnosis collection in order to match the detected events with a most likely diagnosis, selecting actions from the remedy collection consistent with the most likely diagnosis, and initiating the selected actions.

Claim 56

The method of claim 36 wherein a remedial action directs the personal computer-based home security system to call a specific telephone number via the modem and send a specific message through the modem to a receiving party, the remedy collection storing an indication of the type of receiving party to expect for each telephone number, including a human, a fax machine, and another modem.

Claim 57

The method of claim 37 wherein the personal computer-based home security system is first trained by exposing it to the environment so that the personal computer-based home security system can detect and store a representation of the expected background input for the environment.