Patent US4768088A successfully refreshed from Google Patents.
← Back to Patent Explorer
US4768088A Expired / Lapsed US ⏱️ 0.0 years remaining

Apparatus for commanding energization of electrical device

Assignee: Aisin Corp
•
Filing: 1986-12-02
•
Granted: 1988-08-30
•
Expires: 2006-12-02
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract An apparatus controls an on/off condition of an electrical device or devices mounted on an automobile, such as a car radio set, an air conditioner, a cigar lighter or the like. The face of a driver who is mounted on the vehicle is photographed by a television camera, which produces a video signal that is subject to a digital processing operation for storage in a frame memory. A video signal processing system essentially comprising CPU, RAM and ROM is operative, based upon the video data stored in the frame memory, to detect the pupil and mouth of the driver as well as their locations and configurations. A change in the location of the pupil as well as a change in the configuration of the pupil and the mouth is detected as a time sequence, and an on/off command signal is supplied to an electrical device in accordance with such changes.

Inventors

  • 👤 Mitsuhiro Ando

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-03 12:01
CPC Classifications
G; G05; G05B; G05B19/00; G05B19/02; G05B19/04; G05B19/10; G05B19/106; G06; G06V; G06V10/00; G06V10/40; G06V10/44; G06V40/00; G06V40/10; G06V40/16; G06V40/168

Claims Analysis

Total Claims: 18
Claim 1
Independent Claim 541 words
An apparatus for commanding an energization of an electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, illumination control means for adjusting the brightness achieved by the illumination means, whrein the memory means includes halftone video signal memory means which stores halftone data and bi-level data, and wherein the video signal processing means writes halftone data which is obtained by an A/D conversion of the video signal into the halftone video signal memory means, determines the brightness of an object based on the halftone data which is written into and to provide a command to increase or decrease the brightness level to the illumination control means when the brightness level is low or high, respectively, thus establishing the brightness level of an illumination lamp, writes the halftone data which is obtained by an A/D conversion of the video signal which is obtained at the established brightness level into the halftone video signal memory means and then reads the halftone data written into the memory means therefrom and convert it into bi-level data which is then written into the bi-level video signal signal memory means during the step (a), the video signal processing means reading the bi-level data from the bi-level video signal memory means during the step (b), the video signal processing means writing halftine data which is obtained by an A/D conversion of fresh video data into the halftone video signal memory means, reads the halftone data from the memory means and converts is into bi-level data which is then written into the bi-level video signal memory means during the step (e), the video signal processing means reading the bi-level data from the bi-level video signal memory means during the step (f).
Claim 2
Independent Claim 541 words
An apparatus for commanding an energization of an electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, illumination control means for adjusting the brightness achieved by the illumination means, whrein the memory means includes halftone video signal memory means which stores halftone data and bi-level data, and wherein the video signal processing means writes halftone data which is obtained by an A/D conversion of the video signal into the halftone video signal memory means, determines the brightness of an object based on the halftone data which is written into and to provide a command to increase or decrease the brightness level to the illumination control means when the brightness level is low or high, respectively, thus establishing the brightness level of an illumination lamp, writes the halftone data which is obtained by an A/D conversion of the video signal which is obtained at the established brightness level into the halftone video signal memory means and then reads the halftone data written into the memory means therefrom and convert it into bi-level data which is then written into the bi-level video signal signal memory means during the step (a), the video signal processing means reading the bi-level data from the bi-level video signal memory means during the step (b), the video signal processing means writing halftine data which is obtained by an A/D conversion of fresh video data into the halftone video signal memory means, reads the halftone data from the memory means and converts is into bi-level data which is then written into the bi-level video signal memory means during the step (e), the video signal processing means reading the bi-level data from the bi-level video signal memory means during the step (f).
Claim 3
Dependent Claim 24 words
An apparatus according to claim 1 in which the change in a given status represents a change in the location of the particular area.
Claim 4
Dependent Claim 55 words
An apparatus according to claim 1 in which the video signal processing means examines an on/off condition of an electrical device which prevails when a change in a given status is detected, and causes the output means to provide an on or off command signal when the electical device is on or off, respectively. an
Claim 5
Independent Claim 292 words
An apparatus for commanding an energization of electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal form the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the loaction of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, in which the change in a given status represents a change in the configuration of the particular area.
Claim 6
Independent Claim 292 words
An apparatus for commanding an energization of electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal form the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the loaction of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, in which the change in a given status represents a change in the configuration of the particular area.
Claim 7
Dependent Claim 54 words
An apparatus according to claim 4 in which the video signal processing means examines an on/off condition of an electrical device which prevails when a change in a given status is detected, and causes the output means to provide an on or off command signal when the electrical device is on or off, respectively.
Claim 8
Independent Claim 324 words
An apparatus for commanding an energization of an electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, wherein the camera means comprises a television camera disposed in front of a driver's seat within an automobile for taking a picture of the face of a driver who is seated upon the driver's seat and looking forward of the automobile, the particular area being at least one pupil.
Claim 9
Independent Claim 324 words
An apparatus for commanding an energization of an electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, wherein the camera means comprises a television camera disposed in front of a driver's seat within an automobile for taking a picture of the face of a driver who is seated upon the driver's seat and looking forward of the automobile, the particular area being at least one pupil.
Claim 10
Dependent Claim 24 words
An apparatus according to claim 6 in which the change in a given status represents a change in the location of the particular area.
Claim 11
Dependent Claim 54 words
An apparatus according to claim 6 in which the video signal processing means examines an on/off condition of an electrical device which prevails when a change in a given status is detected, and causes the output means to provide an on or off command signal when the electrical device is on or off, respectively.
Claim 12
Independent Claim 325 words
An apparatus for commanding an energization of an electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, wherein the camera means comprises a television camera disposed in front of a driver's seat within an automobile for taking a picture of the face of a driver who is seated upon the driver,s seat and looking forward of the automobile, the particular area being a mouth of the driver.
Claim 13
Independent Claim 325 words
An apparatus for commanding an energization of an electrical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, wherein the camera means comprises a television camera disposed in front of a driver's seat within an automobile for taking a picture of the face of a driver who is seated upon the driver,s seat and looking forward of the automobile, the particular area being a mouth of the driver.
Claim 14
Dependent Claim 54 words
An apparatus according to claim 9 in which the video signal processing means examines an on/off condition of an electrical device which prevails when a change in a given status is detected, and causes the output means to provide an on or off command signal when the electrical device is on or off, respectively.
Claim 15
Independent Claim 329 words
An apparatus for commanding an energization of an electical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, wherein the camera means comprises a television camera disposed in front of a driver's seat within an automobile for taking a picture of the face of a driver who is seated upon the driver,s seat and looking forward of the automobile, the particular area being at least one pupil and mouth of the driver.
Claim 16
Independent Claim 329 words
An apparatus for commanding an energization of an electical device comprising: illumination means for illuminating an object; camera means for converting an optical image of the object into a video signal; memory means for storing at least one frame of the video signal; output means for delivering an on/off command signal to an electrical device; video signal processing means which operates (a) to write the video signal into the memory means; (b) to read the video signal from the memory means and to detect at least part of an outer profile of the object within an image frame and to detect the location of the part; (c) on the basis of the location detected, to detect a particular area of the object which is located within the outer profile of the object as well as its location; (d) to calculate a window region which is greater in size than the particular area and less in size than the image frame and centered about the particular area; (e) to write at least one fresh frame of video signal into the memory means; (f) to read the video signal located within the window region from the memory means, to detect the particular area and the location thereof on the basis of the video signal which is read from the memory means, and to calculate a fresh window region which is centered about the location detected; (g) to repeat the steps (e) and (f) to detect any change in a given status of the particular area; and (h) to command the output means to feed an on/off command signal in response to a given change in the status, wherein the camera means comprises a television camera disposed in front of a driver's seat within an automobile for taking a picture of the face of a driver who is seated upon the driver,s seat and looking forward of the automobile, the particular area being at least one pupil and mouth of the driver.
Claim 17
Dependent Claim 41 words
An apparatus according to claim 11 in which the change in a given status represents a change in the location of the pupil and in which the change in a given status represents a change in the configuration of the mouth.
Claim 18
Dependent Claim 54 words
An apparatus according to claim 11 in which the video signal processing means examines an on/off condition of an electrical device which prevails when a change in a given status is detected, and causes the output means to provide an on or off command signal when the electrical device is on or off, respectively.

References Cited (Backward Citations)

US4034401A Cited
US4028725A Cited
US4281342A Cited
US4340878A Cited
US4688037A Cited
US4397531A Cited
US4648052A Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 1991-08-30 1992-02-29 1992-08-30 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 1995-08-30 1996-02-29 1996-08-30 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 1999-08-30 2000-02-29 2000-08-30 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag