Patent US6516247B2 successfully refreshed from Google Patents.
← Back to Patent Explorer
US6516247B2 Expired / Lapsed US ⏱️ 0.0 years remaining

Robot, identifying environment determining method, and program thereof

Assignee: NEC Corp
•
Filing: 2002-01-29
•
Granted: 2003-02-04
•
Expires: 2022-01-29
📄 Original PDF 🌐 Google Patents 🔄 Sync Now

Abstract

Abstract A robot is provided, wherein it is possible to reduce incorrect identification in the case of executing face identification in a place where lighting variations are large such as in a house and in a place where there exists a lighting environment that is bad for identification. A face area of a person is detected from an image picked up at an imaging device and stored, and a face detecting and identifying device identifies a person using face image information stored before then. An identification result reliability calculating device calculates, using information from the imaging device, whether or not a present lighting state is suitable for face identification. When the result of calculation indicates that the lighting state is not suitable for face identification, the robot is moved by a moving means. Thereby, incorrect identification can be reduced.

Inventors

  • 👤 Junichi Funada

Bibliographic Details

Application Number —
Jurisdiction US
Data Source google_patents
Last Synchronized 2026-11-09 11:50
CPC Classifications
G; G06; G06V; G06V40/00; G06V40/10; G06V40/16; G06V40/172; H; H04; H04N; H04N23/00; H04N23/70; H04N23/60; H04N23/61; H04N23/611

Claims Analysis

Total Claims: 93
Claim 1
Independent Claim 148 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; an identification result reliability calculating means for determining, using information from the imaging means, whether or not a present lighting environment is suitable for identification; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 2
Dependent Claim 148 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; an identification result reliability calculating means for determining, using information from the imaging means, whether or not a present lighting environment is suitable for identification; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 3
Dependent Claim 38 words
The robot as claimed in claim 1 , wherein the identification result reliability calculating means determines a lighting environment using a variance value of pixel values in a face area detected at the face detecting and identifying means.
Claim 4
Dependent Claim 51 words
The robot as claimed in claim 1 , wherein the identification result reliability calculating means determines a lighting environment using a ratio of an average pixel value in a face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area.
Claim 5
Dependent Claim 27 words
The robot as claimed in claim 1 , wherein the identification result reliability calculating means determines a lighting environment using an average pixel value of whole image.
Claim 6
Dependent Claim 69 words
The robot as claimed in claim 1 , comprising a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein the identification result reliability calculating means determines a lighting environment using information whether or not the lighting device is turned on.
Claim 7
Dependent Claim 59 words
The robot as claimed in claim 1 , comprising a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein the identification result reliability calculating means determines a lighting environment using information whether or not the curtains are drawn.
Claim 8
Dependent Claim 36 words
The robot as claimed in claim 1 , comprising a robot state observing means retaining information about time, wherein the identification result reliability calculating means determines a lighting environment using information about time before executing identification.
Claim 9
Dependent Claim 43 words
The robot as claimed in claim 1 , comprising a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein the identification result reliability calculating means determines a lighting environment using the positional information.
Claim 10
Dependent Claim 96 words
The robot as claimed in claim 1 , wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person.
Claim 11
Dependent Claim 153 words
The robot as claimed in claim 1 , wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result is reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the identification result reliability calculating means determines the present lighting environment using at least one selected from a variance value of pixel values in the face area detected at the face detecting and identifying means to that in the vincinity of an outside of the face area, and an average pixel value of whole image.
Claim 12
Dependent Claim 158 words
The robot as claimed in claim 1 , including a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the persent lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the identification result reliability calculating means determines the present lighting environment using information whether or not the lighting device is turned on.
Claim 13
Dependent Claim 146 words
The robot as claimed in claim 1 , including a robot state observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the identification result reliability calculating means determines the present lighting environment using information whether or not the curtains are drawn.
Claim 14
Dependent Claim 125 words
The robot as claimed in claim 1 , including a robot state observing means retaining information about time, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the identification result reliability calculating means determines the present lighting environment using information about time before executing identification.
Claim 15
Dependent Claim 132 words
The robot as claimed in claim 1 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the dientification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the identification result reliability calculating means determines the present lighting environment using the positional information.
Claim 16
Dependent Claim 103 words
The robot at claimed in claim 1 , wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliabilty calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot.
Claim 17
Dependent Claim 159 words
The robot as claimed in claim 1 , wherein when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the identification result reliability calculating means determines the present lighting environment using at least one selected from a variance value of pixel values in the face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area, and an average pixel value of whole image.
Claim 18
Dependent Claim 165 words
The robot as claimed in claim 1 , including a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the identification result reliability calculating means determines the present lighting environment using information whether or not the lighting device is turned on.
Claim 19
Dependent Claim 155 words
The robot as claimed in claim 1 , including a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the identification result reliability calculating means determines the present lighting environment using information whether or not the curtains are drawn.
Claim 20
Dependent Claim 142 words
The robot as claimed in claim 1 , including a robot state observing means retaining information about time, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the identification result reliability calculating means determines the present lighting environment using information about time before executing identification.
Claim 21
Dependent Claim 139 words
The robot as claimed in claim 1 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: when the controlling means determines to shift to a state for identification, the identification result reliability calculating means determines whether or not the present lighting environment is suitable for identification; and when the identification result reliability calculating means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the identification result reliability calculating means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the identification result reliability calculating means determines the present lighting environment using the positional information.
Claim 22
Dependent Claim 242 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a lighting environment on the basis of image information acquired from the imaging means, and determining which predetermined lighting category corresponds to the lighting environment; an identifying performance recording means for recording, as identifying performance information, a classification of a lighting category at face identification, the category being determined at the lighting environment determining means, number of times where face identification has succeeded per lighting category, and number of times where face identification has been executed per lighting category; a lighting environment comparing means for determining, on the basis of the identifying performance information recorded in the identifying performance recording means, whether or not a present lighting environment is suitable for identification; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 23
Dependent Claim 242 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a lighting environment on the basis of image information acquired from the imaging means, and determining which predetermined lighting category corresponds to the lighting environment; an identifying performance recording means for recording, as identifying performance information, a classification of a lighting category at face identification, the category being determined at the lighting environment determining means, number of times where face identification has succeeded per lighting category, and number of times where face identification has been executed per lighting category; a lighting environment comparing means for determining, on the basis of the identifying performance information recorded in the identifying performance recording means, whether or not a present lighting environment is suitable for identification; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 24
Dependent Claim 37 words
The robot as claimed in claim 21 , wherein the lighting environment determining means categorizes a lighting environment using a variance value of pixel values in a face area detected at the face detecting and identifying means.
Claim 25
Dependent Claim 50 words
The robot as claimed in claim 21 , wherein the lighting environment determining means categorizes a lighting environment using a ratio of an average pixel value in a face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area.
Claim 26
Dependent Claim 26 words
The robot as claimed in claim 21 , wherein the lighting environment determining means categorizes a lighting environment using an average pixel value of whole image.
Claim 27
Dependent Claim 68 words
The robot as claimed in claim 21 , comprising a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the lighting device is turned on.
Claim 28
Dependent Claim 58 words
The robot as claimed in claim 21 , comprising a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the curtains are drawn.
Claim 29
Dependent Claim 35 words
The robot as claimed in claim 21 , comprising a robot state observing means retaining information about time, wherein the lighting environment determining means categorizes a lighting environment using information about time before executing identification.
Claim 30
Dependent Claim 42 words
The robot as claimed in claim 21 , comprising a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein the lighting environment determining means categorizes a lighting environment using the positional information.
Claim 31
Dependent Claim 119 words
The robot as claimed in claim 21 , wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person.
Claim 32
Dependent Claim 172 words
The robot as claimed in claim 21 , wherein: the identifying performance recording means records the identifying performance information each time the information whether result or indication is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identificartion, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using at least one selected from a variance value of pixel values in the face area detected at the face detecting and identifying means that in the vicinity of an outside of the face area, and an average pixel value of whole image.
Claim 33
Dependent Claim 177 words
The robot as claimed in claim 21 , including a robot state observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means caregorizes the lighting environment using information whether or not the lighting device is turned on.
Claim 34
Dependent Claim 168 words
The robot as claimed in claim 21 , including a robot state observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using information whether or not the curtains are drawn.
Claim 35
Dependent Claim 147 words
The robot as claimed in claim 21 , including a robot state observing means retaining information about time, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using information abouty time before executing identification.
Claim 36
Dependent Claim 153 words
The robot as claimed in claim 21 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using the positional information.
Claim 37
Dependent Claim 127 words
The robot as claimed in claim 21 , wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot.
Claim 38
Dependent Claim 181 words
The robot as claimed in claim 21 , wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using at least one selected from a variance value of pixel values in the face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area, and an average pixel value of whole image.
Claim 39
Dependent Claim 187 words
The robot as claimed in claim 21 , including a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using information whether or not the lighting device is turned on.
Claim 40
Dependent Claim 177 words
The robot as claimed in claim 21 , including a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using information whether or not the curtains are drawn.
Claim 41
Dependent Claim 154 words
The robot as claimed in claim 21 , including a robot state observing means retaining information about time, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using information about time before executing identification.
Claim 42
Dependent Claim 161 words
The robot as claimed in claim 21 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using the positional information.
Claim 43
Dependent Claim 276 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a lighting environment on the basis of image information acquired from the imaging means, and determining which predetermined lighting category corresponds to the lighting environment; an identifying performance recording means for recording, as identifying performance information, a classification of a lighting category at face identification, the category being determined at the lighting environment determining means, number of times where face identification has succeeded per lighting category, and number of times where face identification has been executed per lighting category; a lighting environment comparing means for determining, on the basis of the identifying performance information recorded in the identifying performance recording means, whether or not a present lighting environment is suitable for identification; a controlling means for controlling a robot; a moving means for moving a robot; and a moving plan making means for making a moving plan, on the basis of information recorded in the identifying performance recording means, to move a robot to a position where identifying performance is higher.
Claim 44
Dependent Claim 276 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a lighting environment on the basis of image information acquired from the imaging means, and determining which predetermined lighting category corresponds to the lighting environment; an identifying performance recording means for recording, as identifying performance information, a classification of a lighting category at face identification, the category being determined at the lighting environment determining means, number of times where face identification has succeeded per lighting category, and number of times where face identification has been executed per lighting category; a lighting environment comparing means for determining, on the basis of the identifying performance information recorded in the identifying performance recording means, whether or not a present lighting environment is suitable for identification; a controlling means for controlling a robot; a moving means for moving a robot; and a moving plan making means for making a moving plan, on the basis of information recorded in the identifying performance recording means, to move a robot to a position where identifying performance is higher.
Claim 45
Dependent Claim 37 words
The robot as claimed in claim 41 , wherein the lighting environment determining means categorizes a lighting environment using a variance value of pixel values in a face area detected at the face detecting and identifying means.
Claim 46
Dependent Claim 50 words
The robot as claimed in claim 41 , wherein the lighting environment determining means categorizes a lighting environment using a ratio of an average pixel value in a face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area.
Claim 47
Dependent Claim 26 words
The robot as claimed in claim 41 , wherein the lighting environment determining means categorizes a lighting environment using an average pixel value of whole image.
Claim 48
Dependent Claim 68 words
The robot as claimed in claim 41 , comprising a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the lighting device is turned on.
Claim 49
Dependent Claim 58 words
The robot as claimed in claim 41 , comprising a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the curtains are drawn.
Claim 50
Dependent Claim 35 words
The robot as claimed in claim 41 , comprising a robot state observing means retaining information about time, wherein the lighting environment determining means categorizes a lighting environment using information about time before executing identification.
Claim 51
Dependent Claim 42 words
The robot as claimed in claim 41 , comprising a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein the lighting environment determining means categorizes a lighting environment using the positional information.
Claim 52
Dependent Claim 120 words
The robot as claimed in claim 41 , wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person.
Claim 53
Dependent Claim 167 words
The robot as claimed in claim 41 , wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using at least one selected from a varience value of pixel values in the face area detected at the face detecting and identifying means, a ratio of an average pixel value in the face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area, and an average pixel value of whole image.
Claim 54
Dependent Claim 180 words
The robot as claimed in claim 41 , including a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using information whether or not the lighting deivce is turned on.
Claim 55
Dependent Claim 170 words
The robot as claimed in claim 41 , including a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using information whether or not the curtains are drawn.
Claim 56
Dependent Claim 120 words
The robot as claimed in claim 41 , including a robot state observing means retaining information about time, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using information about time before executing identification.
Claim 57
Dependent Claim 154 words
The robot as claimed in claim 41 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the lighting environment determining means categorizes the lighting environment using the positional information.
Claim 58
Dependent Claim 126 words
The robot as claimed in claim 41 wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot.
Claim 59
Dependent Claim 174 words
The robot as claimed in claim 41 , wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting enviroment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using at least one selected from a variance value of pixel values in the face area detected at the face detecting and identifying means, a ratio of an average pixel value in the face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area, and an average pixel value of whole image.
Claim 60
Dependent Claim 185 words
The robot as claimed in claim 41 , including a robot state observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environement using information whether or not the lighting device is turned on.
Claim 61
Dependent Claim 177 words
The robot as claimed in claim 41 , including a robot state observing means observing a curtain state in a room using a curtain state observing means woring with curtains to detect whether or not the curtains are drawn, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using information whether or not the curtains are drawn.
Claim 62
Dependent Claim 154 words
The robot as claimed in claim 41 , including a robot state observing means retaining information about time, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrect is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person, and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using information about time before executing identification.
Claim 63
Dependent Claim 161 words
The robot as claimed in claim 41 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: the identifying performance recording means records the identifying performance information each time the information whether result of identification is correct or incorrest is acquired from the user; when the controlling means determines to shift to a state for identification, the lighting environment comparing means determines whether or not the present lighting environment is suitable for identification; and when the lighting environment comparing means determines that the present lighting environment is suitable for identification, the face detecting and identifying means identifies the person; or when the lighting environment comparing means determines that the present lighting environment is not suitable for identification, the controlling means controls the robot not to identify the person; and the moving means moves the robot; and the lighting environment determining means categorizes the lighting environment using the positional information.
Claim 64
Dependent Claim 244 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a present lighting environment on the basis of image information acquired from the imaging means, determining which predetermined lighting category corresponds to the lighting environment, and classifying the lighting environment of a face image stored in the face detecting and identifying means into a lighting category; a lighting environment at registration recording means for recording, per user, the lighting category of the stored face image; a lighting environment at registration comparing means for determining, on the basis of information recorded in the lighting environment at registration recording means, whether or not a face image of a user communicating with a robot has been registered in a same lighting environment as a present lighting environment; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 65
Dependent Claim 244 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a present lighting environment on the basis of image information acquired from the imaging means, determining which predetermined lighting category corresponds to the lighting environment, and classifying the lighting environment of a face image stored in the face detecting and identifying means into a lighting category; a lighting environment at registration recording means for recording, per user, the lighting category of the stored face image; a lighting environment at registration comparing means for determining, on the basis of information recorded in the lighting environment at registration recording means, whether or not a face image of a user communicating with a robot has been registered in a same lighting environment as a present lighting environment; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 66
Dependent Claim 37 words
The robot as claimed in claim 61 , wherein the lighting environment determining means categorizes a lighting environment using a variance value of pixel values in a face area detected at the face detecting and identifying means.
Claim 67
Dependent Claim 50 words
The robot as claimed in claim 61 , wherein the lighting environment determining means categorizes a lighting environment using a ratio of an average pixel value in a face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area.
Claim 68
Dependent Claim 26 words
The robot as claimed in claim 61 , wherein the lighting environment determining means categorizes a lighting environment using an average pixel value of whole image.
Claim 69
Dependent Claim 68 words
The robot as claimed in claim 61 , comprising a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the lighting device is turned on.
Claim 70
Dependent Claim 58 words
The robot as claimed in claim 61 , comprising a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the curtains are drawn.
Claim 71
Dependent Claim 35 words
The robot as claimed in claim 61 , comprising a robot state observing means retaining information about time, wherein the lighting environment determining means categorizes a lighting environment using information about time before executing identification.
Claim 72
Dependent Claim 42 words
The robot as claimed in claim 61 , comprising a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein the lighting environment determining means categorizes a lighting environment using the positional information.
Claim 73
Dependent Claim 77 words
The robot as claimed in claim 61 , wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; and when the lighting environment at registration comparing means determines that the face image of the user communicating with the robot has not been registered in the lighting environment, the controlling means directs the face detecting and identifying means to register the face image of the user.
Claim 74
Dependent Claim 149 words
The robot as claimed in claim 61 , wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; the lighting environment determining means categorizes the lighting environment using at least one selected from a variance value of pixel values in the face area detected at the face detecting and identifying means, a ratio of an average pixel value in the face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area, and an average pixel value of whole image; and when the lighting environment at registration comparing means determines that the face image of the user communicating with the robot has not been registered in the lighting environment, the controlling means directs the face detecting and identifying means to register the face image of the user.
Claim 75
Dependent Claim 136 words
The robot as claimed in claim 61 , including a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a ligting devuce in a room to detect whether or not the lighting device is turned on, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identification means identifies the person; the lighting envionment determining means categorizes the lighting environment using information whether or not the lighting device is turned on; and when the lighting environment at registration comparing means determines that the face image of the user communicating with the robot has not been registered in the lighting environment, the controlling means directs the face detecting and identifying means to register the face image of the user.
Claim 76
Dependent Claim 126 words
The robot as claimed in claim 61 , including a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; the lighting environment determining means categorizes the lighting environment using information whether or not the curtains are drawn; and when the lighting environment at registration comparing means determines that the face image of the user communicating with the robot has not been registered in the lighting environment, the controlling means directs the face detecting and identifying means to register the face image of the user.
Claim 77
Dependent Claim 103 words
The robot as claimed in claim 61 , including a robot state observing means retaining information about time, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; the lighting environment determining means categorizes the lighting environment using information about time before executing identification; and when the lighting environment at registration comparing means determines that the face image of the user communicating with the robot has not been registered in the lighting environment, the controlling means directs the face detecting and identifying means to register the face image of the user.
Claim 78
Dependent Claim 110 words
The robot as claimed in claim 61 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; the lighting environment determining means categorizes the lighting environment using the positional information; and when the lighting environment at registration comparing means determines that the face image of the user communicating with the robot has not been registered in the lighting environment, the controlling means directs the face detecting and identifying means to register the face image of the user.
Claim 79
Dependent Claim 320 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a lighting environment on the basis of image information acquired from the imaging means, and determining which predetermined lighting category corresponds to the lighting environment; a face detecting means for detecting, from an image acquired at the imaging means, a face area to extract the face area, and converting the face area into data to execute identification; a data controlling means for storing a characteristic data group of a face per person at acquisition thereof in each lighting category acquired at the lighting environment determining means; a dictionary compiling means for compiling a recognition dictionary using characteristic data per lighting category; a dictionary storing means for storing, per lighting category, a recognition dictionary compiled at the dictionary compiling means; a dictionary selecting means for selecting, from the dictionary storing means, a recognition dictionary of a same lighting category as that determined at the lighting environment determining means, and supplying the dictionary to a face identifying means; a face identification means for executing identification of characteristic data supplied from the face detecting means to determine a user's name on the basis of a recognition dictionary supplied from the dictionary selecting means; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 80
Dependent Claim 320 words
A robot comprising: an imaging means for picking up an image and digitizing the image; a face detecting and identifying means for detecting, from an image acquired at the imaging means, a face area of a person and storing the face area, and identifying a person using a stored image and face image information that is referred for identification; an information informing means for informing a user about result of identification acquired at the face detecting and identifying means; an information inputting means disposed so that a user can input information whether result of identification informed to the user by the information informing means is correct or incorrect; a lighting environment determining means for determining a lighting environment on the basis of image information acquired from the imaging means, and determining which predetermined lighting category corresponds to the lighting environment; a face detecting means for detecting, from an image acquired at the imaging means, a face area to extract the face area, and converting the face area into data to execute identification; a data controlling means for storing a characteristic data group of a face per person at acquisition thereof in each lighting category acquired at the lighting environment determining means; a dictionary compiling means for compiling a recognition dictionary using characteristic data per lighting category; a dictionary storing means for storing, per lighting category, a recognition dictionary compiled at the dictionary compiling means; a dictionary selecting means for selecting, from the dictionary storing means, a recognition dictionary of a same lighting category as that determined at the lighting environment determining means, and supplying the dictionary to a face identifying means; a face identification means for executing identification of characteristic data supplied from the face detecting means to determine a user's name on the basis of a recognition dictionary supplied from the dictionary selecting means; a controlling means for controlling a robot; and a moving means for moving a robot.
Claim 81
Dependent Claim 37 words
The robot as claimed in claim 75 , wherein the lighting environment determining means categorizes a lighting environment using a variance value of pixel values in a face area detected at the face detecting and identifying means.
Claim 82
Dependent Claim 50 words
The robot as claimed in claim 75 , wherein the lighting environment determining means categorizes a lighting environment using a ratio of an average pixel value in a face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area.
Claim 83
Dependent Claim 26 words
The robot as claimed in claim 75 , wherein the lighting environment determining means categorizes a lighting environment using an average pixel value of whole image.
Claim 84
Dependent Claim 68 words
The robot as claimed in claim 75 , comprising a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the lighting device is turned on.
Claim 85
Dependent Claim 58 words
The robot as claimed in claim 75 , comprising a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein the lighting environment determining means categorizes a lighting environment using information whether or not the curtains are drawn.
Claim 86
Dependent Claim 35 words
The robot as claimed in claim 75 , comprising a robot state observing means retaining information about time, wherein the lighting environment determining means categorizes a lighting environment using information about time before executing identification.
Claim 87
Dependent Claim 42 words
The robot as claimed in claim 75 , comprising a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein the lighting environment determining means categorizes a lighting environment using the positional information.
Claim 88
Dependent Claim 30 words
The robot as claimed in claim 75 , wherein when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person.
Claim 89
Dependent Claim 103 words
The robot as claimed in claim 75 , wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; and the lighting environment determining means categorizes the lighting environment using at least one selected from a variance value of pixel values in the face area detected at the face detecting and identifying means, a ratio of an average pixel value in the face area detected at the face detecting and identifying means to that in the vicinity of an outside of the face area, and an average pixel value of whole image.
Claim 90
Dependent Claim 90 words
The robot as claimed in claim 75 , including a robot state observing means observing a lighting state in a room using a lighting device state observing means working with a lighting device in a room to detect whether or not the lighting device is turned on, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; and the lighting environment determining means categorizes the lighting environment using information whether or not the lighting device is turned on.
Claim 91
Dependent Claim 80 words
The robot as claimed in claim 75 , including a robot state observing means observing a curtain state in a room using a curtain state observing means working with curtains to detect whether or not the curtains are drawn, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; and the lighting environment determining means categorizes the lighting environment using information whether or not the curtains are drawn.
Claim 92
Dependent Claim 57 words
The robot as claimed in claim 75 , including a robot state observing means retaining information about time, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; and the lighting environment determining means categorizes the lighting environment using information about time before executing identification.
Claim 93
Dependent Claim 64 words
The robot as claimed in claim 25 , including a robot state observing means retaining positional information acquired by observing a position of a robot in a room, wherein: when the controlling means determines to shift to a state for identification, the face detecting and identifying means identifies the person; and the lighting environment determining means categorizes the lighting environment using the positional inforamation.

References Cited (Backward Citations)

US5781650A Cited
US5614714A Cited
US5663562A Cited
US5614715A Cited
JPH11316836A Cited
JP2000222576A Cited
US20010020837A1 Cited
US6301440B1 Cited

USPTO Annuity & Maintenance Windows

Annuity Stage Window Opens Payment Deadline Surcharge Period Until Estimated Fee Status
3.5 Years (Year 4) 2006-02-03 2006-08-05 2007-02-04 $2000.00 Window Closed / Lapsed
7.5 Years (Year 8) 2010-02-03 2010-08-05 2011-02-04 $3760.00 Window Closed / Lapsed
11.5 Years (Year 12) 2014-02-03 2014-08-05 2015-02-04 $7700.00 Window Closed / Lapsed

Assigned Categories & Tags

No categories assigned to this patent yet.

Assign Category Tag