Information processing device, information processing system, and storage medium storing program

Claim 2

An information processing device comprising: circuitry configured to obtain an image including a plurality of objects; after an operation has been performed on a first object of the plurality of objects, control identification information associated with a second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, and the identification information indicating the second object; and obtain one or more candidates for the identification information indicating the second object, wherein at least one region of a plurality of regions set in the image is specified based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.

Claim 3

The information processing device according to claim 1 , wherein the circuitry is further configured to control the identification information based on a result of identification of the first object on which the operation has been performed.

Claim 4

The information processing device according to claim 2 , wherein the operation performed on the first object is an operation of specifying a region in the image corresponding to the first object.

Claim 5

The information processing device according to claim 1 , wherein the operation performed on the first object is an operation of setting identification information indicating the first object.

Claim 6

The information processing device according to claim 1 , wherein the circuitry is further configured to control a display to display, as the identification information, a candidate or candidates estimated from the one or more candidates, after the operation has been performed on the first object.

Claim 7

The information processing device according to claim 5 , wherein the circuitry is further configured to control the display to display the one or more candidates for the identification information indicating the second object in association with the second object, after the operation has been performed on the first object, and update the identification information indicating the second object based on identification information indicating a candidate or candidates estimated from the one or more candidates.

Claim 8

The information processing device according to claim 5 , wherein the circuitry is further configured to obtain one or more candidates for identification information indicating the first object, and estimate identification information indicating the second object from the one or more candidates for the identification information indicating the second object, based on one candidate that has been selected from the one or more candidates for the identification information indicating the first object.

Claim 9

The information processing device according to claim 5 , wherein the circuitry is further configured to obtain one or more candidates for identification information indicating respective objects of the plurality of regions set in the image.

Claim 10

The information processing device according to claim 8 , wherein the circuitry is further configured to obtain a candidate or candidates for the identification information indicating the respective objects of the plurality of regions based on a result of identification of one of the objects of the plurality of regions.

Claim 11

The information processing device according to claim 9 , wherein the circuitry is further configured to obtain the candidate or candidates for the identification information indicating the respective objects of the plurality of regions based on a result of identification of the one of the objects of the plurality of regions that has been updated, when a region of the one of the objects of the plurality of regions has been updated.

Claim 12

The information processing device according to claim 8 , wherein the second object is a dish, and the at least one region is specified based on the result of recognition of the container of the second object in which the dish is served.

Claim 13

The information processing device according to claim 5 , wherein the circuitry is further configured to obtain the one or more candidates for the identification information from an external server.

Claim 14

The information processing device according to claim 5 , wherein the identification information indicating the second object is estimated based on a co-occurrence probability indicating a probability with which an object indicated by each of the one or more candidates for the identification information co-occurs with the first object.

Claim 15

The information processing device according to claim 5 , wherein the circuitry is further configured to control the display to display a correctness of a result of estimation of the identification information indicating the second object in an identifiable fashion.

Claim 16

The information processing device according to claim 1 , further comprising: an image sensor configured to capture the image.

Claim 17

An information processing system comprising: a terminal including a display; and a server including circuitry configured to obtain an image including a plurality of objects, control the display to display the image, and obtain one or more candidates for identification information indicating a second object, wherein after an operation has been performed on a first object of the plurality of objects, the circuitry of the server controls identification information associated with the second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, the identification information indicating the second object, and at least one region of a plurality of regions set in the image is specified based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.

Claim 18

An information processing system comprising: a terminal including a display; and a server including circuitry configured to obtain an image including a plurality of objects, control the display to display the image, and obtain one or more candidates for identification information indicating a second object, wherein after an operation has been performed on a first object of the plurality of objects, the circuitry of the server controls identification information associated with the second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, the identification information indicating the second object, and at least one region of a plurality of regions set in the image is specified based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.

Claim 19

A non-transitory computer-readable storage medium having a program stored therein, the program causing a computer to execute: obtaining an image including a plurality of objects; after an operation has been performed on a first object of the plurality of objects, controlling identification information associated with a second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, and the identification information indicating the second object; obtaining one or more candidates for identification information indicating the second object; and setting at least one region of a plurality of regions in the image based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.

Claim 20

A non-transitory computer-readable storage medium having a program stored therein, the program causing a computer to execute: obtaining an image including a plurality of objects; after an operation has been performed on a first object of the plurality of objects, controlling identification information associated with a second object based on the operation performed on the first object, the second object being contained by a container of the second object, the second object and the container of the second object being discrete from the first object, and the identification information indicating the second object; obtaining one or more candidates for identification information indicating the second object; and setting at least one region of a plurality of regions in the image based on an image analysis process performed on the image and based on a result of recognition of the container of the second object.

Claim 21

The information processing device according to claim 15 , wherein the image sensor is a camera.