Recording media with video, respectively audio index information, information management and retrieval methods for video, respectively audio information and a video retrieval system

Claim 2

The recording medium with video index information (100) recorded therein according to Claim 1; wherein, of the structure element objects, at least one type of structure element object has retrieval information for retrieving contents of frames and/or voices directly and indirectly managed by the structure element object.

Claim 3

The recording medium with video index information (100) recorded therein according to Claim 1; wherein the structure element object has retrieval information for retrieving frames and/or voices directly or indirectly managed by each structure element object.

Claim 4

A video information management method which uses a video index information (100) for managing the video information by analyzing at least video including a plurality of frames, generating, apart from the video information, video index information (100) for managing the video information, and referring to the generated video index information (100); wherein the video index information (100) has a tree structure comprising, as structure element objects, at least one frame information (102) for managing a given number of successive frames in the video information as one unit of information, at least one sound information for managing voices corresponding to a given range in the video information as one unit of information, at least one segment information (104) for classifying the frame information (102) and sound information each as one unit of information and managing the information as a desired significant collection of data, and package information (105) for collectively managing a plurality of segment information (104) as a group; further the segment information (104) manages the package information (105) for collectively managing a plurality of other segment information (104) generated by using the same frame as that of the frame information (102) and sound information managed by the segment information (104) and voices in the frame; the package information (105) is arranged, in addition to the frame information (102) and sound information, under one segment information (104) within said tree structure; and the video information is managed by using said tree structure and structure element objects of the video index information (100).

Claim 5

The video information management method which uses the video index information (100) according to Claim 4; wherein a particular structure element object in said tree structure of video index information (100) is specified to make the specified structure element object visible and/or audible.

Claim 6

The video information management method which uses the video index information (100) according to Claim 4 or Claim 5; wherein the frame information (102) has a node ID in said tree structure, a range of successive frames managed according to the frame information (102), and a pointer indicating a position in the video information.

Claim 7

The video information management method which uses the video index information (100) according to any of Claims 4 to 6; wherein the sound information (103) has a node ID in said tree structure, a given range to be managed according to the frame information (102), and a pointer indicating a position in the video information.

Claim 8

The video information management method which uses the video index information (100) according to any of Claims 4 to 7; wherein the segment information (104) has a node ID in said tree structure, identifying information for identifying frame information (102), sound information (103) and package information (105) to be managed according to the segment information (104), and a pointer to upper package information (105) with the segment information (104) belonging thereto.

Claim 9

The video information management method which uses the video index information (100) according to any of Claims 4 to 8; wherein the package information (105) has a node ID in said tree structure, a list of segment information (104) managed according to the package information (105), and a pointer to upper segment information (104) with the package information (105) belonging thereto.

Claim 10

The video information management method which uses the video index information (100) according to any of Claims 4 to 9; wherein the video index information (100) has a given attribute object (106) allocated in said tree structure, all of structure element objects in the video index information (100) each have a pointer to the attribute object (106), and given additional information can be added to a given structure element object using the attribute object (106) and the pointer to the attribute object (106).

Claim 11

A video information management method which uses a video index information (100) for managing the video information by analyzing video information including at least a plurality of frames, generating, apart from the video information, video index information (100) for managing the video information, and referring to the generated video index information (100); wherein the video index information (100) has at least a plurality of segment information (104) for managing a range of a given number of successive frames, and a link list for indicating links between segment information (104) for indicating in what order the plurality of segment information (104) should be followed; a plurality of link lists each indicating in what a desired order of segment information (104) are to be followed of the plurality of segment information (104) each constituting the video information, a plurality of view information corresponding to the link lists are set, and the video information is managed by using the video index information (100) having the plurality of view information.

Claim 12

The video information management method which uses the video index information (100) according to Claim 11; wherein, of the plurality of view information in the video index information (100), particular view information is specified, and a portion of the video information is made visible and/or audible by using a link list for the specified view information.

Claim 13

The video information management method which uses the video index information (100) according to any of Claims 4 to 12; wherein the video index information (100) is separated from the video information and is stored in the separated state.

Claim 14

A computer-readable recording medium with audio index information (100) prepared by analyzing audio information recorded therein; wherein the audio index information (100) has a tree structure comprising at least one sound information (103) for managing voices corresponding to a given range in the audio information as one unit of information, at least one segment information (104) for classifying one the sound information (103) equivalent to one unit of information and managing the sound information (103) as a collection of information having desired meaning, package information (105) for collectively managing the segment information (104) as a group each as a structure element object; the segment information (104) manages package information (105) for collectively managing a plurality of other segment information (104) generated by using the same range of sounds as the sound information (103) managed according to the segment information (104) and managing the segment information (104) as a group; and the package information (105) is allocated in addition to the sound information (103), under one segment information (104) within said tree structure.

Claim 15

The recording medium with audio index information (100) recorded therein according to Claim 14; wherein, of the structure element objects, at least one type of structure element object has retrieval information for retrieving contents of sounds directly or indirectly managed by the structure element object.

Claim 16

The recording medium with audio index information (100) recorded therein according to Claim 14; wherein the structure element object has retrieval information for retrieving contents of sounds directly or indirectly managed by each structure element object.

Claim 17

An audio information management method which uses an audio index information (100) for managing the audio information by analyzing audio information, generating, apart from the audio information, audio index information (100) for managing the audio information, and referring to the generated audio index information (100); wherein the audio index information (100) has a tree structure comprising at least one sound information (103) for managing sounds corresponding to a given range in the audio information as one unit of information, at least one segment information (104) for classifying the sound information (103) equivalent to one unit of information and managing the sound information (103) as a group having desired meaning, package information (105) for collectively managing the group of segment information (104) each as a structure element object; the segment information (104) has package information (105) for collectively managing a plurality of other segment information (104) generated using sounds in the same range as that of the sound information (103) managed by the segment information (104) as a group and managing the group of information; the package information (105) is allocated, in addition to the sound information (103), under one segment information (104) within said tree structure; and the audio information is managed by using said tree structure of the audio index information (100) and the structure element objects.

Claim 18

The audio information management method which uses the audio index information (100) according to Claim 17; wherein the audio index information (100) is separated from the audio information and stored in the separated state.

Claim 19

A video retrieval method which uses a video index information (100) for retrieving video information satisfying desired retrieval conditions from a plurality of video information by referring video index information (100) prepared in correlation to each video information; wherein the video index information (100) has a tree structure comprising at least one frame information (102) for managing a given number of successive frames in the video information as one unit of information, at least one sound information (103) for managing sounds corresponding to a given range in the video information as one unit of information, at least one segment information (104) for classifying the sound information (103) equivalent to one unit of information and managing the sound information (103) as a group having desired meaning, package information (105) for collectively managing the group of segment information (104) each as a structure element object; at least one type of structure element object of the structure element objects has retrieval information for retrieving contents of a frame and/or sounds directly or indirectly managed by the structure element object; the segment information (104) manages package information (105) for collectively managing a plurality of segment information (104) prepared by using the frame information (102) managed by the segment information (104) as well as a frame and sounds in the same range as that of the sound information (103) and managing the group of segment information (104); the package information (105) is located, in addition to the frame information (102) and sound information (103), under one segment information (104) within said tree structure; and retrieval conditions for desired vide information are inputted, a plurality of video index information (100) prepared from a plurality of different video information to identify video index information (100) including retrieval information satisfying the retrieval conditions, and a list of video information corresponding to the identified video index information (100) is outputted as a result of retrieval.

Claim 20

The video retrieval method which uses the video index information (100) according to Claim 19; wherein the frame information (102) further has retrieval information for managing a representative frame freely selected from successive frames in the video information managed as one unit of information and retrieving contents of the representative frame; and the sound information (103) has retrieval information for managing a representative noise and sound in a given range selected from sounds corresponding to a given range in the video information managed as one unit of information and retrieving contents of the representative voice and sound.

Claim 21

The video retrieval method which uses the video index information (100) according to Claim 19 or Claim 20; wherein further a hierarchy level of the video index information (100) is inputted as a retrieval range together with the retrieval conditions, video index information (100) including retrieval information satisfying the retrieval conditions is identified by retrieving only retrieval information for structure element objects present in the retrieval range in the plurality of video index information (100), and a list for video information corresponding to the identified video index information (100) is outputted as a result of retrieval.

Claim 22

The video retrieval method which uses the video index information (100) according to any of Claims 19 to 21; wherein only retrieval information in video index information (100) prepared in correlation to video information is used when retrieving desired video information from the plurality of video information.

Claim 23

The video retrieval method which uses the video index information (100) according to any of Claims 19 to 22; wherein the retrieval conditions include a plurality of retrieval items each for a specified type of structure element objects.

Claim 24

The video retrieval method which uses the video index information (100) according to any of Claims 19 to 23; wherein the retrieval conditions include a plurality of retrieval items each for the same type of structure element object.

Claim 25

The video retrieval method which uses the video index information (100) according to Claim 23 or Claim 24; wherein the retrieval conditions can logically express relations among the plurality of retrieval items.

Claim 26

The video retrieval method which uses the video index information (100) according to any of Claims 23 to 25; wherein the retrieval item has the same data structure as that of the retrieval information present in a structure element object as an object for retrieval.

Claim 27

The video retrieval method which uses the video index information (100) according to any of Claims 16 to 26; wherein a list of structure element objects having retrieval information satisfying the retrieval conditions is outputted together with the list for video information for each video information on a list outputted as a result of retrieval.

Claim 28

The video retrieval method which uses the video index information (100) according to any of Claims 19 to 27; wherein the retrieval conditions comprise a plurality of retrieval items capable of being weighted independently, and a score assessed according to weighting of the retrieval items is given to each video information on the list outputted as a result of retrieval.

Claim 29

The video retrieval method which uses the image index information (100) according to Claim 28; wherein each video information on the list outputted as a result of retrieval is outputted according to the assessment value in the ranking order.

Claim 30

A video retrieval method which uses a video index information (100) for retrieving a video satisfying desired retrieval conditions from image information by referring video index information (100) previously prepared from video information; wherein the video index information (100) has a tree structure comprising at least one frame information (102) for managing a given number of successive frames in the video information as one unit of information, at least one sound information (103) for managing sounds corresponding to a given range in the video information as one unit of information, at least one segment information (104) for classifying the frame information (102) and sound information (103) each as one unit of information as a group having desired meaning and managing the group of information, and package information (105) for managing a plurality of segment information (104) as a group each as a structure element object; the structure element object has retrieval information for retrieving contents of frames and/or sounds directly and indirectly managed by the structure element object; the segment information (104) manages package information (105) for managing a plurality of other segment information (104) generated using frames, sounds in the same range as that of the frame information (102) and sound information (103) managed by the segment information (104); the package information (105) is located, in addition to the frame information (102) and sound information (103), under one segment information (104) within said tree structure; retrieval conditions for a desired video-image are inputted, a structure element object including retrieval information satisfying the retrieval conditions is identified by retrieving the video index information (100), and a list for the identified structure element objects is outputted as a result of retrieval.

Claim 31

The video retrieval method which uses the video index information (100) according to Claim 30; wherein a hierarchy level in a direction of depth in said tree structure is inputted as a retrieval range together with the retrieval conditions, a structure element object including retrieval information satisfying the retrieval conditions is identified by retrieving only retrieval information for structure element objects present in the retrieval range in the video index information (100), and a list of identified structure element objects is outputted as a result of retrieval.

Claim 32

The video retrieval method which uses the video index information (100) according to Claim 30 or Claim 31; wherein the retrieval conditions comprises a plurality of retrieval items capable of being weighted independently, and a score assessed according to weighting of the retrieval items is assigned to each structure element object on the list outputted as a result of retrieval.

Claim 33

The video retrieval method which uses the video index information (100) according to Claim 32; wherein each of the structure element objects on the list outputted as a result of retrieval is outputted according to the assessment value in the ranking order.

Claim 34

An audio retrieval method which uses an audio index information for retrieving audio information satisfying desired retrieval conditions from a plurality of audio information by referring to audio index information previously prepared in correlation to each audio information; wherein the audio index information has a tree structure comprising at least one sound information (103) for managing sounds corresponding to a given range in the audio information, at least one segment information (104) for classifying the sound information (103) as one unit of information and managing the sound information (103) as a group having desired meaning, package information (105) for managing the plurality of segment information (104) each as a structure element object; at least one type of structure element objects of the structure element objects have retrieval information for retrieving contents of sounds directly or indirectly managed by the structure element object; the segment information (104) manages package information (105) for collectively managing other segment information (104) prepared by using sounds in the same range as that of the sound information (103) managed by the segment information (104) and managing the segment information (104) as a group; the package information (105) is allocated in addition to the sound information (103), under one segment information (104) within said tree structure; and retrieval conditions as conditions for desired sounds are inputted, audio index information satisfying the retrieval conditions is identified by retrieving a plurality of audio index information previously prepared from a plurality of different audio information, and a list of audio information corresponding to the identified audio index information is outputted as a result of retrieval.

Claim 35

The audio retrieval method which uses the audio index information according to Claim 34; wherein positional information identifying a position of a desired voice is added according to a structure element object satisfying the retrieval conditions to each audio information on a list outputted as a result of retrieval and the audio information with the positional information added thereto is outputted.

Claim 36

The audio retrieval method which uses the audio index information according to Claim 34 or Claim 35; wherein the retrieval conditions comprises a plurality of retrieval items each capable of being weighted independently, and a score assessed according to weighting of each retrieval item is added to each audio information on the list outputted as a result of retrieval.

Claim 37

The audio retrieval method which uses the audio index information according to Claim 36; wherein each of audio information on the list outputted as a result of retrieval is outputted according to the assessment order in the ranking order.

Claim 38

An audio retrieval method which uses an audio index information for retrieving sounds satisfying a desired retrieval condition from audio information by referring to audio index information previously prepared from audio information; wherein the audio index information has a tree structure comprising at least one sound information (103) for managing voiced and sounds corresponding to a given range in the audio information as one unit of information, at least one segment information (104) for classifying the sound information (103) as a group and managing the sound information (103) as a group having desired meanings, and package information (105) for collectively managing the group of segment information (104); the structure element object has retrieval information for retrieving contents of sounds directly or indirectly managed by the structure element object; the segment information (104) has package information (105) for collectively managing a plurality of other segment information (104) prepared using sounds in the same range as that the sound information (103) managed by the segment information (104) as a group; the package information (105) is allocated in addition to the sound information (103) under one segment information (104) within said tree structure; and retrieval conditions for desired sounds are inputted, a structure element object including retrieval information satisfying the retrieval conditions is identified by retrieving the audio index information, and a list for the identified structure elements is outputted as a result of retrieval.

Claim 39

The audio retrieval method which uses the audio index information according to Claim 38; wherein a hierarchy level in a direction of depth in said tree structure is inputted together with the retrieval conditions, a structure element object including retrieval information satisfying the retrieval conditions is identified by retrieving only retrieval information for structure element objects present in the retrieval range in the audio index information, and a list for the identified structure element objects is outputted as a result of retrieval.

Claim 40

The audio retrieval method which uses the audio index information according to Claim 38 or Claim 39; wherein the retrieval conditions consist of a plurality of retrieval items each capable of being weighted independently, and a score assessed according to weighting of the retrieval item is given to each of the structure element objects on the list outputted as a result of retrieval.

Claim 41

The audio retrieval method which uses the audio index information according to Claim 40; wherein each of structure elements on the list outputted as a result of retrieval is outputted according to the assessment value in the ranking order.

Claim 42

A video retrieval system (700) comprising: a plurality of video information databases (701) each storing therein a plurality of video information; a plurality of video index information databases (702) each storing video index information previously prepared in correlation to each video information; a retrieval information delivery file (703) generated by extracting retrieval information for retrieving video information stored in said video information databases (701) from the video index information stored in said plurality of index information databases (702); and a retrieval device (704) for retrieving video information completely or almost satisfying a desired retrieval condition from said video information databases (701) by using said retrieval information delivery file (703); wherein the video index information in said video index information databases (702) has a tree structure comprising at least one frame information (102) for managing a given number of successive frames in the video information as one unit of information, at least one sound information (103) for managing sounds corresponding to a given range in the video information as one unit of information, at least one segment information (104) for classifying the frame information (102) and sound information (103) each as one unit of information and managing the information as a group having desired meanings, and package information (105) for managing a plurality of segment information (104) as a group each as a structure element object; of the structure element objects, at least one type of structure element objects have retrieval information for retrieving contents of frames and/or sounds directly or indirectly managed by the structure element object, the segment information (104) manages package information (105) for managing a plurality of other segment information (104) prepared by using the frame information (102) managed by the segment information (104) and sounds in the same frame as that of the sound information (103) as a group, and further the package information (105) is allocated in addition to the frame information (102) and sound information (103) under one segment information (104) within said tree structure; said retrieval information delivery file (703) stores therein in a correlated form the retrieval information extracted from said plurality of video index information databases (702), and the retrieval information classified into a plurality of categories with a structure element object as an extraction source of the retrieval information and video index information having the structure element object present; and said retrieval device (704) identifies, when retrieval conditions for a desired video-image are inputted, retrieval information completely or almost satisfying the retrieval conditions using each retrieval information stored in said retrieval information delivery file (703) and information relating to and a category of the retrieval information, and outputs the video information as a result of retrieval according to the video index information including the retrieval information.

Claim 43

A video retrieval system (700) comprising: a plurality of video information databases (701) each storing therein a plurality of video information; a plurality of video index information databases (702) each storing video index information (100) previously prepared in correlation to each video information; a retrieval information delivery file (703) generated by extracting retrieval information for retrieving video information stored in said video information databases (701) from the video index information (100) stored in said plurality of index information databases (702); and a retrieval device (704) for retrieving video information completely or almost satisfying a desired retrieval condition from said video information databases (701) by using said retrieval information delivery file (703); wherein the video index information (100) in said video index information databases (702) has a tree structure comprising at least one frame information (102) for managing a given number of successive frames in the video information as one unit of information, at least one sound information (103) for managing sounds corresponding to a given range in the video information as one unit of information, at least one segment information (104) for classifying the frame information (102) and sound information (103) each as one unit of information and managing the information as a group having desired meanings, and package information (105) for managing a plurality of segment information (104) as a group each as a structure element object; the segment information (104) manages package information (105) for managing a plurality of other segment information (104) prepared by using the frame information (102) managed by the segment information (104) and frames and sounds in the same range as that of the sound information (103) as a group, and further the package information (105) is allocated in addition to the frame information (102) and sound information (103) under one segment information (104) in said tree structure; said retrieval information delivery file (703) stores therein the plurality of retrieval information classified into a plurality of categories, each retrieval information correlated to a structure element object retrieved according to the retrieval information and video index information (100) with the structure element object present therein; and said retrieval device (704) identifies, when retrieval conditions for a desired video-image are inputted, retrieval information completely or almost satisfying the retrieval conditions using each retrieval information stored in said retrieval information delivery file (703) and information relating to and a category of the retrieval information, and outputs the video information as a result of retrieval according to the video index information (100) including the retrieval information.

Claim 44

The video retrieval system (800) according to Claim 42 or Claim 43; wherein said video information databases (701), video index information databases (702), retrieval information delivery files (703), and retrieval devices (704) are provided on a network, and any retrieval device (704) on the network can be connected via a given retrieval information delivery file (703) to any of all of the video index information databases (702) and all of the video information databases (701).

Claim 45

The video retrieval system according to Claim 42 or Claim 43; wherein said video information databases (701), video index information databases (702), retrieval information delivery files (703), and retrieval device (704) are provided on a network, and any retrieval device (704) on the network can be connected via a given retrieval information delivery file (703) on the network to any of all of the video index information databases (702) and all of the video information databases (701).