Recording medium, apparatus and method of recording data on the same, and apparatus and method of reproducing data from the recording medium

Claim 2

A recording medium according to claim 1, characterized in that said audio data and sub-picture are of a same language.

Claim 3

A recording apparatus for recording reproduction data on a recording medium (10), characterized by comprising: means for generating a plurality of data packs and playback time information (PTS), said data packs containing packets of reproduction data including at least one of audio data, video data and sub-picture data; means for preparing a plurality of data units including playback time information (PTS) and having a stream of data packs to be reproduced within a given time period as a unit; and means for recording said data units on said recording medium (10) in a time-sequentially reproducible manner, time information (PTS) of that data unit which includes a sub-picture to be reproduced within said given time period being later by a predetermined time than time information (PTS) of that data unit which includes audio data or video data to be reproduced within said given time period.

Claim 4

A recording apparatus according to claim 3, characterized in that said audio data and sub-picture are of a same language.

Claim 6

A method according to claim 5, characterized in that said audio data and sub-picture are of a same language.

Claim 7

A reproducing apparatus for reproducing reproduction data from a recording medium (10), characterized by comprising: means (30, 50, 52, 54, 56) for acquiring, from said recording medium (10), a plurality of data units recorded thereon, which become objects to be reproduced in a time sequential manner, each object being reproduced within a given time period, each of said data units being constituted of a stream of a plurality of data packs and playback time information, said data packs containing packets of reproduction data including at least one of audio data, video data and sub-picture data, time information (PTS) of that data unit which includes a sub-picture to be reproduced within a given time period being later by a predetermined time than time information (PTS) of that data unit which includes audio data or video data to be reproduced within said given time period; and means for converting said data unit of said acquired reproduction data to a reproduction signal in accordance with said time information (PTS) included in said data unit and reproducing said reproduction signal, whereby after reproduction data of that data unit which includes audio data or video data to be reproduced within a given time period is reproduced, said reproducing means reproduces reproduction data of said data unit including said sub-picture to be reproduced within said given period.

Claim 8

A reproducing apparatus according to claim 7, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 9

A reproducing apparatus according to claim 7, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 10

A reproducing apparatus according to claim 7, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 11

A reproducing apparatus according to claim 7, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 12

A reproducing apparatus according to claim 7, characterized in that said audio data and said sub-picture are of a same language.

Claim 14

A reproducing method according to claim 13, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 15

A reproducing method according to claim 13, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 16

A reproducing method according to claim 13, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 17

A reproducing method according to claim 13, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 18

A reproducing method according to claim 13, characterized in that said audio data and said sub-picture are of a same language.

Claim 19

A reproducing apparatus for reproducing reproduction data from a recording medium (10), characterized by comprising: means (30, 50, 52, 54, 56) for acquiring, from said recording medium (10), a plurality of data units recorded thereon, which become objects to be reproduced in a time sequential manner, each object being reproduced within a given time period, each of said data units being constituted of a stream of a plurality of data packs and playback time information (PTS), said data packs containing packets of reproduction data including at least one of audio data, video data and sub-picture data; and means for converting said data unit of said acquired reproduction data to a reproduction signal in accordance with said time information (PTS) included in said data unit and reproducing said reproduction signal, whereby after reproduction data of that data unit which includes audio data or video data to be reproduced within a given time period is reproduced, said reproducing means reproduces reproduction data of said data unit including said sub-picture to be reproduced within said given period when a predetermined time previously set elapses.

Claim 20

A reproducing apparatus according to claim 19, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 21

A reproducing apparatus according to claim 19, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 22

A reproducing apparatus according to claim 19, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 23

A reproducing apparatus according to claim 19, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 24

A reproducing apparatus according to claim 19, characterized in that said audio data and said sub-picture are of a same language.

Claim 26

A reproducing method according to claim 25, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 27

A reproducing method according to claim 25, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 28

A reproducing method according to claim 25, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 29

A reproducing method according to claim 25, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 30

A reproducing method according to claim 25, characterized in that said audio data and said sub-picture are of a same language.

Claim 31

A reproducing apparatus for reproducing reproduction data from a recording medium (10), characterized by comprising: means (30, 50, 52, 54, 56) for acquiring, from said recording medium (10), a plurality of data units recorded thereon, which become objects to be reproduced in a time sequential manner, each object being reproduced within a given time period, each of said data units being constituted of a stream of a plurality of data packs and playback time information (PTS), said data packs containing packets of reproduction data including at least one of audio data, video data and sub-picture data; means (4) for setting a delay time (Td) at which reproduction data of that data unit which includes a sub-picture to be reproduced within a given time period after reproduction data of that data unit which includes audio data or video data to be reproduced within said given time period is reproduced; and means (57, 58, 60, 62) for converting said data unit of said acquired reproduction data to a reproduction signal in accordance with said time information (PTS) included in said data unit and reproducing said reproduction signal, whereby after reproduction data of that data unit which includes at least one of audio data and video data to be reproduced within a given time period is reproduced, said reproducing means reproduces reproduction data of said data unit including said sub-picture to be reproduced within said given period when said set delay time (Td) elapses.

Claim 32

A reproducing apparatus according to claim 31, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 33

A reproducing apparatus according to claim 31, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 34

A reproducing apparatus according to claim 31, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 35

A reproducing apparatus according to claim 31, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 36

A reproducing apparatus according to claim 31, characterized in that said audio data and said sub-picture are of a same language.

Claim 37

A reproducing apparatus according to claim 31, characterized in that said sub-picture is displayed as if hidden by a mosaic pattern or black filling for a delay period.

Claim 39

A reproducing method according to claim 38, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 40

A reproducing method according to claim 38, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 41

A reproducing method according to claim 38, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 42

A reproducing method according to claim 38, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 43

A reproducing method according to claim 38, characterized in that said audio data and said sub-picture are of a same language.

Claim 44

A reproducing method according to claim 38, characterized in that said sub-picture is displayed as if hidden by a mosaic pattern or black filling for a delay period.

Claim 45

A reproducing apparatus for reproducing reproduction data from a recording medium (10), characterized by comprising: means (30, 50, 52, 54, 56) for acquiring, from said recording medium (10), a plurality of data units recorded thereon, which become objects to be reproduced in a time sequential manner, each object being reproduced within a given time period, each of said data units being constituted of a stream of a plurality of data packs and playback time information (PTS), said data packs containing packets of reproduction data including at least one of audio data, video data and sub-picture data, said time information (PTS) of that data unit which includes a sub-picture consisting of a playback start time (PTS) and playback stop time (PTS); means (57) for computing a delay time of said data unit including said sub-picture from said playback start time (PTS) and playback stop time (PTS) recorded in said data unit including said sub-picture of said acquired reproduction data; and means (57, 58, 60, 62) for converting said data unit of said acquired reproduction data to a reproduction signal in accordance with said time information (PTS) included in said data unit and reproducing said reproduction signal, whereby after reproduction data of that data unit which includes at least one of audio data and video data to be reproduced within a given time period is reproduced, said reproducing means reproduces reproduction data of said data unit including said sub-picture to be reproduced within said given period when said computed delay time elapses.

Claim 46

A reproducing apparatus according to claim 45, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 47

A reproducing apparatus according to claim 45, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 48

A reproducing apparatus according to claim 45, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 49

A reproducing apparatus according to claim 45, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 50

A reproducing apparatus according to claim 45, characterized in that said audio data and said sub-picture are of a same language.

Claim 51

A reproducing apparatus according to claim 45, characterized in that said sub-picture is displayed as if hidden by a mosaic pattern or black filling for a delay period.

Claim 53

A reproducing method according to claim 52, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 54

A reproducing method according to claim 52, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 55

A reproducing method according to claim 52, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 56

A reproducing method according to claim 52, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 57

A reproducing method according to claim 52, characterized in that said audio data and said sub-picture are of a same language.

Claim 58

A reproducing method according to claim 52, characterized in that said sub-picture is displayed as if hidden by a mosaic pattern or black filling for a delay period.

Claim 59

A reproducing apparatus characterized by comprising: reading means (30, 50, 52, 54, 56) for reading a main picture data unit consisting of a stream of packs of at least one main picture data for reproducing a main picture, an audio data unit consisting of a stream of packs of at least one audio data reproducible in a same time slot as said main picture data unit, and a sub-picture data unit consisting of a stream of packs of at least one sub-picture data reproducible after a predetermined time after reproduction of at least one of said main picture data unit and said audio data unit; first control means (57, 58, 60) for converting at least one of said main picture data unit and audio data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output; and second control means (57, 62) for converting said sub-picture data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output after conversion of at least one of said main picture data unit and audio data unit to said reproduction output by said first control means (57, 58, 60).

Claim 60

A reproducing apparatus according to claim 59, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 61

A reproducing apparatus according to claim 59, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 62

A reproducing apparatus according to claim 59, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 63

A reproducing apparatus according to claim 59, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 64

A reproducing apparatus according to claim 59, characterized in that said audio data and said sub-picture are of a same language.

Claim 65

A reproducing apparatus characterized by comprising: reading means (30, 50, 52, 54, 56) for reading a main picture data unit consisting of a stream of packs of at least one main picture data for reproducing a main picture, an audio data unit consisting of a stream of packs of at least one audio data reproducible in a same time slot as said main picture data unit, and a sub-picture data unit consisting of a stream of packs of at least one sub-picture data reproducible in said same time slot as said main picture data unit; first control means (57, 58, 60) for converting at least one of said main picture data unit and audio data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output; and second control means (57, 62) for converting said sub-picture data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output when a predetermined time previously set elapses after conversion of at least one of said main picture data unit and audio data unit to said reproduction output by said first control means (57, 58, 60).

Claim 66

A reproducing apparatus according to claim 65, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 67

A reproducing apparatus according to claim 65, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 68

A reproducing apparatus according to claim 65, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 69

A reproducing apparatus according to claim 65, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 70

A reproducing apparatus according to claim 65, characterized in that said audio data and said sub-picture are of a same language.

Claim 71

A reproducing apparatus characterized by comprising: reading means (30, 50, 52, 54, 56) for reading a main picture data unit consisting of a stream of packs of at least one main picture data for reproducing a main picture, an audio data unit consisting of a stream of packs of at least one audio data reproducible in a same time slot as said main picture data unit, and a sub-picture data unit consisting of a stream of packs of at least one sub-picture data reproducible after a predetermined time after reproduction of at least one of said main picture data unit and said audio data unit; setting means (4) for setting a delay time (Td) at which said sub-picture data unit is reproduced after reproduction of at least one of said main picture data unit and audio data unit; first control means (57, 58, 60) for converting at least one of said main picture data unit and audio data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output; and second control means (57, 62) for converting said sub-picture data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output when said delay time (Td) set by said setting means (4) elapses after conversion of at least one of said main picture data unit and audio data unit to said reproduction output by said first control means (57, 62).

Claim 72

A reproducing apparatus according to claim 71, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 73

A reproducing apparatus according to claim 71, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 74

A reproducing apparatus according to claim 71, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 75

A reproducing apparatus according to claim 71, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 76

A reproducing apparatus according to claim 71, characterized in that said audio data and said sub-picture are of a same language.

Claim 77

A reproducing apparatus according to claim 71, characterized in that said sub-picture is displayed as if hidden by a mosaic pattern or black filling for a delay period.

Claim 78

A reproducing apparatus characterized by comprising: reading means (30, 50, 52, 54, 56) for reading a main picture data unit consisting of a stream of packs of at least one main picture data for reproducing a main picture, an audio data unit consisting of a stream of packs of at least one audio data reproducible in a same time slot as said main picture data unit, and a sub-picture data unit consisting of a stream of packs of at least one sub-picture data reproducible after a predetermined time after reproduction of at least one of said main picture data unit and said audio data unit, a playback start time (PTS) and playback stop time (PTS) being recorded in said sub-picture data unit; means (57) for computing a delay time (Td) of said sub-picture data unit from said playback start time (PTS) and playback stop time (PTS) in said sub-picture data unit, read by said reading means (30, 50, 52, 54, 56); first control means (57, 58, 60) for converting at least one of said main picture data unit and audio data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output; and second control means (57, 62) for converting said sub-picture data unit, read by said reading means (30, 50, 52, 54, 56), to a reproduction output when said delay time (Td) computed by said computing means (57) elapses after conversion of at least one of said main picture data unit and audio data unit to said reproduction output by said first control means (57, 62).

Claim 79

A reproducing apparatus according to claim 78, characterized in that after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced, and reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced again after reproduction of said reproduction data of said data unit including said sub-picture is completed.

Claim 80

A reproducing apparatus according to claim 78, characterized in that when a predetermined time elapses after reproduction data of said data unit including audio data and reproduction data of said data unit including video data are simultaneously reproduced, reproduction data of said data unit including a sub-picture is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 81

A reproducing apparatus according to claim 78, characterized in that while reproduction data of said data unit including video data is being reproduced at a predetermined point of time, reproduction data of said data unit including a sub-picture is reproduced, and when reproduction of said reproduction data of said data unit including said sub-picture is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 82

A reproducing apparatus according to claim 78, characterized in that when a predetermined time elapses after reproduction data of said data unit including video data and reproduction data of said data unit including a sub-picture are simultaneously reproduced, reproduction data of said data unit including audio data is reproduced while said reproduction data of said data unit including video data at that point of time is kept reproduced, and when reproduction of said reproduction data of said data unit including said audio data is completed, reproduction data of said data unit including audio data and reproduction data of said data unit including video data, both data being associated with that point of time, are simultaneously reproduced.

Claim 83

A reproducing apparatus according to claim 78, characterized in that said audio data and said sub-picture are of a same language.

Claim 84

A reproducing apparatus according to claim 78, characterized in that said sub-picture is displayed as if hidden by a mosaic pattern or black filling for a delay period.