US5838874A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Audiovisual encoding system with a reduced number of audio encoders
Assignee: Toshiba Corp
•
Filing: 1995-06-06
•
Granted: 1998-11-17
•
Expires: 2015-06-06
Abstract
Abstract An audiovisual encoding system using a multipass video encoder and a plurality of one-pass audio encoders. The number of audio encoders used by the system is equal to the number of audio tracks to be encoded divided by the number of passes required for the video encoding rounded up to the nearest integer, if necessary. The system allows the video encoder and audio encoders to be used at the same time so that the encoding of the video is completed at the same time as the encoding of all audio tracks is completed, using the minimum number of audio encoders.
Inventors
- 👤 Sheau-Bao Ng
- 👤 Mikhail Tsinberg
- 👤 Masaru Sakurai
- 👤 David Lehmann
- 👤 Jay Yogeshwar
- 👤 Faramarz Azadegan
- 👤 Teiichi Ichikawa
- 👤 Hiroaki Unno
- 👤 Hideki Mimura
- 👤 Tetsuya Kitamura
- 👤 Christopher J. Cookson
- 👤 Greg B. Thagard
- 👤 Andrew Drusin Rosen
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-29 13:14
CPC Classifications
H; H04; H04N; H04N9/00; H04N9/79; H04N9/80; H04N9/804; H04N9/806; H04N9/8063; G; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G11B27/10; G11B27/34; G11B27/36; H04N19/00; H04N19/10; H04N19/102; H04N19/115; H04N19/124; H04N19/134; H04N19/146; H04N19/15; H04N19/154; H04N19/157; H04N19/159; H04N19/162; H04N19/169; H04N19/17; H04N19/172; H04N19/189; H04N19/192; H04N19/50; H04N19/503; H04N19/60; H04N19/61; H04N5/00; H04N5/76; H04N5/91; H04N5/92; H04N5/926; H04N5/9261; H04N5/9262; H04N7/00; H04N7/24; H04N7/52; H04N9/8042; G11B2220/00; G11B2220/20; G11B2220/25; G11B2220/2537; G11B2220/2562; G11B2220/90; G11B2220/91; G11B2220/913; G11B27/19; G11B27/28; G11B27/30; G11B27/3027; G11B27/32; G11B27/327; G11B27/329; H04N19/30
Claims Analysis
Total Claims: 43
Claim 1
Independent Claim
88 words
A method of performing multipass video encoding and one-pass audio encoding for an audiovisual sequence having a plurality of audio tracks, comprising the steps of: performing a first video encoding pass of video of the audiovisual sequence while simultaneously performing one-pass audio encoding of at least one but not all of said plurality of audio tracks; and performing a subsequent video encoding pass of said video of the audiovisual sequence while performing one-pass audio encoding of at least one of said plurality of audio tracks which is unencoded.
Claim 2
Independent Claim
88 words
A method of performing multipass video encoding and one-pass audio encoding for an audiovisual sequence having a plurality of audio tracks, comprising the steps of: performing a first video encoding pass of video of the audiovisual sequence while simultaneously performing one-pass audio encoding of at least one but not all of said plurality of audio tracks; and performing a subsequent video encoding pass of said video of the audiovisual sequence while performing one-pass audio encoding of at least one of said plurality of audio tracks which is unencoded.
Claim 3
Dependent Claim
47 words
A method according to claim 1, wherein: one of the one-pass audio encoding steps is always performed whenever one of the video encoding passes is being performed; and one of the video encoding passes is always performed whenever one of the one-pass audio encodings is being performed.
Claim 4
Dependent Claim
58 words
A method according to claim 1, wherein: said step of performing one-pass audio encoding during the first video encoding pass encodes four audio encoding tracks; and said step of performing one-pass audio encoding during the subsequent video encoding pass encodes four audio tracks which are different from the four audio tracks encoded during the first video encoding pass.
Claim 5
Dependent Claim
112 words
A method according to claim 1, wherein: exactly four audio encoders are used to perform the audio encoding; the multipass video encoding is a two-pass video encoding; the plurality of audio tracks is five to eight audio tracks; said step of performing the one-pass audio encoding during the first video encoding pass encodes at least. one of the plurality of audio tracks; said step of performing the one-pass audio encoding during the subsequent video encoding pass encodes at least one of the plurality of audio tracks; and said steps of performing the one pass audio encoding during the first and subsequent video encoding passes encode each of the plurality of audio tracks.
Claim 6
Dependent Claim
58 words
A method according to claim 1, further comprising the step of: repeating said step of performing a subsequent video encoding pass while performing one-pass audio encoding until all video encoding passes are complete and each of said plurality of audio tracks are encoded, whenever all video encoding passes are not complete and all audio tracks are not encoded.
Claim 7
Dependent Claim
20 words
A method according to claim 1, wherein said video encoding steps encode into a Moving Pictures Expert Group (MPEG) format.
Claim 8
Dependent Claim
72 words
A method according to claim 1, wherein: a number of the plurality of audio tracks divided by a number of passes used for the video encoding is not an integer; said step of performing one-pass audio encoding during the first video encoding pass uses a number of one-pass audio encoders which differs in number by one compared to a number of one pass audio encoders used during the subsequent video encoding pass.
Claim 9
Dependent Claim
47 words
A method according to claim 1, wherein: the step of performing a subsequent video pass generates encoded video; and the steps of performing one pass audio encoding generate encoded audio, said method further comprises the step of: formatting the encoded video and audio into a digital bitstream.
Claim 10
Dependent Claim
19 words
A method according to claim 8, further comprising the step of: transferring the digital bitstream to a storage medium.
Claim 11
Dependent Claim
18 words
A method according to claim 9, wherein said transferring step includes creating an optical disc containing said bitstream.
Claim 12
Dependent Claim
19 words
A method according to claim 8, further comprising the step of: pressing an optical disc containing said digital bitstream.
Claim 13
Dependent Claim
34 words
A method according to claim 1, further comprising the steps of: obtaining video encoded during the video encoding passes using a camera; and obtaining audio encoded during the audio encoding passes using a microphone.
Claim 14
Dependent Claim
288 words
A memory containing data structures for storing video generated according to claim 1, audio generated according to claim 1, and information used for processing of menus, comprising: a data structure stored in said memory including: a field for storing a number of menu cells, a cell being a unit of information; a field for a start cell of a title menu; a field for a start cell of an audio selection menu; a field for a start cell of a menu used to select sub-picture information, the sub-picture information being used to present bit mapped information different from the video; a field for a start cell for a menu used to select a plurality of programs, when a plurality of programs exist in the memory; and a field for a start cell for an angle menu used to select a camera angle, when a plurality of angle views exist in the memory; a menu cell information table containing table entries for each menu to be displayed, each of said table entries including: a field indicating whether a menu corresponding to the table entry is a title menu, a program menu, an audio menu, a sub-picture menu, or an angle menu; a field indicating a number of selection items; a field describing at least a portion of a system clock reference of a start portion of the corresponding menu cell; a field describing a start address of the corresponding menu cell; and a field describing a number of blocks of the corresponding menu cell; a data structure for storing information displayed for each menu; a data structure for storing said audio generated according to claim 1; and a data structure for storing said video generated according to claim 1.
Claim 15
Dependent Claim
13 words
A memory according to claim 13, wherein the memory is an optical disc.
Claim 16
Dependent Claim
257 words
A memory containing data structures for storing video generated according to claim 1, audio generated according to claim 1, and file management information, comprising: a data structure for storing file management information, including: a file management table storing address and size information of information in the memory; a sequence information table storing information describing an order in which cells are reproduced, a cell being a unit of information, the sequence information table including a table entry for each sequence, each table entry including: a field storing whether a corresponding sequence is a completion-type sequence which terminates after being reproduced, a head of a connection-type sequence which is part of sequences which are sequentially reproduced, a mid of a connection-type sequence, and an end of a connection-type sequence; a field storing a number of cells in the corresponding sequence; a field storing a reproduction time of the corresponding sequence; and a field storing a sequence which is reproduced after the corresponding sequence; a cell information table storing information describing cells, the cell information table including a table entry for each cell, each table entry including: a field describing a reproduction time of a corresponding cell; a field describing at least a portion of a system clock reference of the corresponding cell a field describing an address of the corresponding cell; and a field describing a number of logical blocks of the corresponding cell; a data structure for storing said audio generated according to claim 1; and a data structure for storing said video generated according to claim 1.
Claim 17
Dependent Claim
13 words
A memory according to claim 15, wherein the memory is an optical disc.
Claim 18
Dependent Claim
167 words
A memory containing data structures for storing video generated according to claim 1, audio generated. according to claim 1, and descriptive information including timing information, comprising: a data structure containing descriptive information, including: a field for storing a system clock reference of the descriptive information data structure; a field for storing a start time of a corresponding video picture which is decoded without reference to other pictures; a field for storing a time stamp of audio information having a reproduction start time immediately before the reproduction start time of said corresponding video picture; a field for storing an address of said audio information, a first bit indicating whether the audio information is located before or after the description information data structure; and a field describing addresses of other descriptive information data structures occurring both before and after said descriptive information data structure; a data structure for storing said audio generated according to claim 1; and a data structure for storing said video generated according to claim 1.
Claim 19
Dependent Claim
13 words
A memory according to claim 17, wherein the memory is an optical disc.
Claim 20
Dependent Claim
164 words
A memory containing data structures for storing video generated according to claim 1, audio generated according to claim 1, and sub-picture information, comprising: a data structure stored in said memory for storing a sub-picture unit, including: a field for storing a sub-picture unit header; a field for storing a bit mapped image; and a field for storing a display control table including a plurality of table entries, each of said table entries including: a sub-field which stores a display start time of the bit-mapped image; a sub-field which stores an address of a subsequent table entry; and a sub-field for storing at least one display control command selected from a group of commands which include a commands indicating a display area, pixel color, pixel contrast, and color and contrast changes of the pixels which occur as video frames are displayed; a data structure for storing audio generated according to claim 1; and a data structure for storing said video generated according to claim 1.
Claim 21
Dependent Claim
25 words
A memory according to claim 19, wherein the sub-picture unit data structure comprises a plurality of packs containing information in the sub-picture unit data structure.
Claim 22
Dependent Claim
13 words
A memory according to claim 20, wherein the memory is an optical disc.
Claim 23
Independent Claim
157 words
A method of encoding an audiovisual work, comprising the steps of: determining a number of passes required to encode a video portion of the audiovisual work; determining a number of audio tracks of the audiovisual work to be encoded; determining a number of one-pass audio encoders for encoding the audio tracks of the audiovisual work by dividing the number of audio tracks to be encoded by the number of passes required to encode the video portion and rounding a result of the division up to a nearest integer if the result of the division is not an integer; performing a first video encoding pass of video of the audiovisual work while simultaneously performing ones-pass audio encoding of at least one but not all of said audio tracks; and performing a subsequent video encoding pass of said video of the audiovisual sequence while performing one-pass audio encoding of at least one of said audio tracks which is unencoded.
Claim 24
Independent Claim
157 words
A method of encoding an audiovisual work, comprising the steps of: determining a number of passes required to encode a video portion of the audiovisual work; determining a number of audio tracks of the audiovisual work to be encoded; determining a number of one-pass audio encoders for encoding the audio tracks of the audiovisual work by dividing the number of audio tracks to be encoded by the number of passes required to encode the video portion and rounding a result of the division up to a nearest integer if the result of the division is not an integer; performing a first video encoding pass of video of the audiovisual work while simultaneously performing ones-pass audio encoding of at least one but not all of said audio tracks; and performing a subsequent video encoding pass of said video of the audiovisual sequence while performing one-pass audio encoding of at least one of said audio tracks which is unencoded.
Claim 25
Dependent Claim
58 words
A method according to claim 22, further comprising the step of: repeating said step of performing a subsequent video encoding pass while performing one-pass audio encoding until all video encoding passes are complete and each of said plurality of audio tracks are encoded, whenever all video encoding passes are not complete and all audio tracks are not encoded.
Claim 26
Dependent Claim
179 words
An audiovisual encoding system for encoding an audiovisual work with a plurality of audio tracks, comprising: a multipass video encoder; a plurality of one pass audio encoders which equal a number of said audio tracks divided by a number of passes required by the multipass video encoder to encode a video portion of the audiovisual work, rounded up to a nearest integer if a result of the division is not an integer; a controller, connected to the multipass video encoder and the plurality of audio encoders, for controlling the video and one-pass audio encoders and instructing the video encoder to perform a first video encoding pass of video of the audiovisual work which occurs at a same time as a one-pass audio encoding of at least one but not all of said plurality of audio tracks, and instructs the video encoder to perform a subsequent video encoding pass of said video of the audiovisual work which occurs at a same time as a one-pass audio encoding of at least one of said plurality of audio tracks which is unencoded.
Claim 27
Dependent Claim
179 words
An audiovisual encoding system for encoding an audiovisual work with a plurality of audio tracks, comprising: a multipass video encoder; a plurality of one pass audio encoders which equal a number of said audio tracks divided by a number of passes required by the multipass video encoder to encode a video portion of the audiovisual work, rounded up to a nearest integer if a result of the division is not an integer; a controller, connected to the multipass video encoder and the plurality of audio encoders, for controlling the video and one-pass audio encoders and instructing the video encoder to perform a first video encoding pass of video of the audiovisual work which occurs at a same time as a one-pass audio encoding of at least one but not all of said plurality of audio tracks, and instructs the video encoder to perform a subsequent video encoding pass of said video of the audiovisual work which occurs at a same time as a one-pass audio encoding of at least one of said plurality of audio tracks which is unencoded.
Claim 28
Dependent Claim
42 words
A system according to claim 24, wherein: whenever a video encoding pass is occurring, there is always at least one audio track being encoded, and whenever one of the audio tracks is being encoded, there is always a video encoding pass occurring.
Claim 29
Dependent Claim
69 words
A system according to claim 24, wherein: the multipass video encoding is a two-pass video encoding and the plurality of audio tracks is eight audio tracks; and the plurality of one-pass audio encoders is four one-pass audio encoders, and four of the eight audio tracks are encoded during the first video encoding pass and another four of the eight audio tracks are encoded during a second video encoding pass.
Claim 30
Dependent Claim
90 words
A system according to claim 24, wherein: exactly four one-pass audio encoders are used to perform the audio encoding; the multipass video encoding is a two-pass video encoding; the plurality of audio tracks is five to eight audio tracks; and at least one of the plurality of audio tracks is encoded during the first video encoding pass, at least one of the plurality of audio tracks is encoded during the subsequent video encoding pass, and all audio tracks are encoded after the first and subsequent video encoding passes are completed.
Claim 31
Dependent Claim
59 words
A system according to claim 24, wherein the controller comprises: means for repeating said step of performing a subsequent video encoding pass while performing one-pass audio encoding until all video encoding passes are complete and each of said plurality of audio tracks are encoded, whenever all video encoding passes are not complete and all audio tracks are not encoded.
Claim 32
Dependent Claim
19 words
A system according to claim 24, wherein said video encoder encodes into a Moving Pictures Expert Group (MPEG) format.
Claim 33
Dependent Claim
61 words
A system according to claim 24, wherein: a number of the plurality of audio tracks divided by a number of passes used for the video encoding is a non-integer; and a number of audio encoders used during the first video encoding pass differs in number by 1 compared to a number of audio encoders used during the subsequent video encoding pass.
Claim 34
Dependent Claim
38 words
A system according to claim 24, wherein: the multipass video encoder generates encoded video; and the one-pass audio encoders generate encoded audio, said system further comprising: means for formatting the encoded video and audio into a digital bitstream.
Claim 35
Dependent Claim
18 words
A system according to claim 31, further comprising: means for transferring the digital bitstream to a storage medium.
Claim 36
Dependent Claim
20 words
A system according to claim 32, wherein said transferring means includes means for creating an optical disc containing said bitstream.
Claim 37
Dependent Claim
18 words
A system according to claim 31, further comprising: means for pressing an optical disc containing said digital bitstream.
Claim 38
Dependent Claim
51 words
A method according to claim 1, wherein: the step of performing a first video encoding pass comprises generating information of said video during the first video encoding pass; and the step of performing the subsequent video encoding pass comprises performing the subsequent video encoding pass of said video using said information.
Claim 39
Dependent Claim
54 words
A method according to claim 35, wherein: the step of performing a first video encoding pass comprises generating statistics as said information of said video during the first video encoding pass; and the step of performing the subsequent video encoding pass comprises performing the subsequent video encoding pass of said video using said statistics.
Claim 40
Dependent Claim
51 words
A method according to claim 22, wherein: the step of performing a first video encoding pass comprises generating information of said video during the first video encoding pass; and the step of performing the subsequent video encoding pass comprises performing the subsequent video encoding pass of said video using said information.
Claim 41
Dependent Claim
54 words
A method according to claim 37, wherein: the step of performing a first video encoding pass comprises generating statistics as said information of said video during the first video encoding pass; and the step of performing the subsequent video encoding pass comprises performing the subsequent video encoding pass of said video using said statistics.
Claim 42
Dependent Claim
46 words
A system according to claim 24, wherein the controller controls the video encoder to perform a first video encoding pass which generates information of said video during the first video encoding pass, and to perform the subsequent video encoding pass of said video using said information.
Claim 43
Dependent Claim
49 words
A system according to claim 39, wherein the controller controls the video encoder to perform the first video encoding pass which generates statistics as said information of said video during the first video encoding pass, and to perform the subsequent video encoding pass of said video using said statistics.
References Cited (Backward Citations)
US4516166A
Cited
US4729044A
Cited
US4746994B1
Cited
US4746994A
Cited
US4743981A
Cited
US4914527A
Cited
US4942476A
Cited
US4965675A
Cited
US4914523A
Cited
US5055939A
Cited
US4963995A
Cited
US5130812A
Cited
US5136395A
Cited
US5206929A
Cited
US5218672A
Cited
US5267092A
Cited
US5270828A
Cited
US5371605A
Cited
US5307456A
Cited
US5309290A
Cited
US5386323A
Cited
US5388197A
Cited
US5294995A
Cited
US5305113A
Cited
US5381274A
Cited
US5305438A
Cited
US5381275A
Cited
US5455684A
Cited
US5367341A
Cited
US5394477A
Cited
JPH06326435A
Cited
JPH0781298A
Cited
JPH0785693A
Cited
US5400077A
Cited
US5508940A
Cited
EP0742674A2
Cited
WO1996035999A1
Cited
WO1996035998A1
Cited
WO1996036170A1
Cited
WO1997003443A1
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2001-11-16 | 2002-05-18 | 2002-11-17 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2005-11-16 | 2006-05-18 | 2006-11-17 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2009-11-16 | 2010-05-18 | 2010-11-17 | $7700.00 | Window Closed / Lapsed |