US5583652A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Synchronized, variable-speed playback of digitally recorded audio and video
Assignee: International Business Machines Corp
•
Filing: 1994-04-28
•
Granted: 1996-12-10
•
Expires: 2014-04-28
Abstract
Abstract Method and system for providing user-controlled, continuous, synchronized variable-speed playback of a previously recorded digital audio/video presentation. The user directly controls the rate of playback and the audio and video remain synchronized. The audio is expanded or compressed using the time domain harmonic scaling method so that the pitch of the audio remains undistorted. Synchronization is maintained by allowing one clock to serve as the master time clock for the system. The clocks which can serve as the master time clock include the audio decoder clock, the video decoder clock, and the system clock. The invention is particularly useful in multimedia display systems designed to display MPEG data.
Inventors
- 👤 Malcolm S. Ware
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 10:03
CPC Classifications
G; G11; G11B; G11B20/00; H; H04; H04N; H04N21/00; H04N21/40; H04N21/43; H04N21/434; H04N21/4341; G10; G10H; G10H1/00; G10H1/0033; G10H1/36; G10H1/361; G10H1/368; G11B20/00007; G11B20/10; G11B20/10527; G11B27/00; G11B27/005; G11B27/10; H04N21/4302; H04N21/4307; H04N21/43072; H04N21/47; H04N21/472; H04N21/47217; H04N5/00; H04N5/04; H04N5/06; H04N5/067; H04N5/073; H04N5/76; H04N5/78; H04N5/782; H04N5/783; H04N5/91; H04N5/93; H04N5/937; H04N7/00; H04N7/24; H04N7/52; H04N7/54; H04N7/56; G10H2240/00; G10H2240/011; G10H2240/046; G10H2240/066; G10H2250/00; G10H2250/541; G10H2250/571; G11B20/14; G11B2020/10537; G11B2020/10546; G11B2020/10555; G11B2020/1062; G11B2020/10629; G11B2020/10638; G11B2020/10805; G11B2020/10814; G11B2220/00; G11B2220/20; G11B2220/25; G11B2220/2537; H04N5/44; H04N5/60; H04N5/602; H04N5/84; H04N5/85; H04N9/00; H04N9/79; H04N9/80; H04N9/804; H04N9/8042
Claims Analysis
Total Claims: 15
Claim 1
Independent Claim
286 words
In a variable-speed, digital audio/video playback system, a method of maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where an audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the method comprising the steps of: placing at least 2 frames of digital audio in an audio buffering means and at least 2 frames of digital video in a video buffering means; reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; decoding, scaling and playing, if the audio buffering means is not empty, an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; decoding and displaying, if the video buffering means is not empty, a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the current audio playback time period; reading a frame of video from the video data stream into the video buffering means and a frame of audio from the audio data stream into the audio buffering means if the end of the data streams has not been reached; and re-reading the value of the user-selected audio scaling factor C in preparation for scaling and playing the next audio frame from the audio buffering means if the user-selected value to be assigned to C has been changed since the start of the immediately preceding audio playback time period.
Claim 2
Dependent Claim
286 words
In a variable-speed, digital audio/video playback system, a method of maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where an audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the method comprising the steps of: placing at least 2 frames of digital audio in an audio buffering means and at least 2 frames of digital video in a video buffering means; reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; decoding, scaling and playing, if the audio buffering means is not empty, an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; decoding and displaying, if the video buffering means is not empty, a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the current audio playback time period; reading a frame of video from the video data stream into the video buffering means and a frame of audio from the audio data stream into the audio buffering means if the end of the data streams has not been reached; and re-reading the value of the user-selected audio scaling factor C in preparation for scaling and playing the next audio frame from the audio buffering means if the user-selected value to be assigned to C has been changed since the start of the immediately preceding audio playback time period.
Claim 3
Dependent Claim
239 words
In a variable-speed, digital audio/video playback system having an audio buffering means for storing at least 2 frames of digital audio and a video buffering means for storing at least 2 frames of digital video, a method of maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where an audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the method comprising the steps of: reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; decoding, scaling and playing, if the audio buffering means is not empty, an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; decoding and displaying, if the video buffering means is not empty, a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period; and reading a frame of video from the video data stream into the video buffering means and a frame of audio from the audio data stream into the audio buffering means if the end of the data streams has not been reached.
Claim 4
Dependent Claim
239 words
In a variable-speed, digital audio/video playback system having an audio buffering means for storing at least 2 frames of digital audio and a video buffering means for storing at least 2 frames of digital video, a method of maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where an audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the method comprising the steps of: reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; decoding, scaling and playing, if the audio buffering means is not empty, an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; decoding and displaying, if the video buffering means is not empty, a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period; and reading a frame of video from the video data stream into the video buffering means and a frame of audio from the audio data stream into the audio buffering means if the end of the data streams has not been reached.
Claim 5
Dependent Claim
58 words
The method according to claim 2, further comprising the step of: re-reading the value of the user-selected audio scaling factor C in preparation for scaling and playing another audio frame from the audio buffering means if the user-selected value to be assigned to C has been changed since the start of the immediately preceding audio playback time period.
Claim 6
Dependent Claim
265 words
A digital audio/video playback system for playing digitally encoded, simultaneous audio and video at variable speeds while maintaining synchronization between the audio and video, the system comprising: means for receiving digital audio data and digital video data from a source; video buffering means capable of holding at least two frames of video, the video buffering means connected to the receiving means; audio buffering means capable of holding at least two frames of audio, the audio buffering means connected to the receiving means; means for displaying a plurality of video frames in succession; means for generating sounds from electronic signals; and apparatus for maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where each audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the apparatus disposed between the audio and video buffering means and the generating and displaying means, the apparatus including: means for reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; means for decoding, scaling and playing an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; and means for decoding and displaying a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period.
Claim 7
Dependent Claim
265 words
A digital audio/video playback system for playing digitally encoded, simultaneous audio and video at variable speeds while maintaining synchronization between the audio and video, the system comprising: means for receiving digital audio data and digital video data from a source; video buffering means capable of holding at least two frames of video, the video buffering means connected to the receiving means; audio buffering means capable of holding at least two frames of audio, the audio buffering means connected to the receiving means; means for displaying a plurality of video frames in succession; means for generating sounds from electronic signals; and apparatus for maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where each audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the apparatus disposed between the audio and video buffering means and the generating and displaying means, the apparatus including: means for reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; means for decoding, scaling and playing an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; and means for decoding and displaying a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period.
Claim 8
Dependent Claim
206 words
Apparatus for maintaining synchronization during variable-speed playback of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where an audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the apparatus comprising: means for receiving digital audio data and digital video data from a source; video buffering means capable of holding at least two frames of video, the video buffering means connected to the receiving means; audio buffering means capable of holding at least two frames of audio, the audio buffering means connected to the receiving means; means for reading a value for a user-selected audio scaling factor, C, where C is proportion of the originally recorded specified rate; means for decoding, scaling and playing an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; and means for decoding and displaying a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period.
Claim 9
Dependent Claim
206 words
Apparatus for maintaining synchronization during variable-speed playback of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where an audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the apparatus comprising: means for receiving digital audio data and digital video data from a source; video buffering means capable of holding at least two frames of video, the video buffering means connected to the receiving means; audio buffering means capable of holding at least two frames of audio, the audio buffering means connected to the receiving means; means for reading a value for a user-selected audio scaling factor, C, where C is proportion of the originally recorded specified rate; means for decoding, scaling and playing an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; and means for decoding and displaying a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period.
Claim 10
Dependent Claim
271 words
A digital audio/video playback subsystem for playing digitally encoded, simultaneous audio and video at variable speeds while maintaining synchronization between the audio and video, the system comprising: means for receiving digital audio data and digital video data from a source; video buffering means capable of holding at least two frames of video, the video buffering means connected to the receiving means; audio buffering means capable of holding at least two frames of audio, the audio buffering means connected to the receiving means; means for connection to apparatus for displaying a plurality of video frames in succession; means for connection to apparatus for generating sounds from electronic signals; and apparatus for maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where each audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the apparatus disposed between the audio and video buffering means and the connection means, the apparatus including: means for reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; means for decoding, scaling and playing an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; and means for decoding and displaying a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period.
Claim 11
Dependent Claim
271 words
A digital audio/video playback subsystem for playing digitally encoded, simultaneous audio and video at variable speeds while maintaining synchronization between the audio and video, the system comprising: means for receiving digital audio data and digital video data from a source; video buffering means capable of holding at least two frames of video, the video buffering means connected to the receiving means; audio buffering means capable of holding at least two frames of audio, the audio buffering means connected to the receiving means; means for connection to apparatus for displaying a plurality of video frames in succession; means for connection to apparatus for generating sounds from electronic signals; and apparatus for maintaining synchronization of a stream of digital video data with a stream of digital audio data originally recorded at a specified rate in frames per second where each audio frame comprises samples recorded in a fixed period of time corresponding to an associated video frame recording rate in frames per second, the apparatus disposed between the audio and video buffering means and the connection means, the apparatus including: means for reading a value for a user-selected audio scaling factor, C, where C is a proportion of the originally recorded specified rate; means for decoding, scaling and playing an audio frame from the audio buffering means using the scaling factor C so that playback of the audio frame requires an audio playback time period inversely proportional to C; and means for decoding and displaying a frame of video from the video buffering means which corresponds to the currently playing audio frame, for a time period equal to the audio playback time period.
Claim 12
Independent Claim
188 words
A system for providing synchronized display of video and audio data, a synchronized rate being set by a scaling factor input which may be varied, the system for being connected to a source of synchronized digital audio and video data, the system comprising: means for buffering digital video data received from the source; system clocking means, the system clocking means being controlled by the scaling factor input; means, connected to the digital video buffering means, for outputting the digital video data to a video display, the rate of the outputting being controlled by the system clocking means; means for buffering digital audio data from the source; means, connected to the digital audio buffering means, for scaling and outputting the digital audio data to a sound generating means, the digital audio data outputting means controlling the scaling and the output rate of the digital audio data based upon the system clocking means so that the output of the scaled, digital audio data is in synchronism with the output of the digital video data; means for connection to a sound generating means; and means for connection to a video display.
Claim 13
Independent Claim
188 words
A system for providing synchronized display of video and audio data, a synchronized rate being set by a scaling factor input which may be varied, the system for being connected to a source of synchronized digital audio and video data, the system comprising: means for buffering digital video data received from the source; system clocking means, the system clocking means being controlled by the scaling factor input; means, connected to the digital video buffering means, for outputting the digital video data to a video display, the rate of the outputting being controlled by the system clocking means; means for buffering digital audio data from the source; means, connected to the digital audio buffering means, for scaling and outputting the digital audio data to a sound generating means, the digital audio data outputting means controlling the scaling and the output rate of the digital audio data based upon the system clocking means so that the output of the scaled, digital audio data is in synchronism with the output of the digital video data; means for connection to a sound generating means; and means for connection to a video display.
Claim 14
Dependent Claim
17 words
The system according to claim 7 further comprising: a sound generating means for playing digitally encoded sounds.
Claim 15
Independent Claim
27 words
The system according to either of claims 7 or 8 further comprising: a video display for displaying a plurality of frames of digital video data in succession.
References Cited (Backward Citations)
US4794465A
Cited
US4994912A
Cited
EP0407970A2
Cited
US5045940A
Cited
EP0534620A2
Cited
US5420801A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-12-10 | 2000-06-10 | 2000-12-10 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-12-10 | 2004-06-10 | 2004-12-10 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-12-10 | 2008-06-10 | 2008-12-10 | $7700.00 | Window Closed / Lapsed |