US5617502A
Expired / Lapsed
US
⏱️ 0.0 years remaining
System and method synchronizing audio and video digital data signals during playback
Assignee: Cirrus Logic Inc
•
Filing: 1996-03-22
•
Granted: 1997-04-01
•
Expires: 2016-03-22
Abstract
Abstract A method and system for synchronizing audio and video data signals that are in a signal format wherein the audio and video data signals are not interleaved but originate from separate sources and arrive at a constant frame rate. In one embodiment, the audio and video data signals are in an Moving Pictures Expert Group (MPEG) format. Portions of the novel system operate within the hardware of a video processor unit and portions of the novel system operate within a software driver of a computer system that receives the audio and video data signals. Audio and video data signals are referenced by a presentation time stamp (e.g., VPTS for video and APTS for audio) encoded in the data. Using these stamps, the novel system (via the video processor unit) determines if the video signal is ahead or behind the audio signal by a small number of frames, x, and if so, the video processor unit either pauses or skips frames in its video display unit hardware to regain synchronization. If the video processor unit determines that the video signal is ahead or behind the audio signal by more than x frames, a software driver operating on the computer system is informed of the difference and the software driver instructs the video processor unit to skip or pause frames within its system parsing unit hardware using a host interrupt driven mechanism to regain synchronization. Using this method, the digital video signal is effectively synchronized to the reference digital audio signal.
Inventors
- 👤 Jeffrey Ort
- 👤 Daniel Daum
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-04 19:38
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/40; H04N21/43; H04N21/434; H04N21/4341; H04N21/4302; H04N21/4305; H04N21/4307; H04N21/43072; H04N21/44; H04N21/44004; H04N5/00; H04N5/76; H04N5/91; H04N5/92; H04N5/926; H04N5/9265; H04N5/9261; H04N5/9262
Claims Analysis
Total Claims: 23
Claim 1
Independent Claim
199 words
In a digital playback system including a video processor unit and a software driver, a method of synchronizing audio and video digital signals during playback thereof, said method comprising the steps of: (a) determining whether said audio and video digital signals are in synchronization or out of synchronization by a small number of frames, x, said step of determining performed by said video processor unit; (b) provided said audio and video digital signals are out of synchronization by x or less frames, performing a first step of synchronizing said video digital signal to said audio digital signal, said first step initiated and performed solely by said video processor unit; and (c) provided said audio and video digital signals are out of synchronization by more than x frames, performing a second step of synchronizing said video digital signal to said audio digital signal, said second step comprising the steps of: (i) said software driver instructing said video processor unit to perform a video frame synchronization procedure; and (ii) said video processor interrupting said software driver during said video frame synchronization procedure on a video frame basis until said software driver determines a completion point of said video frame synchronization procedure.
Claim 2
Dependent Claim
199 words
In a digital playback system including a video processor unit and a software driver, a method of synchronizing audio and video digital signals during playback thereof, said method comprising the steps of: (a) determining whether said audio and video digital signals are in synchronization or out of synchronization by a small number of frames, x, said step of determining performed by said video processor unit; (b) provided said audio and video digital signals are out of synchronization by x or less frames, performing a first step of synchronizing said video digital signal to said audio digital signal, said first step initiated and performed solely by said video processor unit; and (c) provided said audio and video digital signals are out of synchronization by more than x frames, performing a second step of synchronizing said video digital signal to said audio digital signal, said second step comprising the steps of: (i) said software driver instructing said video processor unit to perform a video frame synchronization procedure; and (ii) said video processor interrupting said software driver during said video frame synchronization procedure on a video frame basis until said software driver determines a completion point of said video frame synchronization procedure.
Claim 3
Dependent Claim
86 words
A method as described in claim 1 wherein said first step comprises the steps of: said video processor unit skipping x or less video frames within a buffer of a video display unit of said video processor unit provided said audio digital signal is ahead of said video digital signal, said video display unit containing decoded video data; and said video processor unit pausing x or less video frames, based on a system clock reference, provided said audio digital signal is behind said video digital signal.
Claim 4
Dependent Claim
93 words
A method as described in claim 1 wherein said step of said software driver instructing said video processor unit to perform a video frame synchronization procedure comprises the steps of: said software driver instructing said video processor unit to skip video frames within a system parsing unit containing decompressed video data, provided said audio digital signal is ahead of said video digital signal; and said software driver instructing said video processor unit to pause video frames, based on a system clock reference, provided said audio digital signal is behind said video digital signal.
Claim 5
Dependent Claim
75 words
A method as described in claim 3 wherein said step of said software driver instructing said video processor unit to skip video frames within said system parsing unit comprises the steps of: said software driver instructing said video processor unit to pause playback; said software driver setting skip bits in a control register of said video processor unit; and said software driver instructing said video processor unit to resume playback and skip x video frames.
Claim 6
Dependent Claim
65 words
A method as described in claim 3 wherein said step of said software driver instructing said video processor unit to pause video frames, based on said system clock reference comprises the steps of: said software driver instructing said video processor to pause playback; and said video processor unit pausing a system parsing unit, a decode unit and a video display unit over x video frames.
Claim 7
Dependent Claim
15 words
A method as described in claim 1 wherein said software driver is an MCI driver.
Claim 8
Dependent Claim
22 words
A method as described in claim 1 wherein said audio and video digital signals are of a Motion Picture Expert Group format.
Claim 9
Dependent Claim
16 words
A method as described in claim 1 wherein x is a value from 3 to 4.
Claim 10
Independent Claim
196 words
A method of synchronizing audio and video signals of an MPEG format during playback thereof, said method comprising the steps of: (a) determining whether said audio and video signals are in synchronization or out of synchronization by a small number of frames, x, said step of determining performed by a video processor unit; (b) provided said audio and video signals are out of synchronization by x or less frames, performing a first step of synchronizing said video signal to said audio signal, said first step initiated and performed solely by said video processor unit; and (c) provided said audio and video signals are out of synchronization by more than x frames, performing a second step of synchronizing said video signal to said audio signal, said second step comprising the steps of: (i) instructing said video processor unit, via a software driver, to perform a video synchronization procedure to skip video frames and pause video frames to synchronize to said audio signal; and (ii) said video processor interrupting said software driver during said video synchronization procedure as individual video frames are skipped and paused until said software driver determines a completion point of said video synchronization procedure.
Claim 11
Independent Claim
196 words
A method of synchronizing audio and video signals of an MPEG format during playback thereof, said method comprising the steps of: (a) determining whether said audio and video signals are in synchronization or out of synchronization by a small number of frames, x, said step of determining performed by a video processor unit; (b) provided said audio and video signals are out of synchronization by x or less frames, performing a first step of synchronizing said video signal to said audio signal, said first step initiated and performed solely by said video processor unit; and (c) provided said audio and video signals are out of synchronization by more than x frames, performing a second step of synchronizing said video signal to said audio signal, said second step comprising the steps of: (i) instructing said video processor unit, via a software driver, to perform a video synchronization procedure to skip video frames and pause video frames to synchronize to said audio signal; and (ii) said video processor interrupting said software driver during said video synchronization procedure as individual video frames are skipped and paused until said software driver determines a completion point of said video synchronization procedure.
Claim 12
Dependent Claim
82 words
A method as described in claim 9 wherein said first step comprises the steps of: said video processor unit skipping x or less video frames within a buffer of a video display unit of said video processor unit provided said audio signal is ahead of said video signal, said video display unit containing decoded video data; and said video processor unit pausing x or less video frames, based on a system clock reference, provided said audio signal is behind said video signal.
Claim 13
Dependent Claim
103 words
A method as described in claim 10 wherein said step of instructing said video processor unit, via a software driver, to perform a video synchronization procedure to skip video frames and pause video frames to synchronize to said audio signal comprises the steps of: said software driver instructing said video processor unit to skip video frames within a system parsing unit containing decompressed video data, provided said audio signal is ahead of said video signal; and said software driver instructing said video processor unit to pause video frames, based on a system clock reference, provided said audio signal is behind said video signal.
Claim 14
Dependent Claim
75 words
A method as described in claim 11 wherein said step of said software driver instructing said video processor unit to skip video frames within said system parsing unit comprises the steps of: said software driver instructing said video processor unit to pause playback; said software driver setting skip bits in a control register of said video processor unit; and said software driver instructing said video processor unit to resume playback and skip x video frames.
Claim 15
Dependent Claim
65 words
A method as described in claim 11 wherein said step of said software driver instructing said video processor unit to pause video frames, based on said system clock reference comprises the steps of: said software driver instructing said video processor to pause playback; and said video processor unit pausing a system parsing unit, a decode unit and a video display unit over x video frames.
Claim 16
Dependent Claim
15 words
A method as described in claim 10 wherein said software driver is an MCI driver.
Claim 17
Dependent Claim
16 words
A method as described in claim 10 wherein x is a value from 3 to 4.
Claim 18
Dependent Claim
194 words
A digital playback system for playing back audio and video signals of an MPEG format, said playback system including a computer system and further comprising: (a) a video processor unit coupled to said computer system for determining whether said audio and video signals are in synchronization or out of synchronization by a small number of frames, x; (b) said video processor unit, provided said audio and video signals are out of synchronization by x or less frames, also for performing a first step of synchronizing said video signal to said audio signal, said first step initiated and performed solely by said video processor unit; and (c) a software driver executable within said computer system, and provided said audio and video signals are out of synchronization by more than x frames, said software driver for initiating and controlling a second step of synchronizing said video signal to said audio signal by instructing said video processor unit to perform a video frame synchronization procedure and wherein said video processor is for interrupting said software driver during said video frame synchronization procedure on a video frame basis until said software driver completes said video frame synchronization procedure.
Claim 19
Dependent Claim
194 words
A digital playback system for playing back audio and video signals of an MPEG format, said playback system including a computer system and further comprising: (a) a video processor unit coupled to said computer system for determining whether said audio and video signals are in synchronization or out of synchronization by a small number of frames, x; (b) said video processor unit, provided said audio and video signals are out of synchronization by x or less frames, also for performing a first step of synchronizing said video signal to said audio signal, said first step initiated and performed solely by said video processor unit; and (c) a software driver executable within said computer system, and provided said audio and video signals are out of synchronization by more than x frames, said software driver for initiating and controlling a second step of synchronizing said video signal to said audio signal by instructing said video processor unit to perform a video frame synchronization procedure and wherein said video processor is for interrupting said software driver during said video frame synchronization procedure on a video frame basis until said software driver completes said video frame synchronization procedure.
Claim 20
Dependent Claim
98 words
A system as described in claim 16 wherein said video processor unit comprises: a video display unit having a buffer for storing decoded video data and wherein said video processor unit is for skipping x or less video frames within said buffer provided said audio digital signal is ahead of said video digital by x or less frames; and a system clock reference, wherein said video processor unit is for pausing x or less video frames, based on said system clock reference, provided said audio digital signal is behind said video digital signal by x or less frames.
Claim 21
Dependent Claim
119 words
A system as described in claim 17 wherein said video processor unit further comprises a system parsing unit containing decompressed video data and wherein said software driver is for instructing said video processor unit to skip video frames within said system parsing unit as a first part of said video frame synchronization procedure, provided said audio digital signal is ahead of said video digital signal by more than x frames; and wherein said software driver is also for instructing said video processor unit to pause video frames, based on said system clock reference as a second part of said video frame synchronization procedure, provided said audio digital signal is behind said video digital signal by more than x frames.
Claim 22
Dependent Claim
22 words
A system as described in claim 18 wherein said audio and video digital signals are of a Motion Picture Expert Group format.
Claim 23
Dependent Claim
16 words
A system as described in claim 18 wherein x is a value from 3 to 4.
References Cited (Backward Citations)
US5410343A
Cited
US5333299A
Cited
US5508816A
Cited
US5502573A
Cited
US5396497A
Cited
US5351092A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 2000-03-31 | 2000-09-30 | 2001-04-01 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2004-03-31 | 2004-09-30 | 2005-04-01 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2008-03-31 | 2008-09-30 | 2009-04-01 | $7700.00 | Window Closed / Lapsed |