US5506932A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Synchronizing digital audio to digital video
Assignee: Acoustic Technology LLC
•
Filing: 1993-04-16
•
Granted: 1996-04-09
•
Expires: 2013-04-16
Abstract
Abstract An audio/video input/output (I/O) port apparatus for acquiring digital audio samples from one or multiple channels of input audio and synthesizing digital audio samples into one or multiple channels of output audio. The apparatus comprises a video I/O port, a frequency synthesizer, and an audio I/O port. The video I/O port generates a video-rate clock, and is configured to digitize input video into digital video, and to synthesize output video from digital video. The frequency synthesizer is configured to derive an audio sampling clock based on the video-rate clock. The audio I/O port is configured to sample input audio and convert it into digital audio samples according to the sampling clock, and to synthesize digital audio samples into output audio according to the sampling clock. The apparatus ensures that the video and audio data track together, both when inputting the information from an external source and when outputting the audio/video data streams. The technique is particularly valuable in video editing, where it is critical to establish and maintain synchronization between the video of a speaking person and the audio representing the spoken material.
Inventors
- 👤 Daniel J. Holmes
- 👤 John W. Molnar
- 👤 Morton H. Tarr
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-10-24 06:35
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/40; H04N21/43; H04N21/4302; H04N21/4305; G; G11; G11B; G11B27/00; G11B27/02; G11B27/031; G11B27/034; G11B27/10; H04N21/41; H04N21/426; H04N21/4307; H04N21/43072; H04N21/434; H04N21/4341; H04N5/00; H04N5/04; H04N5/08; H04N5/44; H04N5/60; H04N5/602; H04N5/76; H04N5/765; H04N7/00; H04N7/24; H04N7/52; H04N7/54; H04N7/56; H04N9/00; H04N9/79; H04N9/80; H04N9/802; G11B2220/00; G11B2220/90; G11B27/022; G11B27/024; G11B27/032; G11B27/34; H04N9/64; H04N9/641
Claims Analysis
Total Claims: 43
Claim 1
Independent Claim
152 words
An audio/video input/output (I/O) apparatus for acquiring digital audio samples from one or multiple channels of input audio and, alternately, synthesizing digital audio samples into one or multiple channels of output audio, the apparatus comprising: a video I/O port circuit generating a video-rate clock, said video I/O port circuit comprising a video input port configured to convert input analog video into digital video, and a video output port configured to synthesize output analog video from digital video; and an audio I/O port circuit comprising a frequency synthesizer connected to receive said video-rate clock from said video I/O port and configured to derive am audio sampling clock based on said video-rate clock, an audio input port configured to sample and convert input analog audio into digital audio samples according to said sampling clock, and an audio output port configured to synthesize digital audio samples into output analog audio according to said sampling clock.
Claim 2
Dependent Claim
152 words
An audio/video input/output (I/O) apparatus for acquiring digital audio samples from one or multiple channels of input audio and, alternately, synthesizing digital audio samples into one or multiple channels of output audio, the apparatus comprising: a video I/O port circuit generating a video-rate clock, said video I/O port circuit comprising a video input port configured to convert input analog video into digital video, and a video output port configured to synthesize output analog video from digital video; and an audio I/O port circuit comprising a frequency synthesizer connected to receive said video-rate clock from said video I/O port and configured to derive am audio sampling clock based on said video-rate clock, an audio input port configured to sample and convert input analog audio into digital audio samples according to said sampling clock, and an audio output port configured to synthesize digital audio samples into output analog audio according to said sampling clock.
Claim 3
Dependent Claim
69 words
The audio/video I/O apparatus of claim 1 further comprising: a general purpose computer with a storage device and a peripheral slot; and peripheral interface circuitry installed in said peripheral slot and configured to transfer said digital video and digital audio samples from said audio input and video input ports to said storage device, and to transfer data from said storage device to said audio output and video output ports.
Claim 4
Dependent Claim
34 words
The audio/video I/O apparatus of claim 2 wherein said peripheral interface circuitry further comprises FIFOs for coupling asynchronous operation of said computer to synchronous operation of said video and audio input and output ports.
Claim 5
Dependent Claim
50 words
The audio/video I/O apparatus of claim 2 wherein said peripheral interface circuitry further comprises a CODEC for compressing said digital video into compressed video data for storing on said storage device and for decompressing said video data as they are transferred from said storage device to said video output port.
Claim 6
Dependent Claim
96 words
The audio/video I/O apparatus of claim 1 wherein the video input port circuit further comprises: a detector configured to detect a synchronizing signal in said input analog video; a frequency generator for generating said video-rate clock and clocking said video output port; a pulse generator configured to provide an input synchronization pulse to said audio I/O port circuit, said input synchronization pulse being generated for each frame of said input analog video and being based on said detected synchronizing signal; and a pulse generator configured to provide a synchronizing pulse to said audio I/O port circuit.
Claim 7
Dependent Claim
31 words
The audio/video I/O apparatus of claim 1 wherein said video I/O port circuit further comprises a frequency generator configured to generate said video-rate clock independent of both input and output video.
Claim 8
Dependent Claim
31 words
The audio/video I/O apparatus of claim 1 wherein said frequency synthesizer comprises an m/n phase lock loop to generate said audio sampling clock as an adjustable ratio of said video-rate clock.
Claim 9
Dependent Claim
26 words
The audio/video I/O apparatus of claim 7 wherein said m/n phase lock loop includes an m counter, an n counter, a phase detector, and an oscillator.
Claim 10
Dependent Claim
100 words
The audio/video I/O apparatus of claim 8 further comprising a digital signal processor programmed to: selectively associate a varying number of digital audio samples to each respective frame of said digital video to achieve a precise ratio of the number of said digital audio samples over a finite time to the number of associated frames of said digital video over said finite time; and selectively associate a varying number of said digital audio samples to each respective frame of said digital video as said digital audio samples and said digital video are presented to said video and audio output ports.
Claim 11
Dependent Claim
54 words
The audio/video I/O apparatus of claim 1 wherein said frequency synthesizer further comprises: an oversampled clock synthesizer that generates an oversampled clock whose frequency is at least twice as great as the frequency of said audio sampling clock; and a frequency divider that frequency divides said oversampled clock to generate said audio sampling clock.
Claim 12
Dependent Claim
100 words
The audio/video I/O apparatus of claim 1 further comprising a digital signal processor programmed to: selectively associate a varying number of digital audio samples to each respective frame of said digital video to achieve a precise ratio of the number of said digital audio samples over a finite time to the number of associated frames of said digital video over said finite time; and selectively associate a varying number of said digital audio samples to each respective frame of said digital video as said digital audio samples and said digital video are presented to said video and audio output ports.
Claim 13
Dependent Claim
63 words
The audio/video I/O apparatus of claim 1 wherein said audio input port further comprises: an analog-to-digital converter for converting said input analog audio into said digital audio samples, said analog-to-digital converter being clocked by said audio sampling clock; and a digital-to-analog converter for converting said digital audio samples to said output analog audio, said digital-to-analog converter being clocked by said audio sampling clock.
Claim 14
Dependent Claim
89 words
The audio/video I/O apparatus of claim 1 further comprising: a host computer with a storage device for storing said digital audio samples and said digital video; first and second FIFOs for storing said digital audio samples between said audio input port and said storage device; third and fourth FIFOs for storing said digital audio samples between said storage device and said audio output port; and a digital signal processor for controlling flow of said digital audio samples between said first and second FIFOs and said third and fourth FIFOs.
Claim 15
Dependent Claim
82 words
An audio/video input apparatus for acquiring one or multiple channels of digital audio samples, the apparatus comprising: a video input port configured to convert input analog video into digital video and generate a video-rate clock; a frequency synthesizer connected to receive said video-rate clock from said video input-port and configured derive an audio sampling clock based on said video-rate clock; and an audio input port configured to sample and convert input analog audio into digital audio samples according to said sampling clock.
Claim 16
Dependent Claim
82 words
An audio/video input apparatus for acquiring one or multiple channels of digital audio samples, the apparatus comprising: a video input port configured to convert input analog video into digital video and generate a video-rate clock; a frequency synthesizer connected to receive said video-rate clock from said video input-port and configured derive an audio sampling clock based on said video-rate clock; and an audio input port configured to sample and convert input analog audio into digital audio samples according to said sampling clock.
Claim 17
Dependent Claim
53 words
The audio/video input apparatus of claim 14 further comprising: a general purpose computer with a storage device and a peripheral slot; and peripheral interface circuitry installed in said peripheral slot and configured to transfer said digital video and digital audio samples from said audio input and video input ports to said storage device.
Claim 18
Dependent Claim
33 words
The audio/video input apparatus of claim 15 wherein said peripheral interface circuitry further comprises a FIFO for coupling asynchronous operation of said computer to synchronous operation of said video and audio input ports.
Claim 19
Dependent Claim
31 words
The audio/video input apparatus of claim 15 wherein said peripheral interface circuitry further comprises a CODEC for compressing said digital video into compressed video data for storing on said storage device.
Claim 20
Dependent Claim
65 words
The audio/video input apparatus of claim 14 wherein the video input port further comprises: a detector configured to detect a synchronizing signal of said input analog video; and a pulse generator configured to provide an input synchronization pulse to said audio input port, said input synchronization pulse being generated for each frame of said input analog video and being based on said detected synchronizing signal.
Claim 21
Dependent Claim
28 words
The audio/video input apparatus of claim 14 wherein said video input port further comprises a frequency generator configured to generate said video-rate clock independent of input analog video.
Claim 22
Dependent Claim
31 words
The audio/video input apparatus of claim 14 wherein said frequency synthesizer comprises an m/n phase lock loop to generate said audio sampling clock as an adjustable ratio of said video-rate clock.
Claim 23
Dependent Claim
26 words
The audio/video input apparatus of claim 20 wherein said m/n phase lock loop includes an m counter, an n counter, a phase detector, and an oscillator.
Claim 24
Dependent Claim
63 words
The audio/video input apparatus of claim 21 further comprising: a digital signal processor programmed to selectively associate a varying number of digital audio samples to each respective frame of said digital video to achieve an accurate ratio of the number of said digital audio samples over a finite time to the number of associated frames of said digital video over said finite time.
Claim 25
Dependent Claim
54 words
The audio/video input apparatus of claim 14 wherein said frequency synthesizer further comprises: an oversampled clock synthesizer that generates an oversampled clock whose frequency is at least twice as great as the frequency of said audio sampling clock; and a frequency divider that frequency divides said oversampled clock to generate said audio sampling clock.
Claim 26
Dependent Claim
63 words
The audio/video input apparatus of claim 14 further comprising: a digital signal processor programmed to selectively associate a varying number of digital audio samples to each respective frame of said digital video to achieve an accurate ratio of the number of said digital audio samples over a finite time to the number of associated frames of said digital video over said finite time.
Claim 27
Dependent Claim
38 words
The audio/video input apparatus of claim 14 wherein said audio input port further comprises an analog-to-digital converter for converting said input analog audio into said digital audio samples, said analog-to-digital converter being clocked by said audio sampling clock.
Claim 28
Dependent Claim
64 words
The audio/video input apparatus of claim 14 further comprising: a host computer with a storage device for storing said digital audio samples and said digital video; first and second FIFOs for storing said digital audio samples between said audio input port and said storage device; and a digital signal processor for controlling flow of said digital audio samples between said first and second FIFOs.
Claim 29
Dependent Claim
85 words
An audio/video output apparatus for synthesizing one or multiple channels of digital audio samples into output audio, the apparatus comprising: a video output port configured to synthesize output analog video from digital video and generating a video-rate clock; a frequency synthesizer connected to receive said video-rate clock from said video output port and configured to derive an audio sampling clock based on said video-rate clock; and an audio output port configured to synthesize output analog audio from digital audio samples according to said sampling clock.
Claim 30
Dependent Claim
85 words
An audio/video output apparatus for synthesizing one or multiple channels of digital audio samples into output audio, the apparatus comprising: a video output port configured to synthesize output analog video from digital video and generating a video-rate clock; a frequency synthesizer connected to receive said video-rate clock from said video output port and configured to derive an audio sampling clock based on said video-rate clock; and an audio output port configured to synthesize output analog audio from digital audio samples according to said sampling clock.
Claim 31
Dependent Claim
47 words
The audio/video output apparatus of claim 27 further comprising: a general purpose computer with a storage device and a peripheral slot; and peripheral interface circuitry installed in said peripheral slot and configured to transfer data from said storage device to said audio output and video output ports.
Claim 32
Dependent Claim
33 words
The audio/video output apparatus of claim 28 wherein said peripheral interface circuitry further comprises a FIFO for coupling asynchronous operation of said computer to synchronous operation of said video and audio output ports.
Claim 33
Dependent Claim
33 words
The audio/video output apparatus of claim 28 wherein said video peripheral further comprises a CODEC for decompressing said video data as they are transferred from said storage device to said video output port.
Claim 34
Dependent Claim
43 words
The audio/video output apparatus of claim 27 wherein said video output port further comprises: a frequency generator for generating said video-rate clock and clocking said video output port; and a pulse generator configured to provide a synchronizing pulse to said audio output port.
Claim 35
Dependent Claim
27 words
The audio/video output apparatus of claim 27 wherein said video output port further comprises a frequency generator configured to generate said video-rate clock independent of output video.
Claim 36
Dependent Claim
32 words
The audio/video output port apparatus of claim 27 wherein said frequency synthesizer comprises an m/n phase lock loop to generate said audio sampling clock as an adjustable ratio of said video-rate clock.
Claim 37
Dependent Claim
26 words
The audio/video output apparatus of claim 33 wherein said m/n phase lock loop includes an m counter, an n counter, a phase detector, and an oscillator.
Claim 38
Dependent Claim
54 words
The audio/video output apparatus of claim 27 wherein said frequency synthesizer further comprises: an oversampled clock synthesizer that generates an oversampled clock whose frequency is at least twice as great as the frequency of said audio sampling clock; and a frequency divider that frequency divides said oversampled clock to generate said audio sampling clock.
Claim 39
Dependent Claim
51 words
The audio/video output apparatus of claim 27 further comprising: a digital signal processor programmed to selectively associate a varying number of said digital audio samples to each respective frame of said digital video as said digital audio samples and said digital video are presented to said video and audio output ports.
Claim 40
Dependent Claim
38 words
The audio/video output apparatus of claim 27 wherein said audio output port further comprises a digital-to-analog converter for converting said digital audio samples to said output analog audio, said digital-to-analog converter being clocked by said audio sampling clock.
Claim 41
Dependent Claim
64 words
The audio/video output apparatus of claim 27 further comprising: a host computer with a storage device for storing said digital audio samples and said digital video; first and second FIFOs for storing said digital audio samples between said storage device and said audio output port; and a digital signal processor for controlling flow of said digital audio samples between said first and second FIFOs.
Claim 42
Independent Claim
102 words
A method for acquiring video and one or more channels of audio and storing them in digital form on a storage device of a computer, the method comprising the steps: receiving said video at a video input port; detecting one or more synchronization signals in said video; frequency-synthesizing an audio sampling clock from said synchroniztion signals in a frequency synthesizing circuit connected to receive said synchronization signals from said video input port; receiving said audio at an audio input port, said audio input port clocked by said audio sampling clock; and storing said received video and received audio on the storage device.
Claim 43
Independent Claim
102 words
A method for acquiring video and one or more channels of audio and storing them in digital form on a storage device of a computer, the method comprising the steps: receiving said video at a video input port; detecting one or more synchronization signals in said video; frequency-synthesizing an audio sampling clock from said synchroniztion signals in a frequency synthesizing circuit connected to receive said synchronization signals from said video input port; receiving said audio at an audio input port, said audio input port clocked by said audio sampling clock; and storing said received video and received audio on the storage device.
References Cited (Backward Citations)
US4974178A
Cited
US4851909A
Cited
US5164839A
Cited
US5014267A
Cited
US4970663A
Cited
US5045940A
Cited
US5192999A
Cited
US5168247A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-04-09 | 1999-10-09 | 2000-04-09 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-04-09 | 2003-10-09 | 2004-04-09 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-04-09 | 2007-10-09 | 2008-04-09 | $7700.00 | Window Closed / Lapsed |