Patent US5548346A successfully refreshed from Google Patents.
US5548346A
Expired / Lapsed
US
⏱️ 0.0 years remaining
Apparatus for integrally controlling audio and video signals in real time and multi-site communication control method
Assignee: Hitachi Ltd
•
Filing: 1994-11-04
•
Granted: 1996-08-20
•
Expires: 2014-11-04
Abstract
Abstract A real time visual communication system capable of improving a correspondence between a received video signal and a received audio signal in real time and improving reality. An AV signal is separated into a video signal and an audio signal, and the output state of the video or audio signal is controlled by the characteristics of the audio or video signal. For example, the sound field, reverberation, and the like are controlled in accordance with the characteristics of the video signal. A suitable image pickup unit is selected in accordance with the characteristics of the audio signal to make the sights of conversation participants coincide with each other. It is possible to reproduce sounds of audio signals well matching video signals and to provide visual communication having good reality because of the combination of matched audio and video signals.
Inventors
- 👤 Itaru Mimura
- 👤 Hirotada Ueda
- 👤 Shigeo Sumino
- 👤 Mitsuru Ikezawa
- 👤 Toshiaki Suzuki
- 👤 Taizo Kinoshita
- 👤 Katsumi Tada
Bibliographic Details
Application Number
—
Jurisdiction
US
Data Source
google_patents
Last Synchronized
2026-11-02 17:14
CPC Classifications
H; H04; H04N; H04N21/00; H04N21/40; H04N21/43; H04N21/4302; H04N21/4305; H04N5/00; H04N5/14; H04N5/147; H04N5/44; H04N5/60; H04N5/607; H04N7/00; H04N7/14; H04N7/141; H04N7/142; H04N7/15; H04N5/445; H04N5/45
Claims Analysis
Total Claims: 29
Claim 1
Independent Claim
101 words
An apparatus for integrally controlling in real time an audio signal and a video signal transmitted in real time, comprising: a separator for receiving a video signal and an audio signal synchronous with said video signal and separating the received signals into said audio and video signals; a display unit for displaying said video signal; a sound output unit for outputting a sound of said audio signal; and a control means for processing and controlling the output state of said audio signal in accordance with said video signal, said processing and controlling being conducted before said outputting of said audio signal.
Claim 2
Independent Claim
101 words
An apparatus for integrally controlling in real time an audio signal and a video signal transmitted in real time, comprising: a separator for receiving a video signal and an audio signal synchronous with said video signal and separating the received signals into said audio and video signals; a display unit for displaying said video signal; a sound output unit for outputting a sound of said audio signal; and a control means for processing and controlling the output state of said audio signal in accordance with said video signal, said processing and controlling being conducted before said outputting of said audio signal.
Claim 3
Dependent Claim
54 words
An apparatus according to claim 1, wherein said control means includes a video analyzer for analyzing said video signal, and a table for storing a relationship between an output from said video analyzer and the output state of said audio signal, whereby said sound output unit is controlled by an output from said table.
Claim 4
Dependent Claim
62 words
An apparatus according to claim 1, wherein said control means includes a video analyzer for analyzing said video signal and detecting a discontinuity of said video signal, and a table for storing a relationship between an output from said video analyzer and the output state of said audio signal, whereby said sound output unit is controlled by an output from said table.
Claim 5
Dependent Claim
55 words
An apparatus according to claim 1, wherein said control means includes an audio signal analyzer for analyzing said audio signal, and a table for storing a relationship between an output from said audio signal analyzer and the output state of said video signal, whereby said display unit is controlled by an output from said table.
Claim 6
Dependent Claim
52 words
An apparatus according to claim 1, wherein said control means includes a means for controlling to change said video signal to an icon and display said icon on said display unit, and a table for storing a relationship between a level of said audio signal and a display size of said icon.
Claim 7
Dependent Claim
52 words
An apparatus according to claim 1, wherein said control means includes a means for controlling to change said video signal to an icon and display said icon on said display unit, and a table for storing a relationship between a level of said audio signal and a display color of said icon.
Claim 8
Independent Claim
178 words
An apparatus for integrally controlling an audio signal and a video signal in real time, comprising: a separator for receiving a video signal and an audio signal synchronous with said video signal and separating the received signals into said audio and video signals; a display unit for displaying said video signal; a sound output unit for outputting a sound of said audio signal; a control means for controlling the output state of one of said audio and video signals in accordance with the other of said audio and video signals; a microphone; and an image pickup means; wherein a composite signal of said video signal and said audio signal synchronous with said video signal is received via a network interconnecting communication terminals at other sites, and said control means includes a correlation analyzing means for analyzing a correlation between said audio signal supplied from said network and said audio signal obtained from said microphone, and controls said display unit, said sound output unit, and said image pickup means, in accordance with an output from said correlation analyzing means.
Claim 9
Independent Claim
178 words
An apparatus for integrally controlling an audio signal and a video signal in real time, comprising: a separator for receiving a video signal and an audio signal synchronous with said video signal and separating the received signals into said audio and video signals; a display unit for displaying said video signal; a sound output unit for outputting a sound of said audio signal; a control means for controlling the output state of one of said audio and video signals in accordance with the other of said audio and video signals; a microphone; and an image pickup means; wherein a composite signal of said video signal and said audio signal synchronous with said video signal is received via a network interconnecting communication terminals at other sites, and said control means includes a correlation analyzing means for analyzing a correlation between said audio signal supplied from said network and said audio signal obtained from said microphone, and controls said display unit, said sound output unit, and said image pickup means, in accordance with an output from said correlation analyzing means.
Claim 10
Dependent Claim
20 words
An apparatus according to claim 7, wherein said control means controls an image pickup angle of said image pickup means.
Claim 11
Dependent Claim
56 words
An apparatus according to claim 7, further comprising a plurality of sound output units, wherein said control means controls a balance of reproduced sounds of the plurality of sound output units to orientate a sound field to a display screen area at which said video signal synchronizing said audio signal having a largest correlation is displayed.
Claim 12
Dependent Claim
76 words
An apparatus according to claim 9, wherein said display unit displays said composite signal of said video signal and said audio signal synchronous with said video signal in a window, and said control means controls the balance of reproduced sounds of the plurality of sound output units and controls to display, in a different manner from an ordinary state, the window in which said video signal synchronizing said audio signal having a largest correlation is displayed.
Claim 13
Dependent Claim
82 words
A multi-site communication method for a multi-site communication system having a plurality of communication terminals at different sites interconnected by a communication network for transmitting an audio signal and a video signal between the communication terminals, wherein correlations between an audio signal generated at one communication terminal and audio signals generated at other communication terminals are analyzed, and a conversation partner of said one communication terminal is identified from said other communication terminals in accordance with a result of an analyzed correlation.
Claim 14
Dependent Claim
82 words
A multi-site communication method for a multi-site communication system having a plurality of communication terminals at different sites interconnected by a communication network for transmitting an audio signal and a video signal between the communication terminals, wherein correlations between an audio signal generated at one communication terminal and audio signals generated at other communication terminals are analyzed, and a conversation partner of said one communication terminal is identified from said other communication terminals in accordance with a result of an analyzed correlation.
Claim 15
Dependent Claim
86 words
A multi-site communication method according to claim 11, wherein said one communication terminal includes a display unit for displaying images received from said other communication terminals at predetermined display positions and a plurality of cameras disposed near said predetermined display positions for taking images of participants at said other communication terminals, and wherein said video signal recorded by a camera near a predetermined display position corresponding to said identified conversation partner is selected and transmitted at least to said communication terminal of said identified conversation partner.
Claim 16
Dependent Claim
25 words
A multi-site communication method according to claim 12, wherein a display state of an image is controlled in accordance with identification of said conversation partner.
Claim 17
Dependent Claim
22 words
A multi-site communication method according to claim 13, wherein contents of image decoding are controlled in accordance with identification said conversation partner.
Claim 18
Dependent Claim
23 words
A multi-site communication method according to claim 13, wherein contents of image encoding are controlled in accordance with identification of said conversation partner.
Claim 19
Dependent Claim
31 words
A multi-site communication method according to claim 14, wherein the image decoding includes a hierarchical decoding scheme, and a hierarchy thereof is changed in accordance with said identification of conversation partner.
Claim 20
Dependent Claim
26 words
A multi-site communication method according to claim 11, wherein a reproduction state of audio signal sounds is controlled in accordance with identification of said conversation partner.
Claim 21
Dependent Claim
99 words
A communication terminal connected to a plurality of other communication terminals at different sites via a communication network for transmitting and receiving an audio signal and a video signal to and from the plurality of other communication terminals, comprising: a correlation analyzing means for analyzing correlation between said audio signal to be transmitted to another communication terminal at another site and audio signals received from said other communication terminals at the different sites; and a conversation partner identifying means for identifying the another communication terminal of a conversation partner in accordance with an output of said correlation analyzing means.
Claim 22
Dependent Claim
99 words
A communication terminal connected to a plurality of other communication terminals at different sites via a communication network for transmitting and receiving an audio signal and a video signal to and from the plurality of other communication terminals, comprising: a correlation analyzing means for analyzing correlation between said audio signal to be transmitted to another communication terminal at another site and audio signals received from said other communication terminals at the different sites; and a conversation partner identifying means for identifying the another communication terminal of a conversation partner in accordance with an output of said correlation analyzing means.
Claim 23
Dependent Claim
72 words
A communication terminal according to claim 18, further comprising: a display unit for displaying images received from said other communication terminals at predetermined display positions; a plurality of cameras disposed near said predetermined display positions for taking the images of participants at said other communication terminals; and a video signal selecting means for selecting said video signal recorded by a camera near a predetermined display position corresponding to an identified conversation partner.
Claim 24
Dependent Claim
29 words
A communication terminal according to claim 18, further a comprising video controlling means for controlling a display state of an image in accordance with identification of said conversation partner.
Claim 25
Dependent Claim
32 words
A communication terminal according to claim 18, further comprising a conversation partner identified result transmitting means for transmitting identification of said conversation partner to said other communication terminals via said communication network.
Claim 26
Dependent Claim
69 words
A communication terminal connected via said communication network to a plurality of communication terminals including the communication terminal recited in claim 21, further comprising: a conversation partner identified result receiving means for receiving the identification of said conversation partner from said communication network; and a video signal decoding control means for controlling contents of decoding said video signal in accordance with the identification received by said result receiving means.
Claim 27
Dependent Claim
31 words
A communication terminal according to claim 18, further comprising a video signal encoding control means for controlling contents of encoding said video signal in accordance with identification of said conversation partner.
Claim 28
Dependent Claim
30 words
A communication terminal according to claim 22, wherein said video signal decoding control means changes a hierarchy of a hierarchical decoding scheme in accordance with the identification said conversation partner.
Claim 29
Dependent Claim
26 words
A communication terminal according to claim 18, further comprising a sound controlling means for controlling a sound reproduction in accordance with identification of said conversation partner.
References Cited (Backward Citations)
JPS60203086A
Cited
JPS6110381A
Cited
US4964162A
Cited
JPS6377282A
Cited
US4907082A
Cited
US5389976A
Cited
USPTO Annuity & Maintenance Windows
| Annuity Stage | Window Opens | Payment Deadline | Surcharge Period Until | Estimated Fee | Status |
|---|---|---|---|---|---|
| 3.5 Years (Year 4) | 1999-08-20 | 2000-02-19 | 2000-08-20 | $2000.00 | Window Closed / Lapsed |
| 7.5 Years (Year 8) | 2003-08-20 | 2004-02-19 | 2004-08-20 | $3760.00 | Window Closed / Lapsed |
| 11.5 Years (Year 12) | 2007-08-20 | 2008-02-19 | 2008-08-20 | $7700.00 | Window Closed / Lapsed |