Multi-media communication apparatus for transmitting audio information, video information and character information simultaneously

Claim 2

A multi-media communication apparatus comprising: line interface means for controlling communication through a communication line; call control/processing means for controlling calls incoming and outgoing through said line interface means; multiplexing means for multiplexing video information and audio information to transmit the multiplexed information through said line interface means; audio codec means for encoding an audio signal to transmit the encoded audio signal to said multiplexing means; moving picture data encoding means for encoding a video signal; video data buffer means for temporarily storing the video signal compressed in said moving picture data encoding means to transmit the compressed video signal to said multiplexing means; buffer control means for detecting the quantity of the compressed video signal stored in a memory of said video data buffer means and controlling the video signal compression scheme in said moving picture data encoding means; and frame control means for detecting the quantity of the video signal stored in said video data buffer means on the basis of the information supplied from said buffer control means, said frame control means acting, when the quantity of the stored video signal exceeds a predetermined threshold, (a) to decrease the value of the audio signal communication rate to that of a predetermined non-zero rate and (b) to change over the audio signal compression scheme in said audio codec means to that based on the value of said predetermined non-zero rate, thereby changing over the channel allocation scheme in said multiplexing means to allocate less channels to the audio signal and to allocate more channels to the video signal, said communication rate of the audio signal including levels of 56 kbps, 48 kbps and 16 kbps which are set when a channel of said communication line is allocated to the audio signal, and the audio signal being encoded in accordance with an encoding scheme for one of said communication rates of 16, 48 and 56 kbps.

Claim 3

A multi-media communication apparatus according to claim 1, further comprising mode switching means for changing over between a routine mode and a video priority mode, said video priority mode being one in which said video signal is processed to minimize deformation or distortion of video data.

Claim 4

A multi-media communication apparatus according to claim 2, wherein said frame control means acts to perform said operations (a) and (b) only when said mode switching means sets said communication apparatus into said video priority mode.

Claim 5

A multi-media communication apparatus according to claim 3, wherein, when said mode switching means sets said communication apparatus into said routine mode, said frame control means acts to change a video signal compression parameter of the compressed video signal in response to the detected quantity of the video signal exceeding said predetermined threshold.

Claim 6

A multi-media communication apparatus comprising: line interface means for controlling communication through a communication line; call control/processing means for controlling calls incoming and outgoing through said line interface means; multiplexing means for multiplexing video information and audio information to transmit the multiplexed information through said line interface means; audio codec means for encoding an audio signal to transmit the encoded audio signal to said multiplexing means; moving picture data encoding means for encoding a video signal; video data buffer means for temporarily storing the video signal compressed in said moving picture data encoding means to transmit the stored video signal to said multiplexing means; buffer control means for detecting the quantity of the video signal stored in a memory of said video data buffer means and controlling the video signal compression scheme in said moving picture data encoding means; and frame control means for detecting the quantity of the video signal stored in said video data buffer means on the basis of information supplied from said buffer control means, said frame control means acting, when the detected quantity of the video signal exceeds a predetermined threshold, (a) to decrease the value of the audio signal communication rate to that of a predetermined non-zero rate and (b) to change over the audio signal compression scheme in said audio codec means to that based on said predetermined non-zero rate, thereby changing over the channel allocation scheme in said multiplexing means to allocate less channels to the audio signal and to allocate more channels to the video signal, said frame control means acting, when on the other hand the audio signal communication rate is at a predetermined minimum non-zero threshold and the detected quantity of the video signal exceeds a predetermined threshold, (c) to instruct said buffer control means to change the video signal compression parameter in said moving picture data encoding means, thereby extending the period of video data quantization in the quantizing step and decreasing the number of frames of the video signal, said communication rate of the audio signal including levels of 56 kbps, 48 kbps and 16 kbps which are set when a channel of said communication line is allocated to the audio signal, and the audio signal being encoded in accordance with an encoding for one of said communication rates of 16, 48 and 56 kbps.

Claim 7

A multi-media communication apparatus comprising: line interface means for controlling communication through a communication line; call control/processing means for controlling calls incoming and outgoing through said line interface means; multiplexing means for multiplexing video information and audio information to transmit the multiplexed information through said line interface means; audio codec means for encoding an audio signal to transmit the encoded audio signal to said multiplexing means; moving picture data encoding means for encoding a video signal; video data buffer means for temporarily storing the video signal compressed in said moving picture data encoding means to transmit the stored video signal to said multiplexing means; buffer control means for detecting the quantity of the video signal stored in a memory of said video data buffer means and controlling the video signal compression scheme in said moving picture data encoding means; and frame control means for detecting the quantity of the video signal stored in said video data buffer means on the basis of information supplied from said buffer control means, said frame control means acting, when the detected quantity of the video signal exceeds a predetermined threshold, (a) to decrease the value of the audio signal communication rate to that of a predetermined non-zero rate and (b) to change over the audio signal compression scheme in said audio codec means to that based on said predetermined non-zero rate, thereby changing over the channel allocation scheme in said multiplexing means to allocate less channels to the audio signal and to allocate more channels to the video signal, said frame control means acting, when on the other hand the audio signal communication rate is at a predetermined minimum non-zero threshold and the detected quantity of the video signal exceeds a predetermined threshold, (c) to instruct said buffer control means to change the video signal compression parameter in said moving picture data encoding means, thereby extending the period of video data quantization in the quantizing step and decreasing the number of frames of the video signal, said communication rate of the audio signal including levels of 56 kbps, 48 kbps and 16 kbps which are set when a channel of said communication line is allocated to the audio signal, and the audio signal being encoded in accordance with an encoding for one of said communication rates of 16, 48 and 56 kbps.

Claim 8

A multi-media communication apparatus according to claim 5, further comprising mode switching means for changing over between a routine mode and a video priority mode, said video priority mode being one in which said video signal is processed to minimize deformation or distortion of video data.

Claim 9

A multi-media communication apparatus according to claim 6, wherein said frame control means acts to perform said operations and (a), (b) and (c) only when said mode switching means sets said communication apparatus into said video priority mode.

Claim 10

A multi-media communication apparatus according to claim 7, wherein, when said mode switching means sets said communication apparatus into said routine mode, said frame control means acts to change a video signal compression parameter of the compressed video signal in response to the detected quantity of the video signal exceeding said predetermined threshold.

Claim 11

A multi-media communication apparatus comprising: line interface means for controlling communication through a communication line; call control/processing means for controlling calls incoming and outgoing through said line interface means; multiplexing means for multiplexing video information and audio information to transmit the multiplexed information through said line interface means; audio codec means for encoding an audio signal to transmit the encoded audio signal to said multiplexing means; video codec means for encoding a video signal to transmit the encoded video signal to said multiplexing means; frame control means for increasing the rate of audio signal compression in said audio codec means when the quantity of the video signal exceeds a predetermined threshold, said increasing of said rate of audio signal compression being limited so as to maintain an audio signal communication rate above a predetermined non-zero threshold, thereby controlling the channel allocation scheme in said multiplexing means to allocate less channels to the audio signal and to allocate more channels to the video signal; and mode switching means for changing over between a routine mode and a video priority mode, said video priority mode being one in which said video signal is processed to minimize deformation or distortion of video data.

Claim 12

A multi-media communication apparatus comprising: line interface means for controlling communication through a communication line; call control/processing means for controlling calls incoming and outgoing through said line interface means; multiplexing means for multiplexing video information and audio information to transmit the multiplexed information through said line interface means; audio codec means for encoding an audio signal to transmit the encoded audio signal to said multiplexing means; video codec means for encoding a video signal to transmit the encoded video signal to said multiplexing means; frame control means for increasing the rate of audio signal compression in said audio codec means when the quantity of the video signal exceeds a predetermined threshold, said increasing of said rate of audio signal compression being limited so as to maintain an audio signal communication rate above a predetermined non-zero threshold, thereby controlling the channel allocation scheme in said multiplexing means to allocate less channels to the audio signal and to allocate more channels to the video signal; and mode switching means for changing over between a routine mode and a video priority mode, said video priority mode being one in which said video signal is processed to minimize deformation or distortion of video data.

Claim 13

A multi-media communication apparatus according to claim 9, wherein said frame control means acts to increase said rate of audio signal compression only when said mode switching means sets said communication apparatus into said video priority mode.

Claim 14

A multi-media communication apparatus according to claim 10, wherein, when said mode switching means sets said communication apparatus into said routine mode, said frame control means acts to change a video signal compression parameter of the compressed video signal in response to the detected quantity of the video signal exceeding said predetermined threshold.