Gamingdeputy June 27 news, Tencent announced today that the company is leading the new generation of real-time speech coding industry standards AVS3P10 The final version has been completed and will be officially released soon.
The AVS audio group AVS3P10 standard adopted Tencent's solution, using Tencent Conference's first self-developed neural network voice codec Penguins AI voice engine as the prototype.Can improve call quality in weak network environment.
Advertisement
Tencent said that this is the world's first system to introduce artificial intelligence and achieve high-quality voice coding standards at low bit rates, with performance reaching world-class standards.Only 1/3 of the encoding bit rate is required to achieve the same clear sound quality as the existing mainstream standards. “Even if the network is as slow as 2G, the meeting can still be held smoothly.”
The standard was initiated, promoted and maintained by Tencent, and was contributed by many member units of the AVS audio group. “In the future, the bandwidth requirements for real-time audio scenarios such as online meetings and voice calls will be greatly reduced.Even in environments with poor network conditions such as elevators, basements, tunnels, etc.and can also achieve clear and smooth voice calls. “
It is reported that in order to transmit high-quality sound to the receiver under limited bandwidth conditions, voice coding technology that compresses original data and removes redundant information is the key. However, based on existing mainstream audio codec standards such as EVS and OPUS, when the bit rate is reduced to below 10kbps, the voice quality decreases significantly, affecting the user experience.
Advertisement
To meet this challenge, Tencent Conference Tianlai Lab and Tencent AI Lab jointly developed Tencent's first neural network speech codec – Penguins.
Specifically, Penguins integrates AI with traditional technologies, breaks the performance limit of traditional Shannon's law, introduces big data, and provides a new performance upper bound under controllable computing power increments, thus providing a new technical foundation and methodology for the next generation of communication systems, especially the source encoder part. Through AI voice signal modeling, the most core feature parameter encoding is extracted, and then with the help of deep learning networks, the subtle structure in the voice is predicted and reconstructed, and finally a realistic audio waveform is generated.
Multiple tests have shown that the AVS3P10 standard submitted by Tencent has achieved High-quality voice communication at 6kbpseven in the “2G” network, clear calls can be achieved, and the subjective quality is very close to the original reference signal, comparable to the quality of the international mainstream OPUS standard at 20kbps. At the same time, the subjective quality is benchmarked against the medium and high bit rates of traditional encoding, and the coding efficiency is improved by 200-300%.
Penguins audio encoders are available in 2021Driving mode, weak network mode and QQ voice call of Tencent ConferenceInvest in large-scale applications in scenarios such as
In March 2023, the Tencent team proposed and participated in the formulation of the standard in the AVS audio group, namely the AVS3P10 real-time speech coding standard. Subsequently, Tencent submitted a candidate technology based on Penguins; it was adopted after cross-verification by the AVS audio group. In June 2024, the AVS3P10 real-time speech coding standard officially completed the standardization work and entered the public announcement stage.
Gamingdeputy Note: Since my country established the AVS working group in June 2002, with the efforts of a team of thousands of people over the past decade, my country's AVS with independent intellectual property rights came into being.AVS3 is the world's first video coding standard launched for 8K and 5G industry applications.
AVS International Team Leader Zheng Jianhua previously revealed,AVS has started the standard setting of AVS4and called on AVS member units to continue to support the development of AVS's next-generation standards, and for various manufacturers to unite and work together to achieve the common overseas release of technical standards and promote global deployment.
Advertising Statement: The external jump links contained in the article (including but not limited to hyperlinks, QR codes, passwords, etc.) are used to convey more information and save selection time. The results are for reference only. All articles in Gamingdeputy contain this statement.