BEIJING, June 19, 2021 /PRNewswire/ — iQIYI Inc. (NASDAQ: IQ) ("iQIYI" or the "Company"), an innovative, market-leading online entertainment company in China, is proud to announce that its Multi-Speaker, Multi-Style, Voice Cloning Challenge ( "M2VoC" or "the Challenge") successfully concluded this week, with the results announced at the 2021 International Conference on Acoustics, Speech, & Signal Processing (ICASSP2021). M2VoC, an ICASSP2021 Signal Processing Grand Challenge, aimed at providing a common sizable dataset and a fair test bed for benchmarking voice cloning tasks. The flagship challenge attracted researchers from both academia and the industry. In light of recent advances in transfer learning, style transfer, speaker embedding, and factor disentanglement—all of which foreshadow potential solutions to low-resource voice cloning—iQIYI was excited to join forces with other leading organizations to host M2VoC.
The Challenge attracted 153 teams from academic institutions and Internet companies. The academic institutions represented included Peking University, Tsinghua University, National Taiwan University, The University of Crete, The Institute of Automation of the Chinese Academy of Sciences, University of Tsukuba, Nagoya University, Fudan University, and The Chinese University of Hong Kong, among others. Leading Internet companies including Huya, Microsoft, Didi Chuxing, Tencent, and Netease, among others, also fielded teams of their own.
The M2VoC had two main tracks, including one for teams working from limited samples and one for very limited samples. In the limited samples track, each team was provided with 100 available training samples, each with a different speaking style. In the very limited samples track, each team was provided with just five training samples of different speaking styles. The organizers also provided participants with two base datasets to be used for building basic training models. Ultimately, a panel of expert judges evaluated the outcomes according to four criteria: similarity to the original speech, voice quality, style and expressiveness, and pronunciation accuracy.
As the world’s first Multi-speaker Multi-style Voice Cloning Challenge, M2VoC brought together leading teams from industry and academia at the cutting edge of voice cloning technology. A total of 18 related papers were included in the Challenge, among which 6 papers were included in ICASSP2021.
The participating teams achieved remarkable results in various areas including acoustic modeling, speaker representation, vocoding, and speaker adaptation strategy. Their innovative solutions can be applied in many scenarios, including internet radio, UGC dubbing, audiobooks, and stylized speech synthesis. These advancements are well placed to help meet ever-advancing voice customization needs, especially in multi-style, low-quality speech scenarios.
The M2VoC showcased the excellent performance of current speech cloning techniques. The Challenge also demonstrated that with advances in deep learning, speech cloning based on limited samples could deliver competitive outcomes, but speech cloning based on a single sample remains an unsolved challenge. In real-world scenarios that require speech cloning applications, the impacts of low quality (noisy) audio as well as the time/cost constraints for training/adaptation/inference are also key factors to be considered.
Through hosting the Challenge, iQIYI hopes to provide more opportunities for exploration of cutting-edge technologies such as voice cloning and speech recognition, helping broaden the application of AI technologies and open new development possibilities for the audio-visual industry.
Artificial intelligence (AI), which has seen rapid growth over the past few years, is mainly due to the development of deep neural networks and artificial intelligence computing technology. Experts believe that there will come a time when artificial intelligence will exceed human intelligence, or be able to do many tasks better than humans.
WASHINGTON – The Cybersecurity and Infrastructure Security Agency (CISA), Federal Bureau of Investigation (FBI), and National Security Agency (NSA) published a cybersecurity advisory today regarding BlackMatter ransomware cyber intrusions targeting multiple U.S. critical infrastructure entities, including two U.S. food and agriculture sector organizations. The advisory includes technical details, analysis, and assessment of this cyber threat,…
What is Minecraft Live? Minecraft Live is a virtual event that’s accessed around the world. It’s packed with news about the game, content creators, and it will include a community vote that influences the game. Where can I watch Minecraft Live? You can watch Minecraft Live in any place that has an internet connection. Use…
WASHINGTON – As part of its mission to recruit diverse cybersecurity talent and build the workforce of the future, the Cybersecurity and Infrastructure Security Agency (CISA) has awarded $2 million to two innovative organizations for development of cyber workforce training programs. The NPower and CyberWarrior organizations, which received the awards, will focus on the unemployed…
Most Popular Articles on dWeb.News
- Sports: ‘One of the worst performances’
- RESEARCH: 'Whoop' – New Autonomous Method Precisely Detects Endangered Whale Vocalizations
- Health: These New Hoka One Ones Are Perfect for Marathon Training
- Dunzo Is Building India’s Largest Quick Commerce Platform with Dunzo Daily
- Beeco Lab to Debut New Kitchen Composter Created for Every Home
- Front Page: US Seeks To Contain Beijing Anger After Biden Vows Taiwan Defense