OmniTalker: Free to Use! Alibaba's Tongyi Model Upgraded with SOTA Ultra-Realistic Audio-Video Generation
OmniTalker: Free AI video generator by Alibaba. Create ultra-realistic digital humans with voice & expressions from any reference video.
"AI Disruption" Publication 5900 Subscriptions 20% Discount Offer Link.
Recently, Alibaba's Tongyi Laboratory launched a new digital human video generation model called OmniTalker. By simply uploading a reference video, it can learn the expressions and voice of the person in the video and even mimic their speaking style.
Compared to traditional digital human production workflows, this method effectively reduces production costs, enhances the realism and interactive experience of generated content, and meets a broader range of application needs.
Currently, the project has opened access for public testing on the ModelScope community and HuggingFace, providing over a dozen templates that anyone can use for free.