When watching a film or series in a language they don’t understand on any OTT platform, the majority of viewers prefer subtitles. Subtitles have made it possible for people to consume their favorite content in any language they desire. However, with subtitles, it can be difficult to fully comprehend the story.
A few students from the International Institute of Information Technology Hyderabad’s Centre for Visual Information Technology, who most likely faced the same issue, are now working on an AI-powered tool for OTT platforms that will replace subtitles. According to reports, two Ph.D. scholars have developed a new deep tech Artificial Intelligence online tool that has the potential to change the world.
In a matter of minutes, the patented tool from a startup, NeuralSync AI, mentored by IIIT-H, can morph authentic-looking dialogues using a single video clip of a person or digital avatar in the dialect of your choice. The app’s name is Way2Lip.
Under the supervision of Prof CV Jawahar and Prof Vinay Namboodiri, Rudrabha Mukhopadhyay and Prajwal KR created the US-patented technology that IIIT-H now possesses.
According to the creators of this technology, if this soft solution is integrated into any OTT platform, a subscriber in any region of the country will be able to watch a film in a different language with perfectly dubbed conversations. A Spanish film, for instance, can be viewed in Telugu or any other language with excellent dubbing on Netflix.
The program and its web interface, according to Rudrabha, a software developer at NeuralSync AI, could reduce dubbing time to minutes. Thanks to advances in technology, video segments can now be shot with a smartphone.
Rudrabha goes on to say that, except Mandarin, almost all European and Asian languages can be easily dubbed, and that, with AI integrating with video production, mismatched lip motions will be a thing of the past.
