recent,AI video creation platform D-ID Launched a new AI video translation tool, AI Video Translate. This tool can translate videos into multiple languages. Not only that, D-ID will also clone the narration voice and adjust the lip shape to ensure that the translated content and video images are perfectly matched.
Product entry:https://www.1ai.net/80.html
The effects that this tool can achieve include:
- Voice cloning: Automatically clone a speaker’s voice to achieve cross-language consistency
- Lip Movement Adaptation: Perfectly synchronizes with the speaker’s lip movements for a natural look.
- Batch Rendering: Quickly translate your videos into up to 29 languages
- User-friendly interface: Drag-and-drop functionality and intuitive design make it easy for anyone to use.
The technology is based on some of D-ID's previous innovative work. For example, a few years ago, users were able to "revive" old photos and make them "speak", which attracted widespread attention.
To support its growing corporate clientele, D-ID raised $25 million in Series B funding in 2022. Today, the newly launched AI video translation technology is now free for D-ID subscribers. Creators can use this technology to automatically translate their videos into 30 languages, including Arabic, Mandarin, Japanese, Hindi, Spanish, and French, which will help them expand their audience.
D-ID said the new technology can help clients promote their marketing, entertainment and social media activities globally, saving localization costs. In the past, dubbing technology allowed video viewers to listen to audio in a language they are familiar with, but this technology was often difficult to access for some small creators.
With the advancement of technology, the situation is changing. For example, YouTube recently launched a multilingual audio feature to help creators translate videos into other languages. MrBeast (Jimmy Donaldson), a well-known YouTube creator, is one of the early users. He used this technology to translate several popular videos into 11 languages.
Today, with the development of AI technology, the ability to create, translate and clone voices is also constantly improving. This year, Microsoft announced the use of AI to translate and dub YouTube videos in real time, and Vimeo also launched a tool in July that supports the translation of audio and subtitles, and can use AI technology to replicate the narrator's voice. In addition, there are many companies that provide voice cloning or AI translation tools, including Descript, ElevenLabs, Speechify, etc.
D-ID’s new video translation technology will be available through D-ID Studio and its API.The company also offers a one-month trial and more demos can be found on its official website.The video length must be between 10 seconds and 5 minutes, and the file size must not exceed 2GB, and for best results, the video should include only one narrator whose face is visible at all times and facing the camera.