D-ID, the Tel Aviv-based synthetic intelligence (AI) startup, launched an AI-powered video translation device in beta on Wednesday. Dubbed Video Translate, the device can generate translated movies that mimic the voice of the unique speaker and sync the lip motion to match the phrases. The function is at present accessible to the subscribers of the platform, and the corporate mentioned it is going to be obtainable totally free for a restricted interval. The device will compete with comparable platforms equivalent to ElevenLabs, Speechify, and extra.
The AI startup introduced the launch of the video translation function in a submit on X (previously referred to as Twitter). The brand new device joins the platform’s current choices equivalent to avatar-based AI video technology, AI agent creation, and AI-powered video marketing campaign creation. The Video Translate device is at present obtainable in beta on the internet. Whereas D-ID does have iOS and Android apps, they don’t help this function in the intervening time.
With the brand new AI device, customers can both add a video file from their system or drag it from a cloud server. At present, the utmost supported file dimension is 2GB and the supported file codecs embody MP4, MOV, and MPEG. Devices 360 employees members have been in a position to check the platform and located it to be working as described, though the lip-syncing and AI voice seem barely unnatural and robotic, and figuring out these movies as AI-generated can be fairly straightforward.
Nevertheless, there are a number of limitations when producing a video as effectively. The video translation will solely work when there’s a single individual within the body of the video, and the individual is front-facing with their face seen always. Additional, background noise or music can distort the standard of technology. Moreover, the platform doesn’t translate movies if the speaker is a well-known or recognisable particular person who seems in them.
The D-ID Video Translate device can translate movies into 30 completely different languages. A few of them embody Arabic, Chinese language, English, French, German, Hindi, Italian, Japanese, Korean, Russian, Tamil, and Turkish.
At present, the function is on the market to all subscribers of the platform. Customers can subscribe to D-ID by registering an e-mail ID totally free. The free tier will get 20 credit, which isn’t replenished as soon as exhausted. The paid subscription begins at $56 (roughly Rs. 4,700) per 12 months and provides 40 credit per thirty days. The costliest plan will price $2,263 (roughly Rs. 1,90,000) per 12 months and provides 700 credit a month. The startup additionally provides enterprise-focused plans as effectively.
