D-ID, the company behind Deep Nostalgia, lets you create AI-generated videos from a single image • Metaverse Marketing

Israel AI Society DIDwhich provided the technology for projects like Deep Nostalgia, launches a new platform where users can upload a single image and text to generate a video. With this new site called creative reality studiothe company targets sectors such as corporate training and education, internal and external corporate communication, marketing and product sales.

The platform is quite simple to use: users can upload an image of a presenter or select one from the pre-created presenters to start the video creation process. Paid users can access premium presenters which are more “expressive” as they have better facial expressions and hand movements than the default ones. After that, users can either type the text of a script or simply upload an audio clip of someone’s speech. Users can then select a language (the platform supports 119 languages), voice, and styles such as happy, sad, excited, and friendly.

The company’s AI-based algorithms will generate a video based on these parameters. Users can then distribute the video anywhere. The company claims the algorithm only takes half the length of the video to generate a clip, but in our tests it took a few minutes to generate a one-minute video. This may change depending on the presenter type and language you have selected.

“The COVID-19 pandemic has accelerated the need for digital content across the world. A big problem for organizations is creating educational content. Reading documents and going through presentations can be dry and boring. Moreover, they have to spend thousands of dollars to hire actors and create educational videos. So we use our AI to create presenters and tutors to recreate humans and make content more engaging and effective,” D-ID CEO Gil Perry told Metaverse Marketing in an interview.

Perry pointed to many use cases for this technology, ranging from a multilingual message from a CEO to employees to personalized greetings to users in an organization.

D-ID launched the studio for testing in mid-August to fix bugs before the public launch. And while its primary focus is to meet the needs of businesses of all sizes, the company sees a lot of interest creators On the platform.

Creating offensive deepfake videos is a risk. This is why the Israeli firm has put in place safeguards such as the filtering of swear words and racist remarks, as well as image recognition to avoid the use of the faces of famous people. He uses the Microsoft Azure Text Moderation API to eliminate sexual remarks and offensive language in video scripts. D-ID said the platform’s terms of service prohibit users from creating political videos. If any of these rules are violated, the company may suspend the violator’s account and remove their video from the library.

D-ID raised $25m in its Series B funding led by Macquarie Capital in March – with a total of $47m raised to date. Until now, the company has relied on others using its API to create content — Deep Nostalgia is a prime example — with clients like Modelez, Warner Bros. and Josh, an India-based short video app. Today, the company is expanding its lucrative products by launching a PowerPoint plugin with this self-service platform. The plugin adds an interactive presenter to the platform, so users don’t just have to read the slides. They can choose between different avatars, voices and languages, just like the self-service platform. But there is no provision to have a custom presenter at the moment.

At launch, users will be able to sign up for a free 14-day trial account and create up to five minutes of AI-generated 720p video. After that, they can pay $49 per month to get access to 15 minutes of AI-generated Full HD video, a PowerPoint plugin, and email support.

D-ID co-founders Eliran Kuta, Gil Perry and Sella Blondheim

Users can also upload their own audio clips for voice cloning. Additionally, the company is working on a tool that allows users to upload their own footage to train the AI ​​to be more expressive so it can better mimic the person in the video. All of these features will be limited to the enterprise level of the enterprise.

As the company faces competition from Rephrase.ai and soul machines in the field of AI-generated video, he claims that there is hardly any company that claims to generate high-quality videos from a single frame.

Perry said D-ID is not intended to be limited to corporate training, communication and marketing videos. It also aims to facilitate real-time video call translation and clone presenters, which pops an avatar on the video for you while you dictate the audio.

The company also plans to become a key player in web3/metaverse development. “Since we have expertise in generating videos from a single frame. We are thinking of ways to create digital avatars for the metaverse,” Perry said.

Leave a Comment