Adobe previews Firefly's next-generation AI-powered “video model” for creating on-demand clips

Adobe Firefly will get a new “video model” later this year that will allow the artificial intelligence (AI) platform to create short videos on demand. The company even created a teaser trailer showing what the model is capable of. According to the announcement, the new model has two main parts. First, there's a “text-to-video” component that lets users create clips via text prompt. They can instruct the AI ​​to include details like specific camera angles and zoom speeds.

Also: The best AI image generators you should try now

The second feature is Image to Video, which adds new animations to uploaded still images or illustrations and turns them into moving clips. Text to Video and Image to Video will be introduced later this year on the official Adobe Firefly website.

There is a third tool called Generative Extend, but it will be exclusive to Adobe Premiere Pro. It fills the gaps between two movie sequences with generated, contextual content. Generative Extend will also be released in the coming months, but in beta. However, it is not yet known when the final version will be released.

The language surrounding this revelation is quite interesting. Unlike OpenAI's Sora, which aims to make real movies, Firefly's new model is intended to be more of an assistive tool. Adobe wants it to enrich a creator's “ability to tell beautiful and engaging stories.”

In the trailer and the post, the company repeatedly mentions that the AI ​​is “commercially safe.” It was trained on either “public domain or licensed content—never user content.” The issue of copyright infringement is a major sticking point for critics of generative AI. They argue that this technology could be used to infringe on a creator's work by taking content without permission or creating derivative content.

Adobe seems to be aware of these problems and therefore makes it clear that the company does not take anyone's work without permission.

Plus, Adobe lets you create AI-generated images in your PDFs – for free.

The company hasn't announced when the final version of Firefly's “video model” will be released, but if you're interested, you can sign up to get a notification when it becomes available on Adobe's website. There are even a few AI-generated examples you can check out.