Adobe integrates Firefly AI-powered video to Premiere Pro

Adobe has unleashed its newest AI tools at Adobe Max. Generative Extend is coming to Premiere Pro beta, powered by Firefly, which allows you to extend clips to cover gaps in footage, smooth out transitions or hold shots longer than you filmed.

The Adobe Firefly Video Model, teased last month, has now also moved into public beta. But it’s not a beta like the usual Adobe beta that any Creative Cloud user can download through the desktop app. It’s a public beta, but you’ll need to sign up and join a waitlist.

Adobe Firefly AI Generative Video

The new Adobe Firefly AI Generative Video features are currently still in beta, and while it is a public beta, it’s not immediately available to everyone. It’s public in the sense that the public can sign up. However, you’re going onto a waitlist when you do.

But once you’re in, you’ll be able to create videos from text prompts that are up to five seconds in length. I expect this will be extended by the time it comes out of beta and becomes the final first version, and this isn’t the only limitation, either.

It can only generate 720p or 1080p videos in a 16:9 aspect ratio. So, if you want 4K, you’ll have to try tunning them through Topaz Video AI or something. It’s also limited to 8-bit SDR video, with framerates between 8 and 30fps. But it provides a lot of control and tweakability.

You can manipulate camera angles, motion, and zoom to create customized animations, effects, and more. In Premiere Pro beta, the new Firefly AI video features include Generative Extend and the ability to animate still images. Adobe says the model was built upon of the company’s existing Firefly image, vector and design tools. They also say that it’ll be completely safe to use for commercial purposes.

Adobe has expanded on this claim in the past, stating:

• We do not and have never trained Adobe Firefly on customer content.
• We only train Adobe Firefly on content where we have permission to do so.
• We compensate creators who contribute to Adobe Stock for the use of their content in training Adobe Firefly.
• We do not mine content from the web to train Adobe Firefly.
• We developed Adobe Firefly to prevent it from creating content that infringes copyright or intellectual property rights, and it is designed to be commercially safe.
• We do not claim any ownership of your content, including content you create with Adobe Firefly.
• We believe in protecting creators’ rights and founded the Content Authenticity Initiative (CAI) focused on ensuring transparency in content ownership and how it was created.
• We defend the intellectual property rights of the creative community through advocating for the Federal Anti-Impersonation Right Act.
• We explicitly prohibit third parties from training on customer content hosted on our servers (such as on Behance).

Other updates

As well as the new Firefly AI Video features, Adobe has also tweaked Premiere Pro with new context-aware properties panels, a new Frame.io panel, the new colour management we posted about recently, and the usual “speedier performance” upgrades that Adobe says are 3x faster – faster than what, I’m not entirely sure.

Photoshop, too, sees an AI-powered update with a new automatic image distraction removal, an all-new generative workspace with Generative Fill, Generative Expand, Generate Similar, Generate Background and Generate Image in both Photoshop desktop and on the web.

Not all of the features of all the apps of all of the apps are available to download right now. But you can find out more about the new features and what’s available on the Adobe website here for Firefly AI Video and here for Premiere Pro.

---