Adobe releases its AI video creation tool and other features

Artificial intelligence is reshaping creative industries, and Adobe is leading the charge.

At Adobe Max, the company's annual creative conference, AI took centre stage with groundbreaking updates to its product lineup. From Premiere Pro to Photoshop, Adobe is integrating cutting-edge AI features transforming how creatives work across a wide range of media.

Central to these advancements is Adobe Firefly, its family of generative AI models that power a suite of new tools across Adobe’s suite of creative apps.

Firefly Video Model Takes Video Editing to New Heights

One of the most significant announcements was the Firefly Video Model, a video generation AI tool designed to compete against rival AI-powered video creation tools, including OpenAI's Sora, and Meta's recently released video creation tool.

Initially announced in September, Firefly’s video tool is now in public beta. Trained on Adobe Stock and other publicly available databases this tool allows users to transform reference images into B-roll footage and handle both 2D and 3D animations effortlessly.

A key integration of Firefly’s AI video model is in Premiere Pro, where it introduces a new feature called “Generative Extend.” This feature will enable users to extend video clips with ease, adding new frames, smoothing transitions, or lengthening shots with a simple drag of the timeline, providing creators with unprecedented flexibility.

The video model is also powering two other video generation tools that are launching on the web: Text-to-Video and Image-to-Video. Text-to-Video allows users to input a text description to generate video, while Image-to-Video enables more control by letting users add a reference image alongside the text prompt. Both tools, also part of Firefly’s public beta, currently support 5-second clips at 720p resolution a while 55 seconds shy of OpenAI Sora's 1-minute-long clips.

AI Enhancements Coming to Photoshop, Illustrator and InDesign

Beyond video, Adobe is enhancing its AI offerings in other flagship products. Earlier this year, the company rolled out AI-powered updates to Photoshop and Illustrator, and now, the Firefly Image 3 model is taking these capabilities further. Previously available only in beta, Firefly Image 3 now powers new and improved features across Creative Cloud.

In Photoshop, the Generative Fill and Generative Expand tools have been upgraded with Firefly Image 3, enabling image generation up to four times faster. New features like Generate Similar, Generate Background, and Generate Image have also been introduced, pushing Photoshop’s creative possibilities even further.

The Remove Tool is also receiving a major upgrade with what Adobe calls “distraction removal technology.” This lets users eliminate unwanted elements, such as tourists in a single click, similar to the "magic eraser" feature found in many smartphone photography apps.

In beta, is another exciting feature called the Adobe Substance 3D Viewer, enabling users to merge 2D and 3D designs and import 3D models directly into Photoshop.

Additionally, Adobe has unveiled a new Generative Workspace in Photoshop, providing a sandbox environment for designers to experiment without disrupting their workflow. The workspace also includes a generation history feature, making it easy to track previous prompts and creations.

Illustrator and InDesign are also benefiting from AI advancements. Illustrator now features tools like Objects on Path and Generative Shape Fill, while InDesign introduces Generative Expand, Text to Image, and enhanced integration with Adobe Express.

While these new AI tools could be a game-changer for many, Adobe has been careful to address potential concerns about the implications of AI-generated content. To ensure transparency and safety, Adobe says it will apply Content Credentials watermarks to all outputs created by Firefly models, certifying them as safe for commercial use.

Overall, Adobe's AI-powered tools represent a significant leap forward in the creative industry. As AI continues to evolve, we can expect even more innovative and powerful features that will empower creatives to push the boundaries of their imagination.