All the details about Adobe Introducing Generative AI Video Editing Tools for Premiere Pro Users

For those who edit videos, Adobe has excellent news: it has revealed that it will be integrating generative AI (artificial intelligence) technology into Premiere Pro, its well-known video editing program. With the help of these new Firefly AI-powered tools, which include a new video production model, editors will be able to add or delete objects from videos with a simple text prompt. Premiere Pro customers should be able to purchase the upgraded model beginning in May 2024.

Adobe now collaborates with Runway and OpenAI as well. However, in the next days, Premiere Pro will get further AI-assisted video editing features. This includes the ability to create a B-roll and the option to use the generative extend tool to add a few additional seconds to video.

Editors may now “quickly add set dressings such as photorealistic flowers or painting on a desk” or “change an actor’s wardrobe” with just one input by using the new Premiere Pro feature, which enables them to rapidly choose an item, track it, and delete an undesired object from the frame. To make a movie longer, use the object addition or removal generative extend function. This is useful for things like fine-tuning edits or creating smoother shot transitions.

Both internal Firefly models and external models, such Sora, Pika, and the Runway big language model from OpenAI, are responsible for this. When creating a B-roll, Pika may stretch shots, Sora, or Runway AI. Finally, Adobe showed off a brand-new text-to-video model that, with only a word prompt or an uploaded reference picture, can create completely original film within Premiere Pro.

Additionally, Adobe is about to release a brand-new tool called content credentials that uses a watermark to make it simple to determine if the material is artificial intelligence (AI) or original.

By characterizing the third-party AI integrations in its video preview as a “early exploration” of what these may look like in the future, Adobe’s new project can aid in the development of relationships with third-party AI businesses.

Adobe emphasized that users may apply the content credentials labels to the created clips in order to determine which AI models were utilized to create them. Adobe has also shown new audio processes, such as interactive fade handles, effect badges, important sound badges with audio categories, and a revised timeline waveform.