Generative Extend now available in Premiere Pro (Beta)
[20:26 Mon,14.October 2024 by blip]
Adobe has been teasing several AI functions for Premiere Pro since last year - at the MAX creative conference, the Firefly video model has now been released for selected users (more on this below), as well as the “generative extension” based on it in a new beta version integrated. This allows video clips to be extended by missing frames directly on the timeline: the Adobe AI creates a suitable continuation or even a fast-forward based on the existing video data. The new feature therefore makes it possible to close gaps in the video material, smooth transitions and keep recordings longer in order to achieve better-timed cuts.
Generative extend is available as a new tool in the timeline, which can be used to drag at the ends of a clip:
Firefly then adds the corresponding frames for video:
The soundtrack can also be extended with the new tool, but only in terms of ambient sounds - dialog and music are not continued. If you are an Adobe subscriber, you can try out the new generative enhancement function for yourself in the current beta.
Firefly for video: public beta phase
Generative enhancement is powered by the Firefly Video model and is now available in a limited public beta; interested Adobe customers can register at join a waiting list.
Firefly for Video can be used to generate five-second sequences in 720p, which can be downloaded as MP4 files. The prompt for the generation can contain up to 175 words - according to Adobe, the recording type, the desired characters (there should not be more than four, otherwise the model will get confused), the plot, the location and the aesthetics should ideally be described specifically. The following example is given (currently only English is supported): “a cinematic, medium shot, eye level, of a beautiful fluffy rabbit in a snowy forest at sunrise, dreamy bokeh, lens flares, the color grade is warm, the rabbit is realistic with soft, detailed fur glistening in the sunlight, camera movement is subtle and soft and in slow motion, shot on film, film grain, snowflakes falling softly in the background, highly detailed.” Further tips for prompting can be found at on a special HelpX page at Adobe.
You can also upload an image to set Firefly in motion. In this case, too, it is advisable to describe in a prompt exactly how the image should be brought to life.
If you get access to Firefly for video, you can only use the model on the desktop and with a Chrome browser. Incidentally, during the limited public beta phase, the generators are free of charge; it has not yet been announced how much it will cost to use them later in regular operation.
;)
;)
;)
;)