.footer { } Logo Logo
deutsch
/// News
Breaking Bad 2 - The Official Trailer

Runway Gen2 turns an image into a 4sec animation - without any prompt

[18:08 Mon,24.July 2023   by blip]    

Recently, videos have been posted on the Internet twitter.com/commonstyle/status/1682874851823058946, which were created with a - presumably - new function in the AI video generator Runway Gen2. In June, the second generation of the model publicly available - an Image-2-Video function was announced, but as far as we know it creates moving variations on the shown motif. It seems that the community has now discovered a new way to get clips from single images.


RunwayGen2_image_animation


The special thing about these new animations is that they seem to be generated without any prompt at all. You simply input a single image, for example one from an AI image generator like Midjourney or Stable Diffusion, and Runway Gen2 independently recognizes which parts of the image could move in a meaningful way. This requires some object recognition and classification, such as Runway "knowing" that people are turning their heads, or moving arms, hair blowing in the wind, and the like. But the camera view also moves.

In this way, individual images can be animated into short clips, each for a maximum of 4 seconds (in the basic account). This works with drawings as well as with photo-realistic shots, but certainly not always and equally well. The more complex the image composition, the stranger the result; human motion sequences do not (yet) succeed convincingly. A zombie movie could probably be generated best this way.

Theoretically, the 4-second limit can be circumvented by re-entering the last frame of an animated sequence as the start frame for the next animation, but you will probably remain trapped in a loop in terms of content. In the absence of a prompt, you have no control over the animation. But like any new gimmick, this one can certainly be used creatively in some way.

The following video shows how easy it is to create such animations.



deutsche Version dieser Seite: Runway Gen2 macht aus einem Bild eine 4-Sekunden-Animation - ganz ohne Prompt

  



[nach oben]












Archiv Newsmeldungen

2024

September - August - July - June - May - April - March - February - January

2023
December - November - October - September - August - July - June - May - April - March - February - January

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

2009

2008

2007

2006

2005

2004

2003

2002

2001

2000






































deutsche Version dieser Seite: Runway Gen2 macht aus einem Bild eine 4-Sekunden-Animation - ganz ohne Prompt



last update : 22.September 2024 - 15:00 - slashCAM is a project by channelunit GmbH- mail : slashcam@--antispam:7465--slashcam.de - deutsche Version