When pictures learn to walk - Motion Brush soon in Runway Gen-2

[00:07 Sat,11.November 2023 by Rudi Schmidts]

OK, we&re still a few weeks away from 2023, but what Runway has just teased as a new feature sounds like another AI milestone for video that would have suited us just fine for next year:

The new "Motion Brush" is supposed to do exactly what it sounds like: you probably use it to draw in a realistic photo and mark the areas where you would like to see movement. Rumor has it that you will also be able to use a prompt to specify approximately what should happen in the movement.

An AI will then animate the marked areas and the result will probably be something to be proud of:

The motion brush is used to select areas that are to be animated in real life.

The special thing about this method: Due to the still relatively static image areas around the animated objects, a temporally consistent video can be created from a standing position. In contrast to our small

summer workshop "Matte Painting for Dummies", the Runway Motion Brush goes two steps further.

Firstly, you no longer necessarily import your own video clip, but runway recognizes the typical movements of an object from the still image. And if you look closely, you will notice that the movement also influences the non-selected areas through changes in light, waves or shadows.

That&s quite something, and even we wouldn&t have expected it so soon. Apart from the teaser video, however, there is no other reliable information yet. Except that the motion brush should be available "soon" in the Gen-2 web interface.

Unfortunately, the teaser clip is currently only available to view on LinkedIn and Twitter, which is why we can only provide you with the links at this point. Click here to go to

Twitter and here to

LinkedIn.

more infos at bei twitter.com

deutsche Version dieser Seite: Als die Bilder laufen lernten - Motion Brush bald in Runway Gen-2