[11:18 Sun,29.September 2024 by Thomas Richter] |
The text is in German. Here is the English translation:
What is FaceFusion?There have been various FaceSwapping tools for some time, but they are limited to command-line operation and are only available to users who are willing to engage with them. In contrast, the open-source project FaceFusion offers an easy-to-use interface for several powerful tools that provide state-of-the-art functions like Face Swapping, Lip Syncing, aging, etc., in the best quality. ;) FaceFusion 3.0 What’s new in FaceFusion 3.0The new version 3 brings a  multitude of innovations. Now, facial expressions can be altered afterward with the Face Editor in great detail, such as manipulating the direction of the gaze, the degree to which the eyes are open, the orientation of the eyebrows, or the mouth expression. The Age Modifier allows you to change the age of a face afterward, making a person appear older or younger. The new Workflow feature is a type of job queue system that enables the automatic processing of one task after another. With Webcam Swapping, it’s possible to swap a face live in a webcam feed. The quality of the face swaps has improved even more (sharper) thanks to Pixel Boost. ;) FaceFusion Face Editor The result often looks quite good, but the algorithm struggles with rapid head movements—then face swapping often doesn’t work consistently. For some functions like Lip Syncing, additional fine-tuning is often necessary to achieve optimal results. FaceFusion for filmmakersFor filmmakers, some of the features in FaceFusion 3.0 are particularly useful: for example, lip movements can be adjusted afterward in post-production with Lip Sync, adapting them to newly recorded audio. Or, a person in an AI-generated clip can speak in sync with the lips. A whole range of possibilities arise in combination with AI-generated videos: for example, in a generated clip, the face of a virtual person can be swapped with your own or vice versa, replacing the face in a self-shot clip with an AI-generated one. Together with a video-to-video model like the one Runway Gen-3 LINK provides, you could, for instance, film a simple "puppeteer" clip, enhance it with AI, and then insert your own face back into the new clip. The Face Editor allows for easy post-production modification of facial expressions—ideal for subtly altering an actor’s expressions without having to reshoot the scene. Potential for abuse with DeepFakesOf course, the potential for abuse of such a tool is extremely high, and the creators are aware of the possible ethical issues (such as pornographic DeepFakes) and have taken steps to prevent the software from being used for inappropriate content like nudity. Several technical filters have been built into the project to block the creation of DeepFakes with explicit content. Additionally, here’s another reminder for all readers experimenting with such models: If you’re using real faces, you should ALWAYS obtain the consent of the respective person beforehand. Likewise, DeepFakes should ALWAYS be clearly labeled as such. After all, clips can easily make their way onto the internet through various uncontrolled channels since they can be shared carelessly on multiple platforms. InstallationInstallation has become even easier compared to previous versions, thanks to the AI Browser Pinokio (Windows, Mac, and Linux). The following video also describes the manual installation:  more infos at bei docs.facefusion.iodeutsche Version dieser Seite: FaceFusion 3.0: Gesichter in Videos austauschen - auf dem eigenen PC |
 |
|
|