Creating an uber-realistic video animation from an avatar with Stable Diffusion

This tutorial will guide you through the process of creating an avatar with ReadyPlayerMe, animating it in Mixamo, building a 3d scene around it in Blender and feeding this scene into StableDiffusion Automatic1111 to create a video animation, using an uber-realistic custom model with the Deforum and ControlNet extensions. To watch some more great music videos created with StableDiffusion, Unreal Engine and Blender, visit our YouTube music channel: @-vero- ---------------------------- Chapters: 00:00 Intro 00:20 Creating an avatar with ReadyPlayerMe 01:45 Preparing the avatar for uploading it to Mixamo 03:00 Animating the avatar in Mixamo and importing it into Blender 05:41 Importing a 3d background scene from Sketchfab into blender and render the scene 10:19 Preparing Automatic1111 for a hyper-realistic render 12:13 Using the Deforum and ControlNet extension for rendering the animation 14:47 Creating the final video Link to the ReadyPlayerMe website for creating free 3d avatars: Link to the Mixamo website: Link to Sketchfab for downloading free 3d models: Downloading custom models for Stable Diffusion: Deforum Extension - download and infos: Controlnet Extension - download and infos: Downloading models for the Controlnet extension: Download Blender: ----------------------------------------- Local installation guide for Automatic1111 on a Windows-PC: and on a Mac with Apple Silicon: Some great Youtube channels, covering Stable Diffusion: @OlivioSarikas @NerdyRodent @sebastiankamph @promptmuse #stablediffusion #automatic1111 #deforum #controlnet #blender #mixamo #tutorial #readyplayerme
Back to Top