Master Mixamo Animation with Stable Diffusion

Master Mixamo Animation with Stable Diffusion

Table of Contents:

1. Introduction
2. Step 1: Downloading the Miximo Animation
3. Step 2: Importing the Animation into Blender
4. Step 3: Adjusting the Render Properties
5. Step 4: Setting up the Scene and Camera
6. Step 5: Adding a Background Image
7. Step 6: Rendering the Animation in Blender
8. Step 7: Using Automatic 1111 Web UI
9. Step 8: Generating the Stable Diffusion Images
10. Step 9: Finishing Touches and Final Output
11. Conclusion

Introduction

In this tutorial, You will learn how to use Miximo animation for creating a stable diffusion video using Blender. Miximo is a free Website from Adobe that offers a wide variety of 3D models and animations. We will start by downloading a dancing animation from Miximo and then import it into Blender. We will adjust the render properties, set up the scene and camera, add a background image, and render the animation. Then, we will use the Automatic 1111 Web UI to generate stable diffusion images. Finally, we will Apply finishing touches and Create the final output.

Step 1: Downloading the Miximo Animation

To begin, create a free account on Miximo and login. Browse through the available animations and choose a dancing animation that suits your needs. Download the animation file in FBX format with skin and a frame rate of 24 frames per Second.

Step 2: Importing the Animation into Blender

Open Blender and delete the default cube. Go to File > Import > FBX and select the downloaded animation file. The animation will be imported along with the 3D model. Check if the animation works by clicking on the Play button.

Step 3: Adjusting the Render Properties

Open a new window in Blender and drag it out. In the new window, adjust the render properties. Select the Eevee rendering engine for its speed. Enable ambient occlusion, bloom, and screen space reflections for improved visual quality.

Step 4: Setting up the Scene and Camera

Determine the size of the scene you want to render. Set the Dimensions to a 1K square image, such as 124x124. Switch to the camera view and adjust the camera's position and rotation to capture the animation effectively. Set the focal length for the desired perspective.

Step 5: Adding a Background Image

Find a suitable background image for your scene on a website like Pixabay. Download the image and import it into Blender using File > Import > Images as Planes. Adjust the size, rotation, and location of the image to fit the scene perfectly.

Step 6: Rendering the Animation in Blender

Switch to the rendered mode in Blender to preview the scene. Although the scene might not be perfect at this stage, proceed to render the animation. Select the folder where you want to store the animation frames and set the end frame to match the length of the animation. Render the animation.

Step 7: Using Automatic 1111 Web UI

Install and run the Automatic 1111 Web UI on your PC or Mac. Open the "Image to Image" section and drag one of the rendered animation frames into the web UI. Enter a prompt to describe the desired scene, such as a beautiful young woman with long red hair dancing in the streets of New York.

Step 8: Generating the Stable Diffusion Images

Adjust the batch count to determine the number of samples to be created. Click the generate button to produce a range of images Based on the prompt and control net. Explore different Prompts and adjust the control net settings to achieve the desired look and feel for the final image.

Step 9: Finishing Touches and Final Output

Enable the control net and select the appropriate preprocessor and model settings. Iterate through test renders to refine the scene. Once satisfied, select the batch button as the input directory and enter the path to the Blender render folder as the output directory. Configure any additional settings and generate the stable diffusion images.

Conclusion

By following these steps, you can harness the power of Miximo animations in Blender to create stunning stable diffusion videos. Experiment with prompts, control net settings, and render options to achieve the desired outcome. Import the stable diffusion images into your video editing software for further customization and enhancements. Now, let's dive into the details and get started with the tutorial.

Step 1: Downloading the Miximo Animation

To begin this tutorial, we will first download a Miximo animation that we will later use in Blender to create our stable diffusion video. Miximo, a free website from Adobe, offers a vast collection of high-quality 3D animations that can be used in various 3D software. Start by creating a free account on Miximo and log into the website. Once logged in, you will have access to a wide variety of 3D models and animations for your own use.

Step 2: Importing the Animation into Blender

Now that we have downloaded the desired Miximo animation, we can proceed to import it into Blender. Blender is a powerful 3D modeling software that may seem intimidating at first, but it is relatively easy to learn. Open Blender and delete the default cube. To import the Miximo animation, go to File > Import > FBX and navigate to the downloaded animation file. Click on the file to import it into Blender.