5-2 Download and prepare ControlNet

List

Chapter 1 Let's learn about image generation AI

• 1-1 Let's create images with AI
• 1-2 The birth and evolution of image generation AI
• 1-3 Let's think about the 'definition of AI' at the present time
• 1-4 Let's learn about artificial neural networks
• 1-5 Let's learn about the principle of image generation by the diffusion model

Chapter 2 Let's start building the environment

• 2-1 Let's prepare the environment to use Stable Diffusion
• 2-2 Let's build the environment using Google Colab
• 2-3 Let's build the Stability Matrix in the local environment
• 2-4 Let's create images with simple words
• 2-5 Download the model
• 2-6 Download the VAE

Chapter 3 Let's create images with prompts

• 3-1 Create images as you think using prompts
• 3-2 Build negative prompts
• 3-3 Let's create images 'as you think'
• 3-4 Let's increase the resolution of the image
• 3-5 Let's adjust various parameters
• 3-6 Let's test various prompts

Chapter 4 Let's create images using images

• 4-1 You can do it with img2img Let's figure out what's there
• 4-2 Let's create an image using Sketch
• 4-3 Let's edit an image using Inpaint
• 4-4 Apply Inpaint to modify an image
• 4-5 Extend an image using Outpainting
• 4-6 Increase the resolution of an image using img2img
• 4-7 Let's upscale with the extension function

Chapter 5 Let's use ControlNet

• 5-1 Let's learn about ControlNet
• 5-2 Download and prepare ControlNet
• 5-3 Create an image using ControlNet
• 5-4 Understand the role of the preprocessor

Chapter 6 Let's create and use LoRA

• 6-1 Let's learn what we can do with additional learning
• 6-2 Let's create an image using LoRA
• 6-3 Create your own dedicated painting style LoRA
• 6-4 Let's create various types of LoRA
• 6-5 Let's evaluate the learning content

Chapter 7 Let's use the image generation AI more

 

Downloading and Installing ControlNet in Stable Diffusion WebUI

Here's a step-by-step guide on how to install ControlNet if you're using the popular Stable Diffusion WebUI (often referred to as AUTOMATIC1111/stable-diffusion-webui):

Method 1: Using the "Extensions" Tab (Recommended)

This is the easiest and most common method.

1. Open your Stable Diffusion WebUI in your web browser.
2. Navigate to the "Extensions" tab. You'll usually find this at the top of the WebUI interface.
3. Go to the "Available" sub-tab. This tab lists extensions that are available for installation.
4. Click the "Load from" button. This will fetch the list of available extensions. It might take a few seconds to load.
5. Search for "ControlNet" in the search bar. Type "controlnet" into the filter box.
6. Look for the extension named "sd-webui-controlnet" by Mikubill. Make sure you identify the correct extension.
7. Click the "Install" button next to the "sd-webui-controlnet" entry.
8. Wait for the installation to complete. You'll usually see a message at the bottom of the WebUI indicating the progress.
9. Go to the "Installed" sub-tab.
10. Click the "Apply and restart UI" button. This is crucial to activate the newly installed extension. The WebUI will close and then automatically reopen.

Method 2: Manual Installation (If the first method doesn't work)

1. Open your Stable Diffusion WebUI installation directory. This is the folder where you cloned or installed the WebUI.
2. Navigate to the extensions folder. Inside the WebUI directory, find a folder named extensions.
3. Open a terminal or command prompt in the extensions folder.
4. Clone the ControlNet repository. Use the following command:
   git clone https://github.com/Mikubill/sd-webui-controlnet.git
5. Wait for the cloning process to finish. This will download the ControlNet extension files into a new folder named sd-webui-controlnet within the extensions directory.
6. Restart your Stable Diffusion WebUI. Close the WebUI and then run it again using your usual method (e.g., running webui-user.bat or webui.sh).

Downloading ControlNet Preprocessor and Model Weights:

After installing the extension, you'll likely need to download the preprocessor scripts and the ControlNet model weights. These are necessary for ControlNet to function.

1. Open your Stable Diffusion WebUI and go to the "ControlNet" tab. You should now see this tab available.
2. You might see prompts or warnings indicating that the preprocessors and/or models are missing.
3. Locate the "ControlNet" section in the "Settings" tab of the WebUI. There will usually be options to manage ControlNet models.
4. Alternatively, within the "ControlNet" tab itself, when you select a Control Type, you might see a dropdown for "Preprocessor" and "Model." If the models are not found, there might be a link or button to download them.
5. The recommended way is often to download the models manually from reliable sources like the official ControlNet GitHub repository or Hugging Face. Look for .pth or .safetensors files for the models.
6. Place the downloaded model files in the correct directory within your WebUI installation. The typical location is:
   extensions/sd-webui-controlnet/models
7. Place any necessary preprocessor scripts (though these are often included with the extension or downloaded automatically) in the appropriate directory within the ControlNet extension folder.
8. Restart your Stable Diffusion WebUI again after placing the model files.

Now, the ControlNet tab should be fully functional, allowing you to upload control images and use the various Control Types to guide your image generation.

---