The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (2024)

Automatic1111 or A1111 is the most popular stable diffusion WebUI for its user-friendly interface and customizable options.

Whether seeking a beginner-friendly guide to kickstart your journey with Automatic1111 or aiming to become a pro, this post has got you covered.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (1)

In this post, I’ll cover all aspects related to how to use Automatic1111 stable diffusion WebUI, from the interface to all the elements.

So, if you want to begin from scratch, read the entire article patiently. If not, feel free to jump to your desired section below.

Here's What We'll Cover

First: Download and Install Automatic1111

You can use the stable diffusion WebUI in Windows, Mac, and Google Collab.

But before you embark on your creative journey, make sure your system meets the requirements.

So, let’s dive into everything you need to know to set up Automatic1111 and get started with Stable Diffusion.

Hardware Requirements:

1. GPU: A discrete NVIDIA GPU with a minimum of 8GB VRAM is strongly recommended. Aim for an RTX 3060 Ti or higher for optimal performance.

While 4GB VRAM GPUs might work, be aware of potential limitations, especially when dealing with finding the best image size for stable diffusion.

2. CPU: Opt for a modern processor, such as an i5 or Ryzen 5, to ensure smooth performance.

3. RAM: Aim for 16GB or more for an ideal experience.

4. Disk Space: Allocate at least 10GB of free space on your system.

Operating System:

Choose from the following operating systems:

  • Windows 10 or higher
  • Linux
  • macOS (additional setup required for Apple Silicon M1/M2 chips)

Software Requirements:

1. Python: Ensure you have Python version 3.10.6 installed. Avoid using Python 3.11 or newer.

2. CUDA Toolkit: For NVIDIA GPUs, a minimum of version 11.7 is required.

3. Git: Install Git for cloning the repository.

Additional Considerations:

AMD GPUs: While not officially supported, some users have reported success with AMD GPUs using experimental methods.

Cloud Services: If your local machine doesn’t meet the requirements, consider using cloud services like Google Colab or platforms offering managed Automatic1111 access, such as Think Diffusion.

If you want to explore more services, read our post on the best Google Collab alternatives for stable diffusion.

Installation Guide:

1. Install Python 3.10.6: During installation, ensure you select the option to add Python to your PATH. Avoid newer Python versions (3.11+).

2. Install Git: You’ll need Git to clone the repository.

3. Clone the Automatic1111 repository:

Windows: Run `git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git` in an elevated command prompt.

Linux/macOS: Run `git clone https://github.com/AUTOMATIC1111/stable-diffusion-webui.git` in a terminal.

4. Download a Stable Diffusion model file: Choose a pre-trained model from sources like Hugging Face and CIVITAI.

We always recommend using Safetensors files for better security and safety.

5. Run the web UI:

Windows: Navigate to the stable-diffusion-webui folder, run `update.bat` to update the codebase, and then `run.bat` to start the web UI.

Linux/macOS: In the stable-diffusion-webui folder, run `python -m webui` to start the web UI.

Now, you’re all set to explore the endless creative possibilities of Stable Diffusion with Automatic1111.

Now, let the artistic journey begin together!

Exploring Interface for Basic Usage

When you first land on your A1111 WebUI, you can generally see the following interface.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (2)

I know you see there are many options to play with and customize on the webui.

That’s why I am starting with the basic usage of stable diffusion.

Text to Image:

The name itself says it is the tab to generate images from text, which we call a prompt.

But you are seeing two sections, right?
One is ‘prompt,’ and another is ‘negative prompt.’

Prompt: It is the area where you describe your image, especially focusing on what you want in your image.

Negative prompt: This is the area to tell the AI what you do not want to see in your image.

Okay, now let me clarify this practically.

For this, I am taking a random prompt and a negative prompt.

Prompt: “A beautiful woman, well-dressed, realistic, a masterpiece.”
Negative prompt: “Unrealistic, cartoon, anime, blurry, low quality.”

I just put these in the desired section and hit the generate button.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (3)

You can see the image is pretty cool.

When you are writing prompts, try to keep it within 75 characters because the model supports only 75 characters.

You can do a lot of things with the generated image by adjusting various parameters, which we will discuss later in this post.

For now, let’s move to the img2img tab.

Img2Img:

Img2img in stable diffusion, also known as image-to-image, is a method that creates new AI images from a picture and a text prompt.

The resulting image keeps the colors and layout of the original picture, letting us add a personal touch with text to turn simple sketches into awesome artwork.

Now, let’s talk about its features:

Img2Img with Text:

Start by uploading an image you want to base the next one on.

In my case, I want to make a picture of a good-looking man using the colors and composition from my last picture.

So, I upload the previous image, type ‘A handsome man’ in the prompt box, and click generate.

The new image is a man, but the colors and layout are from the previous one. Right!

Now, let’s move on to the next part of the img2img tab.

Sketch:

It’s like a painting tool to sketch on an uploaded image.
Here, you have tools like a brush to change color, a pencil icon to adjust sharpness, and an eraser.

I upload the first image and keep the text ‘A handsome man.’

I want to color my character’s hair red.

After painting, there’s a special setting.
Scroll down and find the settings as shown below, then click ‘Only mask.’

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (6)

It helps the AI focus on your masked area.

Now, click generate and see what happens.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (7)
The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (8)

Wow, the man’s hair looks cool in reddish.

If you want a richer color, adjust the Denoising stretch.

Let’s add glasses to the guy’s face to make it clearer.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (9)
The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (10)

Cool, right?

I hope you’re enjoying it too. So, play with this tool after reading the full Automatic1111 tutorial.

Inpaint:

This tool lets you add, remove, or enhance any part of the uploaded image.

Don’t worry; it’s straightforward.

Just upload the image, mark the area, and explain your desire in the prompt box.

To explain, I’m doing two things:

a) I want to improve the eyes of my first image.
Upload the image, mark the eyes, and type ‘A beautiful woman, attractive bluish human eyes’ in the prompt box.

After that click Generate,

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (11)
The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (12)

Now, the eyes look more attractive with a bluish color. Right!

But you can’t specify the color by masking with the tool ‘inpaint’; you have to specify it in the prompt box as I do.

b) Now, I want to remove the rings from my character.

Mask the rings and add ‘earrings’ in the negative prompt box.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (13)
The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (14)

Wow, the rings are gone now.

Now, move to the 4th section of img2img.

Inpaint Sketch:

The name itself indicates that it is a combination of the tools Sketch and Inpaint.

Yes, the name is truly meaningful.

It functions as a combination of the two aforementioned tools.

Here, you can mask any area of the uploaded image with a specific color, bringing your drawing to life on the image.

However, to use it, you should have proper painting knowledge.

But for instance, let’s explore how it works with my limited painting knowledge.

I want to add a necklace without using any text prompt.

To achieve this, I have marked the neck with a red color and clicked the generate button.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (15)
The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (16)

The tool truly understands my input and adds a reddish necklace.

Now, let’s proceed to the 5th section of img2img.

Inpaint Upload:

It involves masking a face with another to generate a unique face with the same composition as the previous image.

To clarify, let me first upload the images.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (17)

The upper canvas represents your image, with the colors and composition you wish to retain in your next generated image.

The lower canvas, i.e., the mask, is the area where you upload an image whose facial aesthetic will be added to the upper canvas image.

I hope you understand the concept.

After uploading both images, click the generate button.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (18)
The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (19)

The tool will then mask the face of the lower canvas image onto the upper canvas image, creating a unique image as shown above,

Okay, these are the basic uses of the img2img tab; now let’s move to the next tab, which is Extras.

Extras tab

It is primarily used to restore faces in stable diffusion.

If you are accustomed to generating AI images, you are aware that high-quality results are not always guaranteed, even with a well-crafted prompt.

Alternatively, upscaling becomes necessary when dealing with images of very low quality.

This is where the tool comes into play.

To achieve this, simply upload the low-quality image to the Extras canvas, select an upscaling model like Codeformer, and click the generate button.

For example, I am upscaling the image below.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (20)
The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (21)

I have used Codeformer for upscaling, but if you want to explore the full potential of Codeformer, you may refer to our article on how to restore faces in stable diffusion.

Now, let’s move on to the next tab, PNG Info.

PNG Info:

If you come across an image on the internet that you like and wish to generate a similar one, this tool will help you discover all the information about that image.

To obtain details about an image, upload it to the PNG Info canvas, and the tool will display all the relevant information.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (22)

After obtaining the details, you can send the image to txt2img, img2img, Inpaint, and Extras canvas by clicking the desired button for further artwork.

Essentially, this tool works to extract prompts and parameters from images in stable diffusion.

These are the main features that we typically use, but to become a professional creator, understanding all the parameters is crucial for achieving better results.

Image Generation Parameters

In this section of the Automatic1111 guide, we’ll unravel the secrets of its parameters, empowering you to craft stunning and distinctive images.

Essential Parameters:

I should start with Prompts and Neagtive prompts, but as I discussed them earlier in the post I am starting with Steps.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (23)

1. Sampling Steps: It controls the denoising process with the number of steps.

It varies from 0 to 150.

Higher steps (30+) yield sharper details but might require more time and GPU.

So, find the sweet spot for your creation, my recommendation is 20 to 25.

2. CFG Scale: It balances the influence of your prompt and the model’s creativity.

In short, lower values (5-7) prioritize accuracy, while higher values (8+) open doors to unexpected and artistic interpretations.

3. Seed: A random number that kickstarts your image.

If you keep the seed the same to generate images, the images will be in the same color and composition.

And changing the seed generates entirely different images, offering endless exploration possibilities.

If you want to random seed for your image make it -1, which is by default.

By clicking on the green triangle icon, as highlighted by the yellow circle in the above image, you can locate the seed of the generated image, and the white square erases the seed.

4. Batch Count: This is all about how many rounds Stable Diffusion will go through for a given text prompt.

Each round, or batch, produces one or more images, depending on the specified batch size.

5. Batch Size:

Batch size is the number of images Stable Diffusion generates simultaneously in each batch.

Think of it as how many pictures are cooked up in the same pot. If you set the batch size to 1, it’s one at a time; if you set it to 4, you get four images at once.

More VRAM (Video RAM) means you can process more images concurrently on your GPU.

Bigger batch sizes can be speedier, processing multiple images simultaneously.

Advanced Parameters: Fine-Tuning Your Masterpiece

6. Sampling Method: It dictates how the model creates images based on the provided text prompt.

Common methods include Euler, Euler-Marzouk, and Langevin.

7. Denoising Strength: In img2img mode, this parameter controls the dominance of the original image.

Lower values retain the original, while higher values (0.5+) prioritize the prompt, generating a new image inspired by the original.

Buttons Near Generate Button

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (24)

1. The Bluish button: It helps to view your last prompt.

So, it is your tool to find prompt history, but remember it only shows the previous prompt you have used.

2. Delete Button: By clicking the button you can delete your prompt.

3. Book Icon: If you have named a specific prompt, then the prompt will be saved as style.

So, when you want to add this style to the next prompt you should use it.

4. Pencil Icon: It the the tool to create a style.

If you are new then it may be difficult for you.

So, at this point, if you want to explore different styles, I recommend you use the SDXL styles selector.

Settings for Automatic1111 WebUI

As there are numerous settings in Automatic1111, I am currently addressing a specific task: adding the ‘integrate clip skip category’ to the interface. You can follow the steps below to update various settings.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (25)

1. Upon launching A1111, observe that only one item is present in the top bar, as highlighted by 1.

2. To incorporate an additional tool, navigate to settings, scroll down the page, and locate ‘User Interface.’

3. Next, you will find only one item. To add ‘integrate clip skip category,’ enter the name in the search box and select it.

4. Now, click on ‘Apply settings,’ and you will notice a notification, as highlighted by the box under 6.

5. After viewing this, reload your UI, and the extra tool will appear in its position.

For ‘integrate clip skip category,’ it is displayed on the top bar.

Know more about Stable diffusion clip skip.

If you are interested in learning about all the settings in A1111, please let me know by commenting below and subscribing to our weekly newsletter.

I will create a post and keep you informed.

In the meantime, let’s proceed to the next part.

Installing Extensions in A1111

If you’re eager to enhance your AUTOMATIC1111 experience with additional features, installing extensions is the way to go.

The process may vary based on your operating system and personal preferences, but fear not—, we’ve got you covered.

Let’s walk through the steps to install an extension on Windows or Mac seamlessly.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (26)

Step 1: Launch AUTOMATIC1111 Web-UI
Start by opening AUTOMATIC1111 Web-UI as you normally would. Ensure that your AUTOMATIC1111 environment is up and running smoothly.

Step 2: Navigate to the Extension Page
Once you’re in the Web UI, locate the Extension Page.
This is the hub where you’ll find a variety of extensions to enhance your AUTOMATIC1111 experience.

Step 3: Click the Install from the URL Tab
On the Extension Page, spot the “Install from URL” tab.
Click on it to initiate the installation process from a specific URL.

Step 4: Enter the Extension’s URL
In the “URL for extension’s git repository” field, enter the URL of the extension you wish to install.

This URL is typically associated with the extension’s git repository.

In my case, it is: “https://github.com/Bing-su/adetailer”

Step 5: Click the Install Button
This action signals AUTOMATIC1111 to fetch and install the extension from the specified repository.

Step 6: Wait for Confirmation
Allow AUTOMATIC1111 some time to complete the installation process.

Once the installation is successful, you’ll receive a confirmation message.

Step 7: Restart AUTOMATIC1111
To ensure the extension integrates seamlessly, restart AUTOMATIC1111.

This step finalizes the installation process, making the new features or functionalities accessible within your environment.

To find and use the newly added extension scroll down the WebUI, and notice below seed.

By following these simple steps, you can effortlessly expand the capabilities of AUTOMATIC1111 to suit your preferences.

Checkpoint Models

Stable Diffusion’s checkpoint models stand as pre-trained marvels, wielding the ability to craft images that exude a distinct style ingrained during their training.

The captivating allure of these models lies in their capacity to generate an array of styles, with each model presenting its unique artistic signature.

Now, let’s explore some noteworthy Stable Diffusion models that have left an indelible mark on the world of image generation:

1. Stable Diffusion v1.4: Made by Stability AI in August 2022, this model is like a versatile artist that can make lots of different styles of pictures.

2. Stable Diffusion v1.1: This model learned to make pictures from a bunch of examples and can create images in two sizes: 256×256 and 512×512.

It’s like having an artist with a big toolkit!

3. Stable Diffusion v1.2: Building on v1.1, this model got even better at making pretty pictures.

It is trained with lots of steps and focuses on making images look even nicer.

4. Stable Diffusion v1.5: Inspired by v1.2, this model uses special tools to make pictures, promising a mix of new and cool styles.

5. SDXL (Stable Diffusion XL): SDXL is a super-powered picture-making machine! It’s designed to turn text into images and pays extra attention to details.

It’s like a superhero artist with a big imagination!

These machines are handy for making all sorts of pictures, from real-looking people to cityscapes.

You can find more models with their details about each one on Hugging Face and CIVITAI.

For me, I’m using RealisticVision51 to generate and showcase in this post.

Final Verdict:

To sum it up, using the options I talked about in this Automatic1111 guide will help you make great images with the stable diffusion WebUI.

Since this is getting quite long, I’ll finish here for now.

But if you think I missed something important, please let me know in the comments. I’ll be happy to add it.

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (27)

Prashant

Hi there! I’m Prashant, the passionate mind behind aienthusiastic.com. With a background in Electronics Science, I’ve had the privilege of delving deep into AI and ML. And this blog is my platform to share my enthusiasm with you.

aienthusiastic.com/about-us/

The Ultimate Guide to Automatic1111: Stable Diffusion WebUI (2024)

FAQs

What is AUTOMATIC1111 Stable Diffusion web UI? ›

WebUI Automatic1111 Stable Diffusion is a powerful tool that revolutionizes the way we create AI-generated images. It is a user-friendly interface that allows users to effortlessly run and manage their AI models for image generation.

How to set up AUTOMATIC1111 Stable Diffusion? ›

Learn All About Arch-Viz
  1. Step 3: Download the Stable Diffusion (AUTOMATIC1111) Download to your home folder: ...
  2. Step 4: Download a checkpoint model. Download the Stable Diffusion v1. ...
  3. Step 5: Run webui-user. bat file. ...
  4. Step 6: Test if it's working. Go to this URL in your web browser: ...
  5. Step 7: Edit the webui-user. bat file.

Is Stable Diffusion AUTOMATIC1111 safe? ›

Stable Diffusion is extremely impressive but presents grave risks for out-of-scope use. Models and code for Stable Diffusion have spread far and wide and any member of the public is capable of generating dangerous images.

Does AUTOMATIC1111 have a NSFW filter? ›

AUTOMATIC1111's Stable Diffusion Web UI: A web-based interface for Stable Diffusion that includes an option to disable the NSFW filter. Roop NSFW Extension: An extension for the Stable Diffusion Web UI that removes the NSFW filter and provides additional features.

How much RAM do I need for AUTOMATIC1111? ›

You need to meet the following requirements. 16GB RAM. NVIDIA (GTX 7xx or newer) GPU with at least 2GB VRAM. At least 10GB disk space.

Is AUTOMATIC1111 free? ›

Is AUTOMATIC1111 free to use? Yes, AUTOMATIC1111 is open-source and free to use. Users can download, modify, and distribute the software without any cost.

How to run Stable Diffusion WebUI? ›

Disclaimer: You must have a GPU to run Stable Diffusion locally.
  1. Step 1: Install Python and Git. ...
  2. Step 2: Create a GitHub and Hugging Face account. ...
  3. Step 3: Clone Stable Diffusion Web-UI. ...
  4. Step 4: Download the latest Stable Diffusion model. ...
  5. Step 5: Setup the Stable Diffusion web UI. ...
  6. Step 6: Run Stable Diffusion locally.

How to speed up AUTOMATIC1111 Stable Diffusion? ›

In AUTOMATIC1111 Web-UI, navigate to the Settings page. Select Optimization on the left panel. In the Cross attention optimization dropdown menu, select an optimization option. The initial selection is Automatic.

Is there anything better than Stable Diffusion? ›

If you are looking for an easy-to-use AI art generator as an alternative to Stable Diffusion, Midjourney is one of your options. With its advanced AI art generation capabilities and ease of use, Midjourney is a user-friendly AI tool.

Will Stable Diffusion be banned? ›

Stability AI's Stable Diffusion 3 has absurd licensing. Stability AI's highly anticipated Stable Diffusion 3 (SD3) model has been temporarily banned on the popular AI art platform Civitai due to concerns over the restrictive nature of its license agreement.

What are the cons of Stable Diffusion? ›

Limitations of Stable Diffusion
  • Image quality - The model was trained on images at various resolutions and can generate images up to 1024x1024. ...
  • Inaccuracies - Insufficient and low-quality training data of human limbs results in anatomical anomalies when prompting the model to generate people.
Apr 24, 2024

Does Stable Diffusion 1.5 allow NSFW? ›

The NSFW ("Safety") Checker

Stable Diffusion 1.5-based image generation models will produce sexual imagery if deliberately prompted, and will occasionally produce such images when this is not intended.

How to undress in Stable Diffusion? ›

Here's the guide on using Stable Diffusion to remove clothing in images:
  1. Load your photo to Stable Diffusion. Launch your Stable Diffusion interface. ...
  2. Masking the clothing that you want to remove. ...
  3. Crafting the prompt and adjust the inpainting settings. ...
  4. Start to remove clothes.
Jul 12, 2024

How to bypass NSFW filter Stable Diffusion? ›

How to remove nsfw filter on stable diffusion?
  1. Access the settings or preferences of the platform or app you are using.
  2. Look for options related to content filtering or safety settings.
  3. Disable or turn off the NSFW filter.
  4. Save the changes and exit the settings or preferences.
Nov 19, 2023

What is Stable Diffusion A1111? ›

Stable Diffusion WebUI (AUTOMATIC1111 or A1111 for short) is the de facto GUI for advanced users. Thanks to the passionate community, most new features come to this free Stable Diffusion GUI first. But it is not the easiest software to use. Documentation is lacking.

What is the use of Stable Diffusion web? ›

Stablediffusionweb.com is an easy-to-use interface for creating images using the recently released Stable Diffusion XL image generation model. It can create high quality images of anything you can imagine in seconds–just type in a text prompt and hit Generate.

How to run Stable Diffusion web UI? ›

  1. How to Run Stable Diffusion Locally.
  2. Step 1: Install Python and Git.
  3. Step 2: Create a GitHub and Hugging Face account.
  4. Step 3: Clone Stable Diffusion Web-UI.
  5. Step 4: Download the latest Stable Diffusion model.
  6. Step 5: Setup the Stable Diffusion web UI.
  7. Step 6: Run Stable Diffusion locally.

What is the difference between ComfyUI and AUTOMATIC1111? ›

Automatic1111 WebUI is terrific for simple image generation, retouching images (inpainting), and basic controls. It's more beginner-friendly. On the other hand, ComfyUI is more performant and provides much greater control to the end-user.

References

Top Articles
Latest Posts
Article information

Author: Mrs. Angelic Larkin

Last Updated:

Views: 5719

Rating: 4.7 / 5 (47 voted)

Reviews: 86% of readers found this page helpful

Author information

Name: Mrs. Angelic Larkin

Birthday: 1992-06-28

Address: Apt. 413 8275 Mueller Overpass, South Magnolia, IA 99527-6023

Phone: +6824704719725

Job: District Real-Estate Facilitator

Hobby: Letterboxing, Vacation, Poi, Homebrewing, Mountain biking, Slacklining, Cabaret

Introduction: My name is Mrs. Angelic Larkin, I am a cute, charming, funny, determined, inexpensive, joyous, cheerful person who loves writing and wants to share my knowledge and understanding with you.