How to Use img2img in Stable Diffusion (Step-by-Step)

Mukund Kapoor
By Mukund Kapoor - Author 5 Min Read
5 Min Read

For those who haven’t been blessed with innate artistic abilities, fear not!

Img2Img and Stable Diffusion can help elevate your drawings while preserving the original color and composition.

This powerful AI-driven tool can transform the simplest sketches into visually stunning masterpieces.

In this comprehensive guide, we’ll walk you through setting up the software, using the color sketch tool, and leveraging Img2Img to turn amateur sketches into professional artwork.

What is Img2Img in Stable Diffusion

Img2Img is a cutting-edge technique that generates new images from an input image and a corresponding text prompt.

Img2Img in Stable Diffusion

The output image retains the original color and composition of the input image.

It’s important to note that the input image does not need to be intricate or visually appealing.

The main focus should be on the color and composition, as these elements will be carried over to the final output.

Setting up The Software for Stable Diffusion Img2img

For this tutorial, we will use the AUTOMATIC1111 GUI, which offers an intuitive interface for the Img2Img process.

Now it’s time to enable the color sketch tool so that we can either draw or add images for reference.

By default, the color sketch tool is not enabled in the AUTOMATIC1111 GUI. However, activating it significantly simplifies the Img2Img process.

Here’s how to enable the color sketch tool:

Add the following argument when running

--gradio-img2img-tool color-sketch

On Windows systems, edit the webui-user.bat file in the stable-diffusion-webui folder.

Modify the line:



"set COMMANDLINE_ARGS=--gradio-img2img-tool color-sketch". 

Make sure there’s a space before adding the new text. Double-click the file to launch the GUI.

This option is already enabled by default in the Colab Notebook Quick Start Guide.

After setting up the color sketch tool, it’s time to learn how to use it. To use the color sketch tool, follow these steps:

Go to the Img2Img tab in the AUTOMATIC1111 GUI and upload an image to the canvas.

Click the color palette icon, followed by the solid color button, then, the color sketch tool should now be visible.

Now you can draw in color, adding vibrancy and depth to your sketches.

How to Use img2img in Stable Diffusion

Now that we have set up the software and are familiar with the color sketch tool, let’s walk through the process of turning a simple sketch into a professional piece of artwork.

Step 1: Set the background

First, upload a black or white 512×512-pixel background to the canvas. This will serve as the foundation for your drawing.

How to Use img2img in Stable Diffusion

Step 2: Draw the Image

Using the color palette tool, sketch the doodle. Focus on capturing the color, shape, and overall composition, rather than perfecting the details.

Step 3: Apply Img2Img

With your sketch in place, it’s time to apply the Img2Img technique. Follow these steps:

Select the v1-5-pruned-emaonly.ckpt from the Stable Diffusion checkpoint dropdown.

Create a descriptive prompt for your image, for example “photo of a realistic banana with water droplets, and dramatic lighting.”

Enter this prompt in the text box.

Set the image width and height to 512, sampling steps to 20, sampling method to DPM++ 2M Karras, batch size to 4, and seed to -1 (random).

How to Use img2img in Stable Diffusion

Experiment with the CFG scale and denoising strength to achieve the desired level of transformation.

Click Generate to produce four new images based on your input sketch and prompt. Examine the generated images and save the one you like best.


You can opt for a second round of Img2Img for further refinement and enhanced detail. Also, watch the tutorial below to get a better understanding of how img2img works in Stable Diffusion⬇

The End!

Img2Img, powered by Stable Diffusion, gives users a flexible and effective way to change an image’s composition and colors. This provides users more control than the traditional text-to-image method.

By following this detailed guide, even if you’ve never drawn before, you can quickly turn your rough sketches into professional-quality art.


Based on our quality standards, we deliver this website’s content transparently. Our goal is to give readers accurate and complete information. Check our News section for latest news. To stay in the loop with our latest posts follow us on Facebook, Twitter and Instagram

Subscribe to our Daily Newsletter to join our growing community and if you wish to share feedback or have any inquiries, please feel free to Contact Us. If you want to know more about us, check out our Disclaimer, and Editorial Policy.

By Mukund Kapoor Author
Mukund Kapoor, the enthusiastic author and creator of GreatAIPrompts, is driven by his passion for all things AI. With a special knack for simplifying complex AI concepts, he's committed to helping readers of all levels - be it beginners or experts - navigate the intriguing world of artificial intelligence. Through GreatAIPrompts, Mukund ensures that readers always have access to the most recent and relevant AI news, tools, and insights. His dedication to quality, accuracy, and clarity is what sets his blog apart, making it a reliable go-to source for anyone interested in unlocking the potential of AI. For more information visit Author Bio.
1 Comment

Leave a Reply

Your email address will not be published. Required fields are marked *