Drawing with Stable Diffusion

Drawing with Stable Diffusion

arjan_M made a python script that gives you a canvas where you can paint on the right side and it will update on the left side. In the background it sends an updated image after every paint stroke to the API of automatic1111 and it uses the controlnet scribble model to generate an image. The video is in 4x speed, but it updates quite fast. It really depends on the speed of your graphics card and the controlnet model. It also works with controlnet 1.1 and that is a little bit faster.I can put the script online if anyone is interested.

Here is the github repo
houseofsecrets/SdPaint: Stable Diffusion Painting (github.com)

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.