arjan_Mmade a python script that gives you a canvas where you can paint on the right side and it will update on the left side. In the background it sends an updated image after every paint stroke to the API of automatic1111 and it uses the controlnet scribble model to generate an image. The video is in 4x speed, but it updates quite fast. It really depends on the speed of your graphics card and the controlnet model. It also works with controlnet 1.1 and that is a little bit faster.I can put the script online if anyone is interested.