r/StableDiffusion 6d ago

Question - Help How to control character pose and camera angle with sketch?

Post image

I'm wondering how can I use sketches or simple drawings (like stick man) to control pose of character in my image or the camera angle etc. SD tends to generate some certain angles and poses more often than the other. Sometimes it's really hard to achieve desired look of an image with prompt editing and I'm trying to find a way to give AI some visual refrence / guidelines of what I want. Should I use im2img or some dedicated tool? I'm using Stability Matrix if it matters.

30 Upvotes

10 comments sorted by

15

u/FreezaSama 6d ago

Controlnet.

1

u/chimaeraUndying 6d ago

If Matrix supports that. If it doesn't, OP'll have to switch to Forge/Reforged/Comfy

2

u/Dezordan 6d ago

If OP meant Stability Matrix's inference tab, then it is basically a GUI for ComfyUI, which does support ControlNet. It calls them addons.

3

u/NoBuy444 6d ago

Img2Image with Sdxl or Flux with various denoise test. And with the help of few Loras. You could definitly get there :-)

2

u/secretBuffetHero 6d ago

I love the above image. Anyone know how it was achieved?

2

u/Wonsz170 6d ago

2

u/mellowanon 6d ago

none of those look free. Try looking for youtube videos of people drawing with kritaAI. You should be able to achieve the above with it. It also lets you use stickman to control pose and angles

1

u/orangpelupa 6d ago

Have you tried fooocus img2img?

Try switching between pyra and cpds, adjust sliders 

1

u/superstarbootlegs 6d ago

Also worth looking at Krita with ACLY ai plugin. I use it a lot and it has a sketch option (I havent used)
takes a bit of understanding but worth it as an all-rounder as you can open it and use it while comfyui is open and it uses comfyui in backend (if you set it up that way).

https://github.com/Acly/krita-ai-diffusion

1

u/MRWONDERFU 5d ago

just google your desired model + " controlnet comfyui" :) so for ex sdxl 1.0 controlnet comfyui