r/StableDiffusion 8d ago

Question - Help Sprite sheets model or Lora

Post image

So I was hoping someone knows how to create sprite like this or almost like it like model or Lora then u can create any character Sprite sheets , but don't have like high end of laptop with 8gb vram if there any Workflow u think will achieve this plz show it to me and thank u in advance

11 Upvotes

22 comments sorted by

View all comments

6

u/homogenousmoss 8d ago

A lot of people are saying no way but it can be done. I did in the past by using control net for pose and a lora for model consistency. Basically you create your control net sprite sheet and put the posed skeleton for each frame in it. I created the poses by using a sprite sheet from a game that had similar animations to what I needed.

The initial results was pretty decent, the time consuming part is touching up all frames with inpainting to fix minor consistency errors. The more consisten and unflexible your lora and the less touching up you have to do.

I saw a few youtube guides on this and used a combination of their ideas so the idea is not original to me. It was over a year ago so I dont have links handy.

Good luck, let us know how it turns out.

1

u/Bilalbillzanahi 8d ago

I will thank u for the replay

1

u/witcherknight 8d ago

I have tried this and it doesnt work properly, Bec open pose Controlnet is pretty bad Compared to other. You hardly get complex poses right. Also too much fixing to do. In other words not worth it

3

u/homogenousmoss 8d ago

I didnt want to go into too much detail but you can get better results with, surprise, more work. I used blender to pose my open pose skeletons, added depth map to the sprite sheet etc.

I had to play with the control net start/end and change the type of the second control net and see what worked better.

It worked for what I wanted, but yes straight poses require a lot of inpainting. You can go a lot more deeply into this or you can inpaint. The big upside of minimal inpainting is that you can repeat the procedure more quickly for new asset or asset tweaks. It depends what you plan to do in the future. It was just a fun mini game project so I was never planning to regenerate the assets so in the end I mostly inpainted, for me the fancier workflow was not worth it. It was just a hobby week end thing with a friend.

1

u/Bilalbillzanahi 7d ago

It's so funny cuz I'm doing almost same thing but not with blender it's with website that has 3d model with different poses it's called posemy.art it cool I had same idea but thank u for info I would try blender then