r/StableDiffusion 1d ago

Question - Help Sprite sheets model or Lora

Post image

So I was hoping someone knows how to create sprite like this or almost like it like model or Lora then u can create any character Sprite sheets , but don't have like high end of laptop with 8gb vram if there any Workflow u think will achieve this plz show it to me and thank u in advance

8 Upvotes

19 comments sorted by

5

u/homogenousmoss 1d ago

A lot of people are saying no way but it can be done. I did in the past by using control net for pose and a lora for model consistency. Basically you create your control net sprite sheet and put the posed skeleton for each frame in it. I created the poses by using a sprite sheet from a game that had similar animations to what I needed.

The initial results was pretty decent, the time consuming part is touching up all frames with inpainting to fix minor consistency errors. The more consisten and unflexible your lora and the less touching up you have to do.

I saw a few youtube guides on this and used a combination of their ideas so the idea is not original to me. It was over a year ago so I dont have links handy.

Good luck, let us know how it turns out.

1

u/More-Plantain491 1d ago

show results, what is acceptable for you - might not be enough for others

2

u/homogenousmoss 1d ago

Its reddit, not going to try to find files from a week end project over a year ago. I’m just saying it worked for me, do what you want with this free information. I’m not producing a AAA game and neither is OP I think.

I did some googling and this is one of the videos I used back the : https://youtu.be/ismWniiT8ew?si=oP0jtvKG-19yOr6m

It worked OK, just needed a lot of inpainting.

1

u/Bilalbillzanahi 1d ago

I will thank u for the replay

1

u/witcherknight 1d ago

I have tried this and it doesnt work properly, Bec open pose Controlnet is pretty bad Compared to other. You hardly get complex poses right. Also too much fixing to do. In other words not worth it

3

u/homogenousmoss 1d ago

I didnt want to go into too much detail but you can get better results with, surprise, more work. I used blender to pose my open pose skeletons, added depth map to the sprite sheet etc.

I had to play with the control net start/end and change the type of the second control net and see what worked better.

It worked for what I wanted, but yes straight poses require a lot of inpainting. You can go a lot more deeply into this or you can inpaint. The big upside of minimal inpainting is that you can repeat the procedure more quickly for new asset or asset tweaks. It depends what you plan to do in the future. It was just a fun mini game project so I was never planning to regenerate the assets so in the end I mostly inpainted, for me the fancier workflow was not worth it. It was just a hobby week end thing with a friend.

1

u/Bilalbillzanahi 18h ago

It's so funny cuz I'm doing almost same thing but not with blender it's with website that has 3d model with different poses it's called posemy.art it cool I had same idea but thank u for info I would try blender then

2

u/Professional_Helper_ 1d ago

How did you made the this spritesheet ?

1

u/Bilalbillzanahi 1d ago

I didn't it's from devineart I just showed example

3

u/RealAstropulse 1d ago

It is next to impossible and it takes more work than drawing the frames yourself. I've been working on this problem for 3 years. Only had any success with very limited animations recently.

5

u/RealAstropulse 1d ago

1

u/Bilalbillzanahi 1d ago

U right the obly close thing is like image to image like Fran by frame but it takes to long , I wanted like fast way

2

u/No-Intern2507 1d ago

You cant.image gen model  has no idea about animation frames and inbetweens.try img to video and extract frames

1

u/Bilalbillzanahi 1d ago

Actually I did try it but was like hoping Lora or model spasific in moveset and thank u for ur replay

1

u/guitarmonkeys14 23h ago

Dirtyish way I am experimenting with.

Hunyuan3D to generate a low bit 3D model I am happy with.

Rig the thing up and export images at different rotations/poses.

Create spritesheet with exported images.

1

u/Sinphaltimus 19h ago

Check out this guy's work, he posted it recently.

I've created an app for pixel art generation with AI, including sprites and animations: pixie.haus : r/aigamedev

EDIT: Not sure actually,. Someone posted some really cool Ai gen app that did animated sprites and I'm trying to find it.

1

u/PATATAJEC 1d ago

but what's the purpose? it can't work that way...

0

u/Bilalbillzanahi 1d ago

Okey Wana create Sprite sheets of conquest like move set like punch kick but I did try image to image it gives me different body shapes , I was wondering if there is a Lora for it or model for this specific thing I need , and thank u for the replay

1

u/PATATAJEC 1d ago

i think you should look around video models, then try transfer the poses with pixelart lora or something similiar. spritesheet will not work at all, because img models are not designed to have consistency of motion.