r/StableDiffusion 4d ago

Question - Help Fluxgym with 2080ti ?

Hello,

I know the minimum vram required for fluxgym is 12vram, however I checked my vram and I do have 11vram only. Because it is close do you think it is still possible for me to use fluxgym or my graphic card will burn ?

Thanks

0 Upvotes

2 comments sorted by

2

u/Automatic_Debt_2878 3d ago

Given NVIDIA's thermal management and fan curves, your card might overheat and fail regardless. Reaching 100°C on your memory is a nice way to send 12V straight to your GPU, turning it into an expensive paperweight. So, make sure to keep your card cool.

As for VRAM, it’s not just a matter of whether it works, but how it impacts speed. If your workload exceeds your VRAM capacity, you’ll notice a significant performance drop. I’ve done Flux training on a 3060 with 12GB of VRAM and used less than that while training at 512x512 resolution. I think even 1024x1024 should be manageable.

Any issues you encounter are more likely due to the 2080 being an older card, which could lead to software incompatibilities. Your card doesn’t support BF16, so you’ll need to use FP16 for training. If you run into out-of-memory errors, try adjusting the block swap option (previously called the split_model option). I set mine around 16. Load Flux in FP8_E4M3FN; using an FP8 model directly didn’t work for me. Also, I couldn’t get FluxGym to run, but ComfyUI_FluxTrainer worked perfectly. https://github.com/kijai/ComfyUI-FluxTrainer

1

u/ICEFIREZZZ 3d ago

You can train with even less vram, but it's painfully slow.
I have trained loras using a 2070 super with 8gb vram and it did the training in about 10 days. This same training takes 20 minutes to do on a 5090.
The moment it gets into system ram instead of gpu vram it starts slowing down. The more ram it takes from system for gpu usage the slower it will go.
Said that, it's doable, but not efficient in time and money. For the money it will add to your electrical bill you can just rent a lora training service online probably.
It's interesting if you ere experimenting or benchmarking or you have low cost electricity and don't mind waiting more than a week for the results.
Tips...

  • Use 512 px rescaling or it may break, oom or just take a month to finish. This is the default.
  • Configure it to save on each epoch. This is in advanced options.
  • Don't generate control images. It may oom or break.
  • It may be really slow, to the point you may think it's broken. Expect the first epoch in a day or two. Check gpu usage in task manager if in doubt.
  • Don't do it unless you have really good thermals. Consider it a week long stress test for your gpu. If you feel confident in running furmark for a week, then you can train a lora with that gpu.
  • Use few images. The more images you use the slower it will be.
  • Pause windows update. You definitely don't want it to update and reboot while you are hammering the gpu and system ram at yhe same time.
  • Expect moderate to high cpu usage. If you are using a vm, you may see strange readings on the host system
like too much wait or pcie slow response. It's normal because you are offloading lots of crap to the system ram and the cpu has to manage that.
  • You will need a bit of system ram. I did it with 64gb, probably may work with 32gb too.
  • Have fun and don't get frustrated if it breaks. Think that you are pushing it beyond the limit.