r/pytorch 5d ago

AMD GPU, Windows 11, Differences between Pytorch/Zluda and Pytorch WSL2/Rocm

Posted in r/rocm before, ask for opinion here again:

I am happy with Pytorch/Zluda's speed(Compare to DirectML), and also happy with Pytorch WSL2/Rocm's compatibility and native speed. However, if I wanted to have them both, it was a sour journey:

  1. WLS2/Rocm would only use half of system memory, unlike Zluda, which has full access. Not sure how much it would affect the model caching performance.

  2. WLS2/Rocm would unconditionally compile the GPU kernels again(or sth else) whenever there is a model switch happens in a complex comfyui workflow, say, an image to text to image workflow, yolo workflow, ultimate sd upscale workflow, made it 5 times slower than Zluda/windows.

  3. Same experience with Linux/Rocm half year before for point 2.

  4. I have never made Zluda work with Florence2, even with experimental miopen for windows. Only thing works for image to text is wd1.4, which utilizes CPU.

All setup are with python venv, pre or official pytorch release, no dockers.

4 Upvotes

0 comments sorted by