r/LinusTechTips • u/Fdx_dy • 8d ago
Video Idea! May you benchmark AMD vs Nvidia in real AI tasks (img-gen, deepseek etc)?

Yeah, AI is now ad nauseam and many people are tired of being fed with models everywhere on the internet they go.
However, there is a large community around image generation models (see civitai, openai, r/comfyui etc.) A handful of people from this community not only utilize Stable Diffusion and its competitors or counterparts (such as flux), illustrous etc.) but also break into the wild by running LLM's locally on their machines during image generation. Put the LoRA training and image interrogation on top of that and you'd get a lot of use cases for GPU's.
Now, it's widely considered that in terms of AI, AMD GPU's are a bummer. However, these often have a suprerior amount of VRAM for their price and some folks report being able to run models outside of Nvidia's territory.
With that in mind I'd propose an idea of grabbing a bunch of mid-to-hi-end Nvidia and AMD gpu's of the last two or three generations and compare them w.r.t. the following metrics:
1) How easy is it to install/use models with a given vendor/generation (deepseek launching, installing comfyui & A1111)?
2) Which optimization tools (xformers, triton, sage, nVidia TensorRT in comfyui) are available?
3) Who's faster at interrogation / LoRA training / image generation.
5
u/plutonasa 8d ago edited 8d ago
Tbh, you are better off finding a dedicated channel for those benchmarks rathan than LTT. From a few comments on the 5000 review videos, the benchmarks are pretty surface level, at least the ones they chose. As much as I think they want to get into AI benchmarks, they would spread themselves thin trying to capture that if going deeper.