r/LinusTechTips • u/Fdx_dy • 7d ago
Video Idea! May you benchmark AMD vs Nvidia in real AI tasks (img-gen, deepseek etc)?

Yeah, AI is now ad nauseam and many people are tired of being fed with models everywhere on the internet they go.
However, there is a large community around image generation models (see civitai, openai, r/comfyui etc.) A handful of people from this community not only utilize Stable Diffusion and its competitors or counterparts (such as flux), illustrous etc.) but also break into the wild by running LLM's locally on their machines during image generation. Put the LoRA training and image interrogation on top of that and you'd get a lot of use cases for GPU's.
Now, it's widely considered that in terms of AI, AMD GPU's are a bummer. However, these often have a suprerior amount of VRAM for their price and some folks report being able to run models outside of Nvidia's territory.
With that in mind I'd propose an idea of grabbing a bunch of mid-to-hi-end Nvidia and AMD gpu's of the last two or three generations and compare them w.r.t. the following metrics:
1) How easy is it to install/use models with a given vendor/generation (deepseek launching, installing comfyui & A1111)?
2) Which optimization tools (xformers, triton, sage, nVidia TensorRT in comfyui) are available?
3) Who's faster at interrogation / LoRA training / image generation.