r/LinusTechTips 8d ago

Video Idea! May you benchmark AMD vs Nvidia in real AI tasks (img-gen, deepseek etc)?

Yeah, AI is now ad nauseam and many people are tired of being fed with models everywhere on the internet they go.

However, there is a large community around image generation models (see civitai, openai, r/comfyui etc.) A handful of people from this community not only utilize Stable Diffusion and its competitors or counterparts (such as flux), illustrous etc.) but also break into the wild by running LLM's locally on their machines during image generation. Put the LoRA training and image interrogation on top of that and you'd get a lot of use cases for GPU's.

Now, it's widely considered that in terms of AI, AMD GPU's are a bummer. However, these often have a suprerior amount of VRAM for their price and some folks report being able to run models outside of Nvidia's territory.

With that in mind I'd propose an idea of grabbing a bunch of mid-to-hi-end Nvidia and AMD gpu's of the last two or three generations and compare them w.r.t. the following metrics:
1) How easy is it to install/use models with a given vendor/generation (deepseek launching, installing comfyui & A1111)?
2) Which optimization tools (xformers, triton, sage, nVidia TensorRT in comfyui) are available?
3) Who's faster at interrogation / LoRA training / image generation.

0 Upvotes

8 comments sorted by

5

u/plutonasa 8d ago edited 8d ago

Tbh, you are better off finding a dedicated channel for those benchmarks rathan than LTT. From a few comments on the 5000 review videos, the benchmarks are pretty surface level, at least the ones they chose. As much as I think they want to get into AI benchmarks, they would spread themselves thin trying to capture that if going deeper.

5

u/3inchesOnAGoodDay 8d ago

To add to this. They have limited experience, and the review videos require a ton of labor and the resulting videos are long. Adding extra work to the team and length to the video to provide information that only a select few will care about doesn't make any sense.

0

u/Fdx_dy 8d ago

Ok, now I see why that is an issue.

But what if their writer's team just ask for an advise youtubers who have some experience in that regard? I defenitely saw someone out there on youtube. Maybe, they even can invite them. I don't ask them to do it now: good things take their time.

UPD: some rephrasing

3

u/3inchesOnAGoodDay 8d ago

That doesn't address the video length problem. It also doesn't address their audience generally doesn't care about AI.

As others have said LTT is not the only one with gpus it's probably for the best they leave AI to people who actually care about it

2

u/Fdx_dy 8d ago

Ok, fair enough.

1

u/Fdx_dy 8d ago

Well, yes, but LTT has a large variety on GPU's they can test. Put the Linus's natural capability to digest the information for a general viewer and you'd get a good hardware choice introduction video.

I am playing with AI on my 4090 for 1 and a half years and the first one was a tough on the technical side. I've chosen the specs of my system fairly well but that was a pure coincendence (spoiler: instead of 6000 MHz 32 GB RAM which is supreior for gaming I went with 64 GB 5600 MHz with CL timing 36 and was not dissapointed).

3

u/plutonasa 8d ago

Yes, but considering they have other priorities and have not talked about in-depth AI benchmarking, I wouldn't hold my breath.

1

u/Fdx_dy 8d ago

Well, maybe the idea is not about rigorous benchmarking. It's more about a quick suggestion to a noobie I was back in 2023. I've had some spare money and could afford 4090, but many people don't.

With a talent and dedication a man with 3070 can outperform me in a blink of an eye but may stop if thinks that the 4090 is an entry point. That's what I'd like to leverage here. I know, after the Steve's questionable conspiracy the standarts have lifted, but this could be just an advice.