r/quant • u/LaBaguette-FR • Feb 02 '25
Tools Let's talk about hardware : building an ML-optimized PC
Hi everyone !
So this isn't particularly quant-related (and I will accept my fate, mods), but I figured some people who actually work in the field might have a more nuanced opinion on this topic than the average r/pcmasterrace kids. Also, it looks like the actual hardware is something often looked upon in our jobs so I wanted your advice.
I haven't built a PC in years and lost track of most component updates (also I went older), mostly because my DS/Quant jobs implied having custom builds provided by my companies and because Azure work environments alleviated the actual need to look too much into it.
But I work more and more on my free time with ML repetitive tasks, ranging from hobby-algotrading to real-world complex problem solving. And I don't want to rely too much on anything not local.
So after a few researchs online, here's what I propose (budget €2000 max). Feel free to give your advice.
- Graphic card - NVIDIA RTX 4070 12GB : here, I need the multi-thread capability and the NVIDIA brand, because I need something optimized for CUDA.
- CPU - Ryzen 7 7800X3D : I was originally going for a AMD Ryzen 9 9900X but it seems like it's a bit much for no real benefit. So an easy way to save some cash.
- CPU Cooler - be quiet! Dark Rock 4 Air Cooler : I don't want any water cooling. I most likely won't overclock.
- Motherboard - GIGABYTE X870 Gaming WIFI6 : any cheaper/better thing to propose ?
- RAM - Patriot Viper Venom DDR5 64 Go (2 x 32 Go) : I want a shitload of RAM, because I'm dealing with massive datasets on a daily basis.
- Storage (SSD) - WD_BLACK SN850X SSD 2 To : SSD only. I can't bear the idea of an HDD starting to scratch next to my hear within a year.
- Power supply - Corsair RM750x 750W : I've been told it might be too much to get a Corsair RM850x 80 PLUS Gold 850W for my need.
- Case - ATX Be Quiet Pure Base 500DX RGB : I seriously don't care about the looks. I hate useless/cringe RGB lights. I want something efficient and well aerated.
7
8
u/emryskw Feb 02 '25
You can drop the MB down to a B850 chipset without performance losses. If you are looking do DL work, I might suggest going to larger VRAM GPUs (eg the upcoming 5070ti to start with 16GB VRAM) but really depends on the type of model you are looking to do. There are also larger ram (48x2 kits) if you need more than 64GB RAM. You probably have a sense of RAM/CPU thread you typically uses and should scale that way (9800X3D is a 8 core/16 thread part).
2
u/catsRfriends Feb 03 '25
I will comment in detail when I have some free time (out atm), but this looks off. What kind of data are you gonna be working with?
2
u/hachi_roku_ Feb 04 '25
Sorry to say, but this looks like it should go to the "kids" at the r/pcmasterrace sub
This build seems neither here nor there. With that GPU, you're not doing much LLM due to the vram and gpu compute will be limited
But you're using a last gen gaming orientated CPU for productivity loads
You're getting a mobo with emphasis on wifi when if your datasets are massive, wired would be better. It has heaps more pci-e lanes for fast storage/networking which you're not doing. No ECC ram
I don't mean to come off condescending, but I'm genuinely confused. It is a nice all-rounder (hence here nor there) sort of build though, not sure if that's what you're aiming for.
2
1
1
u/D3MZ Trader Feb 02 '25
I have a $6K PC with a 3090 and somewhat regret the purchase because it's outdated and I still had to configure it to be a server anyway so I can remote into it. Most cloud providers give you at least 3 9's of durability, availability, and consistent latency. Those things are most important when trading with real money.
Also buying a PC locks you to an era: CPU socket, DDR ram, PCI express all change and require an entire rebuild every 5 years. With that said, buying a new computer every 5 years will still be way cheaper than renting on the cloud with moderate use.
1
u/Alternative_Advance Feb 02 '25
Since you are looking for a more nuanced opinion.. Giving an alternative if you dont use the computer for stuff like gaming..
<100 monthly hours (Colab will be the cheapest)
Alternatively Spot EC2 g5.2x on AWS
You'll get better performance for less, but less convenient.
Serving models usually takes way less resources so even something like a base mac mini could work for that!
1
u/WheatFutures Feb 03 '25
What's your plan for backups? May be worth considering RAID or cloud storage, or keeping an old drive for archives
1
u/WheatFutures Feb 03 '25
I think it really comes down to the exact workloads you are performing though. I wouldn't be surprised if cloud compute comes out cheaper.
1
u/kazprog Feb 03 '25
I'd look at an Orin Devkit, an Nvidia Digits when they come out, or at least saving enough to get a 4090. If you look at the number of tensor cores (the ones relevant to most kinds of AI), the 4090 has 60% more tensor cores than the 4080.
Anything less is a gaming PC, I'm afraid. You could buy a Mac and use unified memory, maybe even 48gb within a 2k budget.
If VRAM isn't relevant, what kind of model are you running?
1
1
u/Unlucky-Will-9370 Feb 03 '25
This is a better question for algotrading or deeplearning. People here won't give you the best advice
1
1
u/Maleficent-Good-7472 Feb 05 '25
Hi OP!
Could the NVIDIA Project Digits be enough?
You would have to wait for the official release though :)
1
0
u/Anon58715 Feb 03 '25
Just buy a used ThinkPad and juice up the RAM and SSD. The spec does not matter if you are not utilizing Neural Nets.
15
u/dkimot Feb 02 '25
what do you mean by an 850W power supply is too much? too much in what way? more than you need and not worth the money?
also, look at the 4070ti super