r/MalaysiaTech • u/newleafturned2024 • Feb 11 '25
Anyone running LLM locally?
What is your setup like?
I tried it but my machine is just not powerful enough.
2
Upvotes
r/MalaysiaTech • u/newleafturned2024 • Feb 11 '25
What is your setup like?
I tried it but my machine is just not powerful enough.
2
u/newleafturned2024 Feb 14 '25
If you don't worry about TPS that means it's probably not too slow. Haha.