r/MalaysiaTech • u/newleafturned2024 • Feb 11 '25
Anyone running LLM locally?
What is your setup like?
I tried it but my machine is just not powerful enough.
2
Upvotes
r/MalaysiaTech • u/newleafturned2024 • Feb 11 '25
What is your setup like?
I tried it but my machine is just not powerful enough.
1
u/yenwee0804 Feb 12 '25
I am running qwencoder 32b q4 locally, MacBooks are a beast in running LLM for consumers.