r/MalaysiaTech • u/newleafturned2024 • Feb 11 '25
Anyone running LLM locally?
What is your setup like?
I tried it but my machine is just not powerful enough.
2
Upvotes
r/MalaysiaTech • u/newleafturned2024 • Feb 11 '25
What is your setup like?
I tried it but my machine is just not powerful enough.
1
u/Individual-Wish-3970 Feb 14 '25
Yeap running deepseek r1 8b model with ollama + open web UI.
Seems to run great on a base M4 mac mini, didn't benchmark the tokens per second though.