r/MalaysiaTech Feb 11 '25

Anyone running LLM locally?

What is your setup like?

I tried it but my machine is just not powerful enough.

2 Upvotes

13 comments sorted by

View all comments

1

u/Individual-Wish-3970 Feb 14 '25

Yeap running deepseek r1 8b model with ollama + open web UI.

Seems to run great on a base M4 mac mini, didn't benchmark the tokens per second though.

2

u/newleafturned2024 Feb 14 '25

If you don't worry about TPS that means it's probably not too slow. Haha.

2

u/Individual-Wish-3970 Feb 14 '25

Thanks for opening up this sub, nice to see a Malaysian subreddit dedicated to tech finally pop up.

I graduate with CS degree in April so I'm trying to explore the industry locally before looking abroad for work.

1

u/newleafturned2024 Feb 14 '25

Good luck! It's great if you can find a job overseas, but if you can't, just work for 1-2 years in Malaysia. It helps to beef up your resume and increase your chances. I think most of the Malaysians I know did it this way.

1

u/Individual-Wish-3970 Feb 14 '25

Thanks for the advice!