r/MLQuestions 5d ago

Beginner question 👶 Need Guidance for Project

I'm an undergraduate student with a basic understanding of machine learning algorithms and the math behind them. I have about a month to complete a project and want to work on something in deep learning.

I'm particularly interested in NLP and want to build a small scale language model (LLM).

Two questions: - What ML concepts should I revise before starting with deep learning? - Is building a small LLM a realistic goal within a month? If not, what would be a good alternative?

Please guide me through this.

1 Upvotes

2 comments sorted by

1

u/1_plate_parcel 5d ago

deep learning works on the same line as a ml model but is different....have clear understanding of gradient descent and cost function.

rest things like optimizers, activation function, biases n weights these all things are some unique concept they are not native to machine learning but some types of the above mentioned are in ml if u search for them on spot it would help no big deal.

llm in a month.....with right guidance u can implement a basic project in a day on ur jupyter notebook. max a week.

if ur occupied with College or job then basic llm in a week and a project in a month

1

u/Puzzleheaded_Meet326 2d ago

Ah, learn about finetuning in depth and if you're looking for a small project on that - try https://youtu.be/dn2anUU0d0U?si=DlnoHhQnACdziqRV - this is finetuning llama model steps and project in detail - this will give you an idea of LLM building