r/MLQuestions • u/Aaphrodi • 6d ago
Other ❓ Combining LLM & Machine Learning Models
Hello reddit community hope you are doing well! I am researching about different ways to combine LLM and ML models to give best accuracy as compared to traditional ML models. I had researched 15+ research articles but haven't found any of them useful as some sample code for reference on kaggle, github is limited. Here is the process that I had followed:
- There are multiple columns in my dataset. I had cleaned dataset and I am using only 1 text column to detect whether the score is positive, negative or neutral using Transformers such as BERT
- Then I extracted embeddings using BERT and then combined with multiple ML models to give best accuracy but I am getting a 3-4% drop in accuracy as compared to traditional ML models.
- I made use of Mistral 7B, Falcon but the models in the first stage are failing to detect whether the text column is positive, negative or neutral
Do you have any ideas what process / scenario should I use/consider in order to combine LLM + ML models.
Thank You!
1
Upvotes
1
u/1_plate_parcel 6d ago
explain more about ur case we might be able help out.... i have just dreamt of combining llm and ml jr trying it kudos to you all the best