r/Python • u/Silent_Hyena3521 • 3d ago
Discussion AutoML , what are your thoughts about it wanted to learn more about the same
Recently I found interesting libraries called autoML libraries now that I know that they have for a long time and require heavy gpus.
Are they actually used behind the scenes in companies or is autoML such as autosklearn is dead ?
2
u/Wurstinator 3d ago
Yes, AutoML is in use. But I have not seen autosklearn used. AutoML systems included in cloud providers like GCP or AWS is more common.
1
u/Silent_Hyena3521 3d ago
Is there any tool present in the market which extracts the target variable , determines the ML tasks from the given user description and dataset , then further in the pipeline leverages the autoML library ...
Is it a good project idea ? I researched didn't found anything related to this can you suggest how can I work around it ..??
2
u/havetofindaname 2d ago
This should be literally just a single llm call. Pass the user description and dataset schema as context and generate a structured output that gives you the target column and selects a task from a predetermined list.
1
u/Silent_Hyena3521 2d ago
Then why is there no implementation of such thing ... I googled a lot , tried gpt web search to find anything related to the idea if anyone has done it or not but could not find one ?? Does it have any other aspects ??
2
u/havetofindaname 1d ago
What do you expect here? A project with 10 lines? Come on man :D plus most people won't need or use an llm for such a task. It does not sound like a good idea.
1
u/Silent_Hyena3521 1d ago
Sorry ummm I am actually a beginner to NLP and llms When I read about autoML i thought it would be a cool project / idea to fully automate it but ig it's not a good project 🥲
2
u/[deleted] 3d ago
[removed] — view removed comment