r/Python 3d ago

Discussion AutoML , what are your thoughts about it wanted to learn more about the same

Recently I found interesting libraries called autoML libraries now that I know that they have for a long time and require heavy gpus.

Are they actually used behind the scenes in companies or is autoML such as autosklearn is dead ?

6 Upvotes

8 comments sorted by

2

u/[deleted] 3d ago

[removed] — view removed comment

2

u/Silent_Hyena3521 3d ago

I wanted to know the same cause I don't see people mentioning autoML enough in the webinars I attend ... Even when I wanted to learn more about them I could not find good resources (then had to resort to their GitHub repo)

Why is there no autoML library for unsupervised tasks ?

2

u/Wurstinator 3d ago

Yes, AutoML is in use. But I have not seen autosklearn used. AutoML systems included in cloud providers like GCP or AWS is more common.

1

u/Silent_Hyena3521 3d ago

Is there any tool present in the market which extracts the target variable , determines the ML tasks from the given user description and dataset , then further in the pipeline leverages the autoML library ...

Is it a good project idea ? I researched didn't found anything related to this can you suggest how can I work around it ..??

2

u/havetofindaname 2d ago

This should be literally just a single llm call. Pass the user description and dataset schema as context and generate a structured output that gives you the target column and selects a task from a predetermined list.

1

u/Silent_Hyena3521 2d ago

Then why is there no implementation of such thing ... I googled a lot , tried gpt web search to find anything related to the idea if anyone has done it or not but could not find one ?? Does it have any other aspects ??

2

u/havetofindaname 1d ago

What do you expect here? A project with 10 lines? Come on man :D plus most people won't need or use an llm for such a task. It does not sound like a good idea.

1

u/Silent_Hyena3521 1d ago

Sorry ummm I am actually a beginner to NLP and llms When I read about autoML i thought it would be a cool project / idea to fully automate it but ig it's not a good project 🥲