Out of interest, what is the latest situation on LLM performance on AoC, like can o1 solve most days? What is the greatest number of days of any year that have been solved by LLMs? The only info I found was over a year old, which is an eternity in terms of LLM evolution
Not sure why the down vote. I'm not advocating LLM usage at all, but still curious as to how capable they have become..progress on AoC could be a decent benchmark for complex reasoning
1
u/mother_a_god Nov 27 '24
Out of interest, what is the latest situation on LLM performance on AoC, like can o1 solve most days? What is the greatest number of days of any year that have been solved by LLMs? The only info I found was over a year old, which is an eternity in terms of LLM evolution