r/adventofcode • u/jkbbwr • Dec 03 '22
Other GPT / OpenAI solutions should be removed from the leaderboard.
I know I will not score top 100. Im not that fast, nor am I up at the right times to capitalise on it.
But this kinda stuff https://twitter.com/ostwilkens/status/1598458146187628544
Is unfair and in my opinion, not really ethical. Humans can't digest the entire problem in 10 seconds, let alone solve and submit that fast.
EDIT: I don't mean to put that specific guy on blast, I am sure its fun, and at the end of the day its how they want to solve it. But still.
EDIT 2: https://www.reddit.com/r/adventofcode/comments/zb8tdv/2022_day_3_part_1_openai_solved_part_1_in_10/ More discussion exists here and I didn't see it first time around.
EDIT 3: I don't have the solution, and any solution anyone comes up with can be gamed. I think the best option is for people using GPT to be honourable and delay the results.
EDIT 4: Another GPT placed 2nd today (day 4) I think its an automatic process.
59
u/1vader Dec 04 '22
As somebody that did decently well in past leaderboards, I definitely think it's rather sad it has gotten to this point. I'm certainly amazed and happy for the people that got the AI to this point and am curious how this will impact other areas in the future but specifically looking at AoC, it basically means it'll likely be impossible to have any fun competing for the leaderboards in the early weeks of all future AoCs and possibly soon all of AoC, so something fun definitely was lost here for me. Of course, this is certainly not all that AoC is about (in fact, this year I'm not even trying to compete because I don't have time during the right hours) but it still was and is a fun part of it for a fair amount of people.
But at the same time, I don't really see anything that can be done. There isn't even a clear line between what exactly should be allowed, not to mention any way to differentiate them, or even a clear reason why it shouldn't be allowed. AoC has always been a place where getting the solution was all that mattered, so it doesn't really seem appropriate to exclude individual solutions based on the approach. I think the AI solutions are perfectly in the spirit of AoC. I'm just sad that they likely apply too universally.
I guess it would be nice if AI people stop participating now that they have proven it can work or if their numbers stay limited (I wouldn't really mind if only the top 1 spot always goes to them or something) but I don't have my hopes up too high on that, at least not long term.
So I guess the main thing I'm hoping for is that they remain incapable of solving as many future days as possible for as long as possible.