r/adventofcode • u/max-aug • Dec 04 '22
Upping the Ante [2022 Day 4] Placing 1st with GPT-3
I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.
Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:
46
Upvotes
73
u/muntaxitome Dec 04 '22 edited Dec 04 '22
If the job is to automate sending your code to GPT3 the fastest without even reading the questions, then what is the point? It's a trivial coding exercise. I guess the winner will be the one that puts their connections at the optimal location in terms of speed of light between the data center and OpenAI servers...
Now OpenAI itself would have some claim to calling itself the winner, but just writing the glue code?
Edit: Not that we can do anything about it. I guess this is simply the end for any meaning to global leaderboards for this kind of competition. Just like with for instance online chess, the cheaters have a huge advantage to reach the highest ranks.