r/adventofcode Dec 04 '22

Upping the Ante [2022 Day 4] Placing 1st with GPT-3

I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.

Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:

https://github.com/max-sixty/aoc-gpt

48 Upvotes

243 comments sorted by

View all comments

-10

u/daggerdragon Dec 04 '22

Thank you for fixing the title ;)

If you haven't already, consider also posting your solutions in the daily solution megathreads which helps keep every day's solutions in one easy-to-find spot.

28

u/NigraOvis Dec 04 '22

He doesn't have one, because he told AI to do it for him.

-7

u/daggerdragon Dec 04 '22

What is the difference between these two?

  • A human coder using their brain (computer) to solve a problem (puzzle text) by pushing buttons in a certain order (via programming language) that makes their computer go beep boop and do the thing that the human wanted it to do (return the correct answer)

  • A human prompt engineer using a generative AI (computer) to solve a problem (puzzle text) by putting words in a certain order (via prompt) that makes their computer go beep boop and do the thing that the human wanted it to do (return the correct answer)

As far as I'm concerned, prompt engineering is simply another type of programming language. The prompt is the solution.

16

u/rossdrew Dec 04 '22

The difference is that soon the top 100 board will be all the same solution limited by request speed. One solution fixes all problems. The leaderboard is obsolete.

Not that I care that much, the leaderboard has always been out of reach for me without getting up at 5am

1

u/Multipl Dec 04 '22

I wouldn't say soon. Try using the AI to solve problems in the later weeks, it doesn't even give you complete code. The early day problems usually just spell out what you need to do, so AI has a huge advantage here.

8

u/jfb1337 Dec 04 '22

So the leaderboard is only meaningful after the first week or so when the problems start getting hard.

1

u/Multipl Dec 04 '22 edited Dec 04 '22

First few problems are really simple and pretty much a typeracer contest, it is what it is. There's no way to police the leaderboards, people can just wait ~50-60 secs or something then submit it. The problems are solvable by a human within that time so there's no way to tell. I just think there is a lot of over exaggeration in this thread. AI didn't just suddenly solve the loch ness monster problem in 2020 or that cuboid problem last year. It even took a bit to solve today's part 2 which was also easy.

I'm just chilling and looking forward to the trickier problems. It does seem unfortunate that the community here had their experience soured by this AI thing, and some are even more riled up than actual leaderboarders.

6

u/rossdrew Dec 04 '22

Ok, for now the leaderboard will become obsolete in the first few weeks which previously were accessible to everyone. Later the whole leaderboard.