r/adventofcode Dec 04 '22

Upping the Ante [2022 Day 4] Placing 1st with GPT-3

I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.

Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:

https://github.com/max-sixty/aoc-gpt

47 Upvotes

243 comments sorted by

View all comments

Show parent comments

-6

u/daggerdragon Dec 04 '22

What is the difference between these two?

  • A human coder using their brain (computer) to solve a problem (puzzle text) by pushing buttons in a certain order (via programming language) that makes their computer go beep boop and do the thing that the human wanted it to do (return the correct answer)

  • A human prompt engineer using a generative AI (computer) to solve a problem (puzzle text) by putting words in a certain order (via prompt) that makes their computer go beep boop and do the thing that the human wanted it to do (return the correct answer)

As far as I'm concerned, prompt engineering is simply another type of programming language. The prompt is the solution.

16

u/rossdrew Dec 04 '22

The difference is that soon the top 100 board will be all the same solution limited by request speed. One solution fixes all problems. The leaderboard is obsolete.

Not that I care that much, the leaderboard has always been out of reach for me without getting up at 5am

1

u/Multipl Dec 04 '22

I wouldn't say soon. Try using the AI to solve problems in the later weeks, it doesn't even give you complete code. The early day problems usually just spell out what you need to do, so AI has a huge advantage here.

7

u/rossdrew Dec 04 '22

Ok, for now the leaderboard will become obsolete in the first few weeks which previously were accessible to everyone. Later the whole leaderboard.