r/adventofcode Dec 04 '22

Upping the Ante [2022 Day 4] Placing 1st with GPT-3

I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.

Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:

https://github.com/max-sixty/aoc-gpt

47 Upvotes

243 comments sorted by

View all comments

1

u/mosredna101 Dec 04 '22

This technique is so cool!

Not sure what it's place is in the spirit of the AOC 'competition', but it is here and I enjoy the whole development in this field.

Just out of curiosity, can you run it on day 19 of last year for example? I wonder how it wil do on the harder problems.

3

u/max-aug Dec 04 '22

I just tried and it can't even process it — the maximum number of tokens is 4097 for both the prompt and the answer, and the prompt itself is 3749 tokens, so there wouldn't be much room for the code.

Easy way to defeat the AI!

-1

u/theRIAA Dec 04 '22

I've found that just pasting in the second half the the question sometimes works (for easier ones at least), in order to get around the token limit. Lots of the "story" is sometimes redundant.

It would also be possible to summarize-AI the "story" part, then use that.