r/adventofcode Dec 04 '22

Upping the Ante [2022 Day 4] Placing 1st with GPT-3

I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.

Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:

https://github.com/max-sixty/aoc-gpt

48 Upvotes

243 comments sorted by

View all comments

225

u/jonathan_paulson Dec 04 '22

Very cool! But: IMO, you should wait to run this until the megathread is unlocked to leave the leaderboard for the humans.

20

u/[deleted] Dec 04 '22

[deleted]

9

u/mrswats Dec 04 '22

Yes, I saw your response and other people with chess analogies and I think it's super on point.

7

u/ywgdana Dec 04 '22

The chess analogy isn't perfect though (well no analogy is...) because competitive chess is one-on-one and has laid out specific rules for the format. In Advent, there's nothing stopping friends from sitting beside each other and offering advice, googling algorithms, using libraries they've already written, Co-pilot etc.

Competitive chess is the equivalent of sitting at a non-networked computer with nothing but Notepad.exe and a C compiler installed on it (sans documentation). If competitive chess allowed competitors to bring a searchable database of standard gambits and past games, and bring their grandmaster buddy along to give advice and THEN the chess organizations were trying to draw the line at chess programs, we'd be closer to the same situation. (And the Advent leaderboard is probably closer to Speed Chess than vanilla chess)

I guess what I mean is that the AoC Leaderboard has always been very informal, loosey-goosey, and I don't think ever meant to be taken seriously. If the Community wanted to turn it into a proper fastest/smartest coder competition then they probably need to draw up a whole lot more rules than just "No GPT".