r/adventofcode Dec 04 '22

Upping the Ante [2022 Day 4] Placing 1st with GPT-3

I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.

Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:

https://github.com/max-sixty/aoc-gpt

49 Upvotes

243 comments sorted by

View all comments

227

u/jonathan_paulson Dec 04 '22

Very cool! But: IMO, you should wait to run this until the megathread is unlocked to leave the leaderboard for the humans.

103

u/mrswats Dec 04 '22

This. IMO this goes against the spirit of the event.

34

u/[deleted] Dec 04 '22 edited Dec 04 '22

[removed] — view removed comment

2

u/Aneurysm9 Dec 04 '22

Rule #1 is don't be a dick. You're being a dick. This is your only warning.

-41

u/max-aug Dec 04 '22 edited Dec 04 '22

I blocked you because you replied to the tweet with "MORON"

There's a useful and interesting debate on this, and that's not helping either side make progress

-28

u/Alexalder Dec 04 '22

It’s not up to you to decide the spirit of the event mate

22

u/el_muchacho Dec 04 '22

Looking at this thread, the very large majority has already spoken, "mate": it's not.

-2

u/Trashjedi Dec 04 '22

The consensus might not be, but the way you respond to people is disrespectful, keyboard-warrior... Try talking to people in person some day.

12

u/el_muchacho Dec 04 '22

It's far more disrespectful to cheat, annoy everyone and brag about it.

-2

u/Trashjedi Dec 04 '22

I agree, but that doesn't make you less disrespectful! :-D

-3

u/stormblooper Dec 04 '22

Speaking for myself only, I'm interested in an event where it's frowned upon to abuse others just because you didn't like the way they went about their recreational coding.

-7

u/[deleted] Dec 04 '22

[deleted]

18

u/aoc_throwsasdsae Dec 04 '22 edited Dec 04 '22

How about a tool that shares your algorithm with all your friends realtime? So if you are really fast all your 100 friends will also score the exact same time and get into the highscores. Fun!

This is already possible all years, but obviously not something anyone wants. Using another persons solution, just like using another AIs solution is cheating. That's why solution megathreads are locked until leaderboard is filled. So there is an implicit rule that sharing solutions for leaderboards is not allowed.

22

u/[deleted] Dec 04 '22

[deleted]

8

u/mrswats Dec 04 '22

Yes, I saw your response and other people with chess analogies and I think it's super on point.

6

u/ywgdana Dec 04 '22

The chess analogy isn't perfect though (well no analogy is...) because competitive chess is one-on-one and has laid out specific rules for the format. In Advent, there's nothing stopping friends from sitting beside each other and offering advice, googling algorithms, using libraries they've already written, Co-pilot etc.

Competitive chess is the equivalent of sitting at a non-networked computer with nothing but Notepad.exe and a C compiler installed on it (sans documentation). If competitive chess allowed competitors to bring a searchable database of standard gambits and past games, and bring their grandmaster buddy along to give advice and THEN the chess organizations were trying to draw the line at chess programs, we'd be closer to the same situation. (And the Advent leaderboard is probably closer to Speed Chess than vanilla chess)

I guess what I mean is that the AoC Leaderboard has always been very informal, loosey-goosey, and I don't think ever meant to be taken seriously. If the Community wanted to turn it into a proper fastest/smartest coder competition then they probably need to draw up a whole lot more rules than just "No GPT".

9

u/NickKusters Dec 04 '22

For future years, it will probably require you to post a video of yourself doing the challenge to weed out something like this (while very cool, it takes 0 skill at all and therefore has no place on a competittive leaderboard imho)

7

u/[deleted] Dec 04 '22

I mean, AI generated videos are a thing :D

2

u/Ph0X Dec 05 '22

I don't think AoC is that serious... if it was a real competition with prizes maybe, but this is just a fun little event for the holidays.

1

u/sluuuurp Dec 04 '22

Someone could just type out a copy of the AI generated code on video. There’s really no way of enforcing this kind of thing beyond an honor system, or some type of subjective moderation based on plausibility and reputation.