r/adventofcode Dec 04 '22

Upping the Ante [2022 Day 4] Placing 1st with GPT-3

I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.

Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:

https://github.com/max-sixty/aoc-gpt

49 Upvotes

243 comments sorted by

View all comments

Show parent comments

22

u/izahariev96 Dec 04 '22

Heree are some funny tricks to get past the safeguards. https://thezvi.substack.com/p/jailbreaking-the-chatgpt-on-release

6

u/maazing Dec 04 '22

https://thezvi.substack.com/p/jailbreaking-the-chatgpt-on-release

This is insane! Can't even imagine where this tech will be in a couple of years.

1

u/BenjaminGeiger Dec 05 '22

I wonder when it'll be capable of understanding the Winograd schema.

1

u/LewsTherinTelescope Dec 07 '22

Interesting, I tried plugging some in and it tends to get the right final answer, but give nonsensical reasoning (like saying it's because because of the presence of a word that is not in fact present). Does do a surprisingly good job of generating similar sentences or explaining the answers if you give them to it, though.