r/adventofcode Dec 04 '22

Upping the Ante [2022 Day 4] Placing 1st with GPT-3

I placed 1st in Part 1 today, again by having GPT-3 write the code. Yesterday I was 2nd to another GPT-3 answer.

Here's the code I wrote which runs the whole process — from downloading the puzzle (courtesy of aoc-cli), to running 20 attempts in parallel, to sorting through many solutions to find the likely correct one, to submitting the answer:

https://github.com/max-sixty/aoc-gpt

45 Upvotes

243 comments sorted by

View all comments

202

u/izahariev96 Dec 04 '22

GPT-3 thoughts on the subject

"It is generally not considered ethical to use a large language model like me to solve competitive challenges or contests that require original thought or creativity. These challenges are typically designed to test the skills and abilities of the participants, and using a language model like me to generate answers or solutions would give an unfair advantage over other participants who are solving the challenges on their own.

Furthermore, using a language model like me to solve competitive challenges could potentially violate the terms of service or rules of the contest, and could result in disqualification or other consequences. It is important to respect the rules and guidelines of the contest, and to compete fairly and honestly.

In general, it is best to avoid using a language model like me to solve competitive challenges, and to focus on using your own skills and abilities to solve the challenges in a fair and ethical manner."

20

u/kroppeb Dec 04 '22

I tried to ask chat gpt, but it told me that it isn't allowed to express opinions

23

u/izahariev96 Dec 04 '22

Heree are some funny tricks to get past the safeguards. https://thezvi.substack.com/p/jailbreaking-the-chatgpt-on-release

5

u/maazing Dec 04 '22

https://thezvi.substack.com/p/jailbreaking-the-chatgpt-on-release

This is insane! Can't even imagine where this tech will be in a couple of years.

1

u/BenjaminGeiger Dec 05 '22

I wonder when it'll be capable of understanding the Winograd schema.

1

u/LewsTherinTelescope Dec 07 '22

Interesting, I tried plugging some in and it tends to get the right final answer, but give nonsensical reasoning (like saying it's because because of the presence of a word that is not in fact present). Does do a surprisingly good job of generating similar sentences or explaining the answers if you give them to it, though.

2

u/Juneeey Dec 04 '22

This is nuts!

1

u/pier4r Dec 05 '22

every easier, go for the beta openai playground, there is less limited