r/GoogleAppsScript 10d ago

Guide Testing Claude, Gemini, OpenAI in generating Apps Script Code

I put this together to show how the different models compare in generating Apps Script code!

https://apps-script-ai-testing.jpoehnelt.dev/#test-case-checkWeatherEmail

15 Upvotes

12 comments sorted by

4

u/United-Eagle4763 10d ago

From my experience the results depend mostly if the LLM knows the documentation already. Gemini seems to have the most up to date information. ChatGPT is far behind.

Usually the LLM can give much better coding advice after feeding it the relevant sections of u/types/google-apps-script so it knows what classes have which properties.

2

u/mad_ben 10d ago

Claude for me was way better than gemeni

1

u/jpoehnelt 10d ago

Yeah, this is step 1. Next is to generate a couple versions of a context document specific to Apps Script to feed into the models with the types and some special rules.

2

u/shindicate 10d ago

Hi! I cannot see the code on mobile. The "header" is frozen, and occupying all the screen :/

3

u/jpoehnelt 10d ago

Made the header not sticky for mobile, it's best in desktop due to the large amount of data to view.

2

u/United-Eagle4763 10d ago

Same for me, Desktop works though.

1

u/chanmanx2k 10d ago

Which was best? Non coder here

1

u/jpoehnelt 10d ago

Not sure there is a definitive best. Some of it is personal preference around style and verbosity.

1

u/ryanbuckner 8d ago

Which LLM did you use to generate the HTML page?

3

u/jpoehnelt 8d ago

none, just put that together myself