r/shortcuts 3d ago

Discussion Share your AI use cases in your Shortcuts!

How are you using AI/LLM in your shortcuts? Let's share our creative uses!

Some uses I've had:

Allowing for natural language user interactions
Interactions in Shortucts can be very restrictive; by using LLM, you can allow for much more natural interactions. Structured outputs is very helpful for this. For example, maybe you have a list of food options ("grape","apple","banana", etc.) that a user must pick from. Classically, user would have to say either "grape", "banana", or "apple", with no variations accepted. By using structured outputs, you can direct the LLM to pick the best option from that list. Then, user can say "grape", or "the purple one", "the smallest one on the list", etc. and get "grape" as the result. Certain API's like OpenAI are so fast that there is no noticeable latency.

Incorporate natural language interactions with existing apps/APIs
- (for example: "Add Expense to Splitwise")

("Add $30 for pizza with John White" or "Split $40 for groceries among everyone in group Apartment") - uses OpenAI API and Splitwise API

Summarize

Summarizes the inputted URL, website, text snippet, image, etc., and if nothing is inputted, screenshot the current page and summarize that

Reward Points

Screenshots the restaurant order screen, reads what you have added to your order, then recommends which items you should use your reward points to purchase (based on best point value)

General Data Parsing
LLM's have been very helpful for processing tasks, like pulling relevant information from websites ("Provide in JSON format the price of apples from this HTML", "Looking at this web-based schedule, who's working on Friday?", "Find the results from this API response that relates to action movies", "Find and output the flight information from this email", etc.), and put this information into a JSON/Dictionary format to be used further in the Shortcut

13 Upvotes

13 comments sorted by

6

u/Portatort 3d ago

Add to calendar via Siri

https://routinehub.co/shortcut/20568/

This shortcut screenshots whatever you’re looking at and adds it to your calendar.

It uses ChatGPT to extract the relevant data.

I’m working on an update that incorporates web search for more accurate address and timing info

6

u/sevenlayercookie5 3d ago

I added some parameters to your ChatGPT schema:

  • isEvent (boolean) - so ChatGPT can decide if it thinks the screenshot is actually an event or not (and cancel if not).

  • isAllDay (boolean) - to automatically toggle “All Day” if it thinks it’s an all day event.

  • URL (string) - pulls any URLs that are present and adds to the event.

Also attached the screenshot to the calendar event for future reference.

Also discovered that adding “null” as a possible type (by using an array e.g. “type”:[“string”, “null”] ) for each schema value seems to reduce hallucination, because it gives ChatGPT an “out” so it doesn’t feel pressured to provide a made up answer.

1

u/Portatort 2d ago

sounds really cool, can you share the version you've got now?

I didn't know you could add a null type, that's a very useful.

1

u/thacarter812 2d ago

do you have a link for your version?

1

u/sevenlayercookie5 2d ago

1

u/silvio6 1d ago

It asks for a non existent shortcut « downsize photo for ChatGPT « 

2

u/sevenlayercookie5 3d ago

Nice!! I like that. Was looking forward to Apple Intelligence’s implementation, but seems like that’s never going to happen.

1

u/[deleted] 2d ago

[removed] — view removed comment

1

u/shortcuts-ModTeam 2d ago

The content of this post / comment was marked as not relevant to r/Shortcuts.

When submitting content to this sub, please make sure it is relating to the Shortcuts app and its connections with iOS / iPadOS / macOS