If you want to get a glimpse at what an LLM-infused, generative Shortcuts + Siri integration may be like in iOS 18, the new natural language creation tool in Zapier is remarkable.

You type what you need, and the service assembles the steps for you. Results were not 100% accurate, but they removed *a lot* of friction from the initial setup. I had something that worked in 2 minutes with minimal editing.

Imagine this, but for Shortcuts created with simple natural language queries. 👀

(Zapier's system struggles with variable assignment inside parameter fields and used the wrong action to filter a number. Apple's system could be much more elegant *and* integrated with native apps.)

@viticci would absolutely love it if apple gave shortcuts the focus it deserves. Current integrations always feel underbaked and glitchy.

True and easy app interoperability is a dream

Agree with @sp -- we need something like a native IFTTT/Zapier with Chat GPT powers. I shouldn't need to bone up on regex expressions just to make an app workflow on my phone.

This @parkerortolani concept from 2022 is something I think about a lot in this context.

Imagine sharing Shortcuts prompts instead of Shortcuts links with others; imagine creating these from Spotlight, a Siri chatbot in iMessage, or even your Watch.

(Original source: https://twitter.com/ParkerOrtolani/status/1531376460665061379/)

Parker Ortolani (@ParkerOrtolani) on X

I am all for the Beats Music sentence style feature for Shortcuts that @viticci suggested on App Stories… had to mock it up… would be such a great way to introduce regular users to the app…

X (formerly Twitter)
@viticci Doesn’t this go back to the original Vision Pro rumours of creating apps with your voice?

@viticci Microsoft added the same thing to it’s Zapier competitor service, Power Automate several months back. Using Copilot you tell it what to build and it generates some possible options for you to select from.

https://learn.microsoft.com/en-us/power-automate/get-started-with-copilot

Get started with Copilot in cloud flows - Power Automate

Learn how to access and use Copilot in cloud flows.

@greenaway @viticci probably the only place where I found Copilot useful. But it creates workflows with deprecated SharePoint actions (triggers?) which is annoying sometimes

@viticci Do you remember that crazy rumor about ‘making apps using Siri’ on Apple’s ‘VR Headset’?

https://9to5mac.com/2023/01/27/apple-headset-apps-siri/

A year later, and it doesn’t sound crazy at all.

Apple wants everyone to create ‘Reality Pro’ headset apps using Siri, internal demos focused on health and storytelling - 9to5Mac

While it’s widely been reported that Apple’s upcoming Reality Pro headset will have an App Store with third-party apps, Apple...

9to5Mac
Federico Viticci (@viticci) on X

Oh my, yes. This is exactly what I meant on @appstoriesnet. The old Beats Music "sentence" feature, but for letting users build shortcuts quickly with natural language. I'd love this.

X (formerly Twitter)
@viticci Make.com has something similar and it made getting started so much easier. I didn’t have to wade through the dozens of actions and integrations.

@viticci it would be so neat if one could create shortcuts using code. That would make LLM assisted creation a lot easier.

I imagine something like Home Assistant automations, that can be edited using both yaml and a visual editor.

@viticci agreed, and can’t wait for that. 1) it’s probably what that story from a year or two ago about writing apps via Siri was and 2) people who say “why can’t Siri just do this for me” will be blown away and spur adoption