Federico Viticci 3d ago

It's not just that Siri is "bad": the issue is that as people get used to basic LLM features, it increasingly feels like a product from 10 years ago.

Comparison of asking Siri to find the contents of a note Vs. Notion AI.

The 'Use Model' action in Shortcuts is a stopgap for power users, not something that most people can approach. Their Foundation models also feel like models from 2/3 years ago.

Apple needs to throw away Siri and replace it with an LLM with App Intents tool-calling ASAP.

Show threadJohn Gruber3d ago
@viticci It’s worse than that though. Doing something quickly, in reflexive reaction to the state of the competition, almost certainly won’t result in anything longterm. They need a competitive personal AI that’s the foundation for decades to come.
Show threadFederico Viticci 3d ago
@gruber Oh I don't disagree! Just very skeptical of what they can do realistically here for another year. Their new Foundation models are still a far cry from any other modern LLM. One has to wonder whether it's a matter of talent, lack of inference infrastructure, politics, or all of the above. Maybe new management can turn it around?
Show threadSteven Op de beeck3d ago
@viticci @gruber they run on-device instead of on a server with a terabyte of ram. Of course these baby-sized models are going to underperform the huge models.
Show threadRhys Morgan3d ago
@stevenodb @viticci @gruber I think this is including the on-server models running on Apple’s Private Cloud Compute machines.
Show threadSteven Op de beeck2d ago
@rhysmorgan @viticci @gruber is that already operational? I only see AI handing off to ChatHPT.
Show threadRhys Morgan
@stevenodb @viticci @gruber Yep, you can prompt it using Shortcuts. e.g. from Apple’s own “Morning Summary” example:
Jul 14 at 1:48pmIvory for iOS