What we’ve seen of visionOS is really impressive. But thinking about the bits that are currently missing…

HUDs aren’t shown. Maybe they look weird when they aren’t anchored to your space. Maybe their applications are no good if other people in the space can’t see them.

But I wanna see more AR applications for drivers and pilots and surgeons.

@clarko The category that as far as I can tell won't be supported in v1 but I'm excited about are the “let you add healthy nudges to the environment" ones I wrote about a few years back (https://allenpike.com/2019/the-supremacy-of-ar). Things like “make the recycling bin glow the evening before recycling pickup” and "show our list of dinners we bought ingredients for on the fridge at dinner time”. Will be more useful when the device is better suited to wearing throughout the day.
The Coming Supremacy of AR

How augmented reality is far more than a phone on your face.

Allen Pike

@apike Oh yeah we’re gonna need some object permanence before we get that.

Same as pinning things to the walls — I’m guessing visionOS doesn’t know or care that the objects in my home are meaningfully different to me than the ones in my hotel room.

@clarko Yes, though Andy Matuschak pointed out that within a given app, ARKit should let you pin a thing to your home wall, and it won't be there in your hotel but the app could restore it when you return home. The problem is, you'd need to launch the "grocery list on fridge" app to make this happen. So there needs to be a bit more of a visionOS-level plugin system to manage these various persistent things, and the resulting battery impact. https://developer.apple.com/videos/play/wwdc2023/10082/?time=567
Meet ARKit for spatial computing - WWDC23 - Videos - Apple Developer

Discover how you can use ARKit's tracking and scene understanding features to develop a whole new universe of immersive apps and games...

Apple Developer
@apike yeah I was saying to Brad that’s probably a WidgetKit thing for another year