Some #Apple tech they COULD build on for their AR/VR headset. @gruber @upgrade

ARKit/environment tracking
Face and expression tracking
Reality Composer
Apple Silicon
Metal
Object Capture
Memoji
Head-tracking Spatial Audio
Audio transparency
Cross-device Universal Control
Sidecar
Gesture-based UIs
Head-tracking Mac cursor
Low-latency Ultra-Wideband
Freeform whiteboard collaboration
SharePlay
Group FaceTime
Voice isolation
Apple Fitness and TV+ original video content
Many biometric and health sensors
iOS/iPad OS apps running within their other systems
Wearable mounting: Watch and AirPods Max
Predictive and swipe typing
Cameras and LiDAR
Computational photography, realtime video processing
De-warping (Center Stage, Desk View)
Stage Manager
Game Center
Apple Arcade
Game controller support
Door detection
RoomPlan
Live captions (Clips)
Live OCR
Handwriting recognition
Screen Time/limits
Device-specific App Stores
Fall detection 😃

#xros #realitypro #virtualreality #augmentedreality #mixedreality #vr #ar #xr

Time to add a couple new ones:

iPadOS hover
Magnetic power cables
The new pro iPad apps: #Logic and #FinalCutPro

@adamsimmersive Did you see the recent rumors about the headset’s power cable? It clicks in, but then you also twist it. Makes sense to make it more locked, so it doesn’t pop off as you’re moving about.

@neven Yeah—sounds like a fancy way to do the final click of something like a BNC cable. A way to hold extra securely without needing awkward force (iMac-style) to unplug.

Extrapolating from such tiny morsels of maybe-fact… could this mean no internal “tide-me-over” battery?

With battery swaps needed for extra-long sessions, I’d kind of expect a little internal battery that can hold memory for a few minutes during a sleep state, without having to fully reboot on battery swap. But in that case, accidental power disconnects wouldn’t be so dire as to need a twist.

Maybe it just dumps RAM to SSD and can reboot super fast. But do you have to tell it in the UI that you’re about to disconnect? Like ejecting a 1984 Mac floppy?? Or maybe enough long-term sessions are expected to be seated, that they expect you’ll use wall power for most of those. Maybe there’s even MacBook-style MagSafe on the battery brick for when you wander off…

It all seems awkward, but will probably make sense in practice 😎

@adamsimmersive Last I heard, you need the battery pack to use it. I think it has enough of an internal battery to power on and tell you to plug it in, but you won’t get any user features.
@neven That would be great for quick barrery swaps without having to save documents and reboot!