There's very little documentation about interacting with spatial video on iOS/macOS, so I wrote a little about the new APIs for reading and writing spatial video with AVFoundation:

https://www.finnvoorhees.com/words/reading-and-writing-spatial-video-with-avfoundation

At some point, *every* engineer wants to rewrite their code from scratch. Circumstances are forcing my hand. Darn. :-)

Here’s my first pass at rewriting my mocap playback system in #Swift #ECS for #RealityKit on #visionOS. I’m using the native particle emitter component for now, so it doesn’t look quite right just yet.

But it is playing back.

Dynamic non-uniform 3D model box resizing.

The box can be any size, but some of the features (such as the label or the tape) remain in the right spot and at the right size.

#visionOS #AR #RealityComposerPro #shader