John Gruber

My favorite two announcements of the day: the ability to apply portrait mode in post, and spatial video on the 15 Pro models.

https://mastodon.social/@gruber/110862243938533453

Sep 12, 2023 at 10:13pmIvory for Mac
Show threadPeter MarksSep 12, 2023
@gruber I can’t understand how spatial video can work properly with the lenses so close. Surely they need to be eye spacing?
Show threadJeff HobbsSep 12, 2023
@marxy @gruber this is exactly my question as well. This is mouse eye spacing!
Show threadPeter MarksSep 13, 2023
@jeffehobbs @gruber It’s going to have to be “at least three times bigger”.
Show threadɈƨɿoʜnɘvυႧ nɘɈƨɿɒƆSep 13, 2023
@marxy @gruber If one can‘t understand what’s going on, there is probably ANN and computational photography involved. ;-)
Show threadDan NugentSep 13, 2023
@marxy @gruber even with stereo cameras, you’d only get one precise 3d perspective. Disallowing for any translational movement of the viewport before introducing perspective distortion. My guess is temporal NERFs. I bet the 3d effect will be worse with fixed camera shots than with hand held videos.
Show threadAlbert KinngSep 12, 2023
@gruber Indeed
Show threadNico ReeseSep 12, 2023
@gruber so did they just retcon that Vision Pro is „Apple‘s first 3D camera“ then?
Show threadSimon KowalewskiSep 12, 2023
@gruber So I finally don't need my 11 year old Lucky GoldStar phone any more to record spatial video! Nor the Nintendo 3DS, for that matter. ;-)
Show threadUsagineko, Catgirl of BattleSep 12, 2023
@gruber I just bought a 14 Pro, and I usually wait 2-4 years between new phones; but if the 15 Pro somehow does true 180º stereoscopic video, I may have to get one.
Show threadDavid CollantesSep 13, 2023
@mikailborg @gruber would you be buying VisionPro too? Because I think—and I might be wrong—that the second is a requirement, no?
Show threadUsagineko, Catgirl of BattleSep 13, 2023
@david @gruber From what I've read, the “spatial video” was specifically mentioned as being viewable on other headsets. I'm a filmmaker who wants to work with quality stereoscopic video but there is almost no consumer equipment available for doing so. If the 15 Pro can, that would be of enormous benefit to me.
Show threadDavid CollantesSep 13, 2023
@mikailborg @gruber I though that “other headsets” meant other people’s VisionPro headsets. As in, you will be able to share them. I am going to dig more into that to see what I find.
Show threadJustin PurnellSep 12, 2023
@gruber It also lends credence to those rumors that AppleTV+ shows are being quietly shot in a spatial format
Show threadJohn GruberSep 15, 2023
@jpurnell Definitely. I think it's very likely for their high-end shows.
Show threadJustin PurnellJan 8, 2024
@gruber There it is:
Show threadFlo GehringSep 12, 2023
@gruber LivePhoto was disabled when they showed that. Would you think both can be on at the same time?
Show threadɈƨɿoʜnɘvυႧ nɘɈƨɿɒƆSep 13, 2023
@flogehring @gruber It could be done, but I doubt they would change the deployed file format for a niche vision pro feature.
Show threadJason Allen Sep 13, 2023
@gruber Did they let you demo? Shoot spatial video on iPhone 15, view it in Vision Pro?
Show threadJohn GruberSep 15, 2023
@JAllen Alas, no.
Show threadCraigSep 13, 2023
@gruber I'd also include having three focal lengths from just the main camera
Show threadDan ProvostSep 13, 2023
@gruber My one question for early reviewers: is spatial video viewable / usable in non-Vision Pro contexts? Does it "gracefully degrade” to a normal video? Basically, I'm wondering if every single video I shoot should be spatial video or is that going to leave me with a format that is only viewable on a headset?
Show threadJohn GrubbSep 13, 2023

@danprovost @gruber Thats how they get ya! 😝

But seriously…I had the same question. Maybe it records regular video simultaneously?

Show threadDan ProvostSep 13, 2023
@johngrubb @gruber Yeah that would be cool. Basically, in the same way I don't have to think about taking a Live Photo (I just take a picture and get the Live Photo for “free”), it would be nice to not have to think about taking a spatial video. Just take a video, and it will look extra cool on the headset.
Show threadLars Sep 13, 2023
@gruber I wonder how the quality is compared to shooting spatial videos directly on VisionPro. Is it worse on iPhone because the lenses are closer to each other? Or is it even better because of the better sensor?
Show threadDuncan WilcockSep 13, 2023

@gruber

100% agree.

Show threadDavid1280Sep 13, 2023
@gruber When you're wearing the Vision Pro, you can continuously record spatial video with an auto-delete timer system if you don't interfere. This is superior to the scenario where you wish you had your iPhone ready to record in your hand, but it does raise privacy concerns. It solves and avoids more crimes until audio and video are no longer evidence because of deepfakes that will change the privacy debate.
Show threadJulius WelbySep 13, 2023
@gruber One question I have is if the name of the A17 Pro chip implies that this chip won’t appear “as is” in the iPhone 16. Maybe a non-pro version will be used in the next base level phone?
Show threadMikey T.Sep 13, 2023
@gruber come to think of it, portrait mode in post should be a no-brainer. If they can do it IRT when taking a photo doing it in post should be easy!
Show threadJeff HobbsSep 13, 2023
@gruber I’d be interested if the user can change the action of the action button based on what focus mode they’re in.
Show threadAAPLSep 13, 2023
@gruber John, forefinger and thumb double tap already exists in WatchOS- see Settings/Accessibility.
Show threadByron MilliganSep 16, 2023

@gruber The ability to shoot Spatial Video on 15 Pro really is great.

Even if you don’t get the first gen Vision Pro, you might get one someday, so the sooner you can start to capture some special moments to enjoy on it, the better.