Steve Troughton-SmithJun 7, 2023
I do think Apple is going to be in a tough spot with game devs for visionOS. Sessions make it clear that hand tracking just won’t be accurate enough for anything fast-paced, and everything has to be re-hosted using Apple APIs to do even basic things with the system compositor. I expect there will be a rising chorus of ‘we need hand controllers’ at the very least. If Apple doesn't have hand controllers of some kind by version 2.0, it could negatively impact the platform for years to come #WWDC23
Show threadSteve Troughton-SmithJun 7, 2023
The real worry is that gaming is such a blind spot for Apple that they don't realize this at the decision-making levels, and won't have been preparing for this eventuality. You don't just throw together hand controllers at the last minute — they need to do similar inside-out tracking to the headset itself, with multiple cameras and sensors. This may be a painful wake-up call
Show threadSteve Troughton-SmithJun 7, 2023
Let's not think about the fact that Apple burned all its bridges with Epic, whose Unreal Engine, this past generation, has become the only game engine in town with which anybody wants to work. Tight Unity support is great, but not in any way enough
Show threadGrievous Angel
@stroughtonsmith they had games controllers in the demo video?
Jun 7, 2023 at 5:24pmWeb
Show threadNamanJun 9, 2023
@grievousangel @stroughtonsmith Yeah but not motion controllers. The existing games like Beat Saber need motion controllers.
Show threadNamanJun 9, 2023

@grievousangel @stroughtonsmith I do want to add that games like Beat Saber came about *because* motion controllers were the only input mechanism.

Hand-tracking and “traditional” controllers might enable different new kinds of games.

Show threadNamanJun 9, 2023
@grievousangel @stroughtonsmith The problem with hand-tracking is that it can’t be used for any quick motion tracking which is needed for gaming. Fast movements are hard for the cameras to track.
Show threadGrievous AngelJun 9, 2023
@nmn @stroughtonsmith yes. 2 different gaming models there. Vision probably lacks the GPU to push enough polygons for pc style gaming. But good for lightweight post iPad ar gaming.