Simon B. StøvringAug 5, 2023
Question for the RealityKit experts: I'd like to create a 3D model of a handheld game console and display that using ARKit and RealityKit. I'd like to add a SpriteKit game on top of the console’s screen. Is it feasible to combine RealityKit and SpriteKit like this?
Show threadsaniul

@simonbs yeah should be able to:

use RealityView’s attachments to render a SwiftUI View that renders the game just above the console model’s screen

Aug 5, 2023 at 8:25amIvory for iOS
Show threadsaniulAug 5, 2023
@simonbs I guess one thing I’m not sure about without checking in simulator is SpriteKit support. I thought SpriteKit was only supported on visionOS for apps in iPad compatibility mode (https://mastodon.social/@stroughtonsmith/110498588595015168), but the SDK docs for SpriteView do mention visionOS as being supported: https://developer.apple.com/documentation/spritekit/spriteview
SpriteView | Apple Developer Documentation

A SwiftUI view that renders a SpriteKit scene.

Apple Developer Documentation
Show threadSimon B. StøvringAug 5, 2023
@saniul Interesting! This could be the way forward. Do you know if a RealityView's attachments will be affected by environmental lightning? Ideally I'll achieve an effect where the SpriteView appears to be the screen of the game console.