Zhuowei Zhang
@stroughtonsmith @rileytestut I've been playing with DS emulation in Augmented Reality on iOS/RealityKit.

It displays the game as a holographic 3D model.

No, it's not practical at all, but I really wanted to see what an emulator would look like in a Sci-Fi spatial computing world.

- DS emulated with melonDS (iOS port from rileytestut's Delta)
- 3D model extracted with scurest's amazing MelonRipper tool
#RealityKit #AugmentedReality #AR
https://github.com/zhuowei/DSReality
GitHub - zhuowei/DSReality

Contribute to zhuowei/DSReality development by creating an account on GitHub.

GitHub
Jun 21, 2023 at 3:13pmWeb
Show threadRobert Petersen Jun 21, 2023

@zhuowei @stroughtonsmith @rileytestut

App Store Review: lol no

Nintendo:

Show threadThomas A.Jun 21, 2023
@zhuowei Maybe instead of having the model rendered directly in the real world, have the model live inside a window and have the window act like a glassless 3D TV screen.
Show threadBenJun 21, 2023
@zhuowei @stroughtonsmith @rileytestut Awesome! This is the kind of stuff I’d hoped Apple would show… how the Vision Pro enhances their device ecosystem. I’m hoping their extreme secrecy meant other teams had to delay integration efforts until the announcement.
Show threadRiley Testut Jun 21, 2023
@zhuowei @stroughtonsmith god I’m gonna have no time for AltStore work once I buy a Vision Pro and start experimenting with Delta in AR 😂
Show threadGraphiarJun 21, 2023

@zhuowei @rileytestut @stroughtonsmith Wait, so it's actually SEPERATELY RENDERING THE GAME IN REAL TIME WITH IT'S OWN MODELS?

As impractical as it is, that's insane.

Show threadZhuowei ZhangJun 22, 2023
@Graphine @rileytestut @stroughtonsmith I didn't build the cool part: it's all https://github.com/scurest/MelonRipper : scurest hooked melonDS to log every polygon drawn by the Nintendo DS's GPU and the entire VRAM and export it as a file; I'm just running MelonRipper every frame to grab the DS's screen and rendering it.
GitHub - scurest/MelonRipper: 3D screenshots in melonDS

3D screenshots in melonDS. Contribute to scurest/MelonRipper development by creating an account on GitHub.

GitHub
Show threadGraphiarJun 22, 2023
@zhuowei @rileytestut @stroughtonsmith That's still batshit insane the way you implemented it with RealityKit. I would love to see this in real time when Vision Pro comes out. Even with it being ridiculous.
Show threadnoah978Jun 21, 2023
@zhuowei
This has gotta be one of the coolest things I’ve seen in awhile, great work!! 👏
Show threadZhuowei ZhangJun 22, 2023
@noah978 I didn't really do anything: I just hooked up https://github.com/scurest/MelonRipper to Reality; scurest gets all the credit for the magic that makes this work
GitHub - scurest/MelonRipper: 3D screenshots in melonDS

3D screenshots in melonDS. Contribute to scurest/MelonRipper development by creating an account on GitHub.

GitHub
Show threadJS_WordSmithJun 21, 2023
@zhuowei that’s amazing
Show threadPaulJun 21, 2023
@zhuowei If ever there was a use-case to bring back Wipeout XL!
Show threadMetafrastisJun 22, 2023
@zhuowei @stroughtonsmith @rileytestut Imagine playing Populous or Civilization on your table or a spinning globe. I really hope game developers are gonna jump on it.