I also just recently got my Project Babble tracker which should enable me to have natural expressions in VR and in particular more accurate mouth tracking which is going to add a lot of expressiveness ^^

So far the experience is pretty unpolished, but much can be forgiven for an open source project. Plus it means people can just build their own. Right now I’m getting a lot of incorrect detection, but others have gotten really good results with it and I think it’s just down to going through the calibration process to detect correctly.

I still also need to get my USB-C splitter cable so I can have audio and the tracker running at the same time, since my Beyond 2E only has one accessory USB port. But hopefully already next week I can have better results!

My avatar also needs some work too since I can’t see the required parameters, I need to figure out how to get it working correctly. I think it’ll be worth it though since I want to do more VR stuff again.

#vr #projectbabble #VRChat #facetracking #vrcft

(258) Merotron - Face Tracking Add On Update #facetracking #vrchat - YouTube
https://www.youtube.com/shorts/JhDrtBKGVZQ

かわいい

I think we're seeing the final major iterations of #VirtualReality Controllers, and #VR #technology is about to hit that maturity point where there isn't much else to do beyond making what's there better.

Unless someone comes up with a groundbreaking new way to do input with them, #VRControllers will condense to buttons / sticks that you attach to your hands (either literally just half a #gamepad on a strap or harnesses for your fingers that push back) and cameras on the headset and in the room do #FingerTracking, #FullbodyTracking, and #FaceTracking. In other words, the designs where you actually hold controllers or attach extensive trackers to your body are kind of dead, aside from maybe #SlimeVR being marketed for a while longer as a way to improve that tracking and compensate for occlusion issues.

After that, attaching stuff to your body will be all about #haptic feedback, like a #HapticVest or a #gigglepuck.

The rest will be #software for #VRExperiences like #Resonite and #VRChat.

AHH LOOK HOW CUTEEE~!

It was my first time today on stream with my new face tracking (headset and model) and made this cute collage "with" my community! ^^ (they were behind me, I got so many faces now)~!

#Vtubers #VRChatPhotos #VRChat #vrchatavatar #VtuberEN #twitchstreamer #vrc #selfies #collageart #facetracking

Project Babble

"Project Babble is a lower-face expression tracking system designed specifically for VR headsets. It uses camera input to capture and interpret facial expressions, which is compatible with your favorite VR social platforms like VRChat, Resonite, Chillout!"

https://babble.diy/

#vr #ar #mr #mixedreality #FaceTracking