Mixed reality proof of concept and new Virtual Desktop with passthrough mask
-
I think I get it now. So when using a VR headset, you would usually not be able to see your desk or keyboard or your full physical pit if you had one.
So if you wanted to press keys on the keyboard you would have to fumble around blindly, or briefly peek “under” the headset. Now you can let the VR headset show you your surroundings thru its cameras and that’s called “passthrough” - is that about right ?
-
@jayb Exactly, It’s super handy for those with physical pit build. When you can see both 3D world and your cockpit in headset.
For those still using keyboard reliable handtracking would be the thing. -
Exactly, the whole goal of this mixed reality is for pitbuilder guys!
With good RGB passthrough cameras coming in the next few months I think the inmersion will be total!!
IMHO: For using keyboard in VR and so on I’m not sure if it’s really worth it
-
WOW! This is a jaw dropping concept - way to go!! I don’t do BMS in VR (yet) but gonna definitely check this out when I get a VR with outward cams… and build more desktop cockpit controls… I’m still on Oculus Rift CV1 with sensor masts lol
Keep up the great work!!
-
This is why I’m building a pit! I thought I wouldn’t see this for a couple years. Great work!
-
Hi!
This is what I am waiting for more than 20 years. WOOOOOWWWW!!!
Definitely the right way for fly experience in home built cockpit.I will be watching this thread for any progress.
Br
Borut -
@oleuzop "From my point of view this is the future of home pits! And we are close to achieving it!
this is the most interesting
-
@oleuzop How are you creating the actual passthrough mask in DCS? Do you modify a .lua file? How do you assign the correct color? I understand how to use Virtual Desktop to implement the passthrough, but am uncertain how to create the mask itself.
-
@FlyDoc said in Mixed reality proof of concept and new Virtual Desktop with passthrough mask:
@oleuzop How are you creating the actual passthrough mask in DCS? Do you modify a .lua file? How do you assign the correct color? I understand how to use Virtual Desktop to implement the passthrough, but am uncertain how to create the mask itself.
This was a POC with an external app to have a 3d model mask to be on a layer above the rendering and showing into the headset.
When VD was out with Passthrough it was outdated, so I stopped developing the app.
I think it’s better to ask directly into DCS forums for a solution for this simulator to use VD passthrough.
-
See this guy’s Youtube Channel. He has built an entire cockpit from scratch.
https://www.youtube.com/@RainmanHST
He has already made the VR mask with pass-through using a Quest3 and he will be doing a how-to video soon.
Here is a Youtube shorts of his cockpit in VR and pass-through.
-
@zap737 Yeap, that’s a really well known member of the BMS community
AR is comming in 4.37.4 as stated in this post:
https://forum.falcon-bms.com/post/385316
Kind regards!