for Quest 3 users : passthrough screen readability (helios compositing)
-
@Mikyjax Welcome! It’s a nice headset
I still like more Pico4 (it’s more comfortable out of the box) but you can get the elite head strap and it should be quite comfortable too
For passthrough Pico4 is not bad, but quest 3 wins
-
Playing BMS in AR with the Quest 3 is nuts!
I got it today and just ran a few tests, no need to repaint the texture of the cockpit, we can use this tool:
https://store.steampowered.com/app/1844610/Reality_Mixer__Mixed_Reality_for_VR_headsets/
That will let you draw a box to which you assign a color (pink in my case)
Then virtual desktop does replace it by your camera.
You can see some artefacts in the video and it’s mainly due to the recording. (I do see some pink around my screen but the right edge deformation was not part of the VR experience)I need to play with it a bit more to adjust the screen position and the box so it’s a bit less uggly but it’s really functionnal… No more mouse or keyboard needed, it’s a blast.
Just keep in mind that information receive by Helios is not laggy on my screen, it becomes laggy once virtual desktop does the compositing (I might be able to tweak it but honnestly, since I can show/hide my screen in game I prefer to use the game MFD) It’s now perfectly readable with the Quest 3
Some time will be needed to test it properly and tweak some stuffs but man it’s fun.
No need to wait a couple more months
Thanks,
Mike -
@Mikyjax That is a really interesting concept. Speaks more to how to interact with the buttons and switches all in one place rather than twisting and turning around in VR to interact.
-
@Mikyjax Nice concept! It’s the poor man’s physical cockpit
-
Have to say, as a Varjo Aero user, I am quite impressed with the Quest 3’s mixed reality possibilities for those of us with physical MFDs/ICPs/etc… Saw the BMS video, then
explaining how to set it up, has me thinking about it. Just being to easily see the KB would be a great help! -
@Icer yes this is exactly how I’ve done it in my demo.
- Virtual desktop should be able to use any camera to achieve that effect so I guess, soon, even people without passthrough on their VR headset will be able to just stick a cam (or 2) on there headset and have even better result than with the quest 3 cameras.
I can’t wait to see how BMS team will streamline this since all there is to do to remove the VRmixer step is to add a pink polygon fixed above the cockpit, that will guarantee the perfect position all the time, and no latency, not like VR mixer which cannot be perfectly sync with the BMS view.
Exciting times to be a simmer…
-
@MaxWaldorf weeks please
Just joking…take your time…we just cannot wait for 4.38 -
@Virus that right now slated for 4.37.4 with its addition of OpenXR allowing AR. That is coming which is hoped to be Q1 of 2024.
-
@Snake122 said in for Quest 3 users : passthrough screen readability (helios compositing):
@Virus that right now slated for 4.37.4 with its addition of OpenXR allowing AR. That is coming which is hoped to be Q1 of 2024.
You guys are legitimately smashing it out of the park.
-
Mike,
Awesome job, can you share your helios setup. I have 2 screens, but the vr displays on 1st and 2nd monitors(mirrors) and I don’t get the view port displays on the cockpit. Plus it’s really shudders when I move my head. I have a 4090 and top tier pc. I just started vr , so not familiar as much as I want to be. Thanks.
-
@scottd5800 Hello,
I’m using Ice’s profile you can find here :
https://forum.falcon-bms.com/topic/20238/ice-s-falcon-bms-profile-updated-for-bms-4-37You can’t be in Mirror mode, you need to right click on your desktop >display settings and choose extend this screen instead of mirror.
Be sure to read Max’s post for a few VR improvement:
https://forum.falcon-bms.com/topic/23871/couple-notes-to-vr-usersAs a note, this “solution” requires one more layer “VR Reality mixer” that’s a payware and as Max said above to me we won’t need that software for U4.
I would suggest you to try to get your vr setup smooth first, then have it smooth with helios running and only then try the mixed reality stuff. It takes time to optimize VR and I’m nowhere near close to the performance I want so I can’t help on that part. -
@Mikyjax Thanks. I have reality mixer and can get passthrough. Silky smooth without reality mixer running, with running, slight jittery when moving my head, seems not to like it as much.
On helios, I use it all the time and quite familiar. For some reason in vr , the view ports don’t display ,.because normally background is black and view ports populate. I get the monitor background without viewports, I also get telemetry, a little laggy. If I use the it , non vr, everything works great. Not sure if I missed a step? Thanks and that’s my goal to get what you accomplished. This is my first time vr, wow I can’t go back! So realistic!
I have RTX 4090, and very beefy PC…so i can achieve extremely high settings with super smooth visuals,.it’s the reality mixer layer that adds the micro stutters, when moving head only.
I just got to figure why my helios is not showing viewports (yes, I don’t have the 2 monitors mirror, I have them extended mode)
Thanks for any ideas or suggestions I might have missed.
-
@scottd5800 sorry, I didn’t get what you asked. I think the jitter (that I also experience) is due to the camera refresh and the sync with the game. Not really a way to avoid it right now.
do you have the line with RTT in your config file to populate the mfd’s? is that what you mean by viewport?
I think there is a limitation in helios where it’s only refreshing half of the game FPS, and in vr it can get quite low, especially on the ground.I did play with Vsinc on and off and it seems to improve it a bit (not sure why)
Did you completely follow the setup guide for ice’s profile? If you are using a different one I can’t really help as there are a few ways to get data into helios and I don’t know much about it, that profile worked directlyYeah, VR is crazy…
-
@Mikyjax Thanks. Are you running 2 monitors? helios on non primarily screen? I use helios all the time, but never in vr applications. So it’s weird, because non vr it works as advertised, in vr, it shows up in 2nd screen, populates the screen, telemetry, but no viewports. Anyhow, Thanks for responding, very cool application. I think this will be greatly modded and improved. Awesome!
-
@scottd5800 yes helios is on my secondary tactile screen, I disabled the mirror view in vr.
-
@Mikyjax Thanks, I think that’s the problem. How specific do you disable mirroring in vr, like screen shot, if possible. Thanks!
-
This post is deleted! -
@scottd5800 I think it’s this command, paste it in your user config:
set g_bVRNoPresent 1 -
@b0bl00i Thanks, I got helios working. Reality mixer just kills the smoothness, like very tiny jerky moving head around …
No Reality mixer, it’s absolutely stunning and smooth
Helios is a little choppy.
I tried Helios dcs, and I can’t get viewports to populate (I know this bms, But trying different sim) Has stuttering with Reality mixer…we are so close to AR!