You are using a very narrow definition of "immersive" here - personally I don't think graphical realism is necessary to provide immersive experiences. Sure it can help, but its a very shallow way to think about gaming broadly.
People spend literally weeks of game time deeply immersed in both of the Zelda titles, as the obvious example.
I'm talking about shoving fire breathing blocks together with fans in the most recent Zelda game (so that you can build your own flying tank or platform). Its designed for fun and play, not immersion.
If anything, VR's issue is that instead of trying to be fun, they're trying to be immersive. No. You know why Beat Saber is one of the best games on VR? Because its fun.
I don't think the Beat Saber blocks realistically represent anything. The scoring system is pretty arbitrary (wider swings for more points as opposed to timing), etc. etc. But it works and is fun. That's the important bit.
People spend literally weeks of game time deeply immersed in both of the Zelda titles, as the obvious example.