Maybe VR would work better if you just fed the same view to both eyes and ignored stereoscopy. Jaron Lanier used to do that with his original VR rig in the 1980s when one of the machines went down. He said nobody noticed.
I can assure you that the tech has advanced enough in the last three decades that you would immediately notice the lack of non-parallax depth perception.