There's ~15 million VR units sitting around and there's steady growth. That's much more than the zero from a few years ago but you're right its not massive popular. There's just enough that some VR game devs are finding success but by no means is it a gold rush and I don't mean to imply that.
I think sitting around is the key point. :P I have a PlayStation VR headset that does just that. There was only one game that ever actually drew me in with VR, and that was Thumper.
My theory is that I think the companies that sell these things are just really good at hyping and selling the headsets. I just don't see what the end game is. It's certainly possible that I'm wrong about all this though.