Returned in within the first month. Couldn’t use it for work because of the shared Apple ID requirements. Hand tracking was too laggy for games. That left movies/tv as the only winning feature, and I prefer to watch socially. Was pretty bummed tbh, I thought it would be much cooler.
Edit: there was something really cool actually, that I think doesn’t get talked about enough. Pooping on Yosemite. Peak futurism.
30fps is 33ms per frame. I'd expect that to be fine for most free-space gestures (for musical instruments you generally want <10ms, but that's most noticeable with discrete impulsive events like hitting a drum pad, and even then is pretty manageable).
Is the frame rate really the limiting factor here, or something algorithmic in the tracking (like smoothing out noise)?
Surprisingly, yes! 90hz would be considered the minimum here.
As a general statement, no, vision isn’t as time-sensitive as hearing, so the timing requirements aren’t as precise. But when it comes to head and hand tracking, the brain’s also doing predictive sensor fusion, and even “unnoticeably” small delays can be disorienting or nauseating. (Ocular fixation is the most sensitive, but hand-eye coordination is also pretty important to the brain!)
The important number in VR is “motion-to-photon” latency.
Over 20ms starts to be noticeable to most people; 50ms starts to make most people uncomfortable. That’s the total budget for sensor fusion, simulation, rendering, and display, and that’s just for the bare-minimum experience that doesn’t make people immediately ill.
You can do a lot with prediction and late updates in screen space, which is what makes VR possible at all on current hardware— but it’s hard to make up for having sensor data delayed by possibly 150% of the total time budget :)
Edit: there was something really cool actually, that I think doesn’t get talked about enough. Pooping on Yosemite. Peak futurism.