The much maligned Amazon Fire Phone had four specialized high-speed head tracking cameras on the front of it, and made this effect the centerpiece of it's UI. I worked on it, and it was very cool. The phone failed for lots of reasons, but this particular "gimmick" actually held some promise. The example clay-molding game which came with it actually showed how being able to perceive the image in pseudo-3D did have a real application.
I worked on it too. You're right about the head tracking - it did work very well. They had some great UX ideas centered around it too. It's unfortunate it didn't pan out for those UX features alone.
Which were the great UX ideas? I think I missed them... The fact that you had to move your head or phone just to see the time was bad. The 'peek' gesture which required moving your head to the side and looking sidelong at the phone to open a side navigation menu was equally lame.
To be self critical, I think there was a lot of, "We've got this cool hammer, let's make everything a nail" sort of thing going on where the perspective stuff was grafted onto a lot of areas better left alone. That said, the tilt scrolling on web pages was actually very nice to use (remember it was based on the angle to your eyes, not the physical phone angle, so you could use it lying down). And like I said, applications where it was helpful to glance around a 3D object, was quite compelling. But yeah, there were too many areas where the effect was used where it probably didn't need to be.
The feature I miss/wish for the most was looking at the phone sitting on your desk and having the screen turn on. "Wonder if I have any notifications...Nope"