Sorry to hear that! There are multiple control modes so I assume you're either using the mobile version or the desktop in casual mode. We've tried our best making the experience as easy to use as possible for a variety of user profiles, but it's not perfect. FWIW, the touch and mouse-only controls are similar to Google Street View.
