The only time I put a filter on is when I shoot on the beach. Dried up saltwater spray is not good. Otherwise, I just use the lens cap to protect the lens. It's not safe to leave the cap off anyway even if you do have a filter: you could point your camera at the sun and damage the sensor (or shutter if it's a film camera).
