When you're a very small business losing money the first few years of operating and California sticks you with an $800 bill on top of local taxes that are also levied regardless of income (business personal property), it's a giant slap in the face that makes you want to move your business to pretty much any other state.
Then move. But remember, if you do business in California, you must still pay the franchise fee if you have a company that is NOT a sole proprietor or general partnership. Incorporating in another state will not save you, you must register with Secretary of State as a foreign entity.