Just because 1 side doesn't provide evidence doesn't mean the other side is correct. If neither side provides evidence then neither side is necessarily correct.
And in the absence of evidence, generally the simplest (common sense) explanation should be presumed most likely (Hanlon's Razor).