The thing is, GPT-3 isn't a fact database, it's a story teller. So depending on how you phrase the input, it may tell you vastly different stories. There's no reason to expect it to reference the fact that Paris is the capital of France consistently in every story iteration.