It's in another continent. You have to cross a sea to get to it from France, and in fact an armada was used to invade it. The natives were not culturally related to the French. It was taken by direct force at the whim of the ruling monarch. French culture and language was imposed after colonization. It is listed as a former French colony in mainstream references. Africa in particular was a target of colonialism by European powers.
I don't think the continent argument holds any moral value. Algeria is not far from the rest of France.