A stronger contrast between human natural language learning and GPT-3 is that the human is an active participant, continually trying things out and getting feedback. GPT-3's training is entirely passive -- and when all humans have of a language is a corpus of fragments with unknown referents (Minoan Linear A), we don't do well.
