>The transformer model is one more incremental improvement that made the language problem tractable. This has only captured the public interest because the language problem is so much more flashy and easy to understand than something like protein folding.
It's not just about language. Language models can predict novel protein structures, no folding required. https://www.nature.com/articles/s41587-022-01618-2
>What is the roadmap to get to general purpose AI, and what is the proof that we are close?
What testable definition of General Intelligence does GPT-4 fail that a big chunk of humans don't also fail ?