But if we are looking at a thinking AGI that is “superior” to human abilities we should see Tolkien or Martin. If the argument is “just wait” then there needs to be sone explanation of why a Tolkien is really possible with this type of AI.
Funny you mention those two. They also suffer from the problem: “starts to break down after a long running thread before eventually becoming almost useless.”
Tolkien kept changing his world as he went along, so the Lord of The Rings required him to make changes to the Hobbit, and his Silmarillion needed extensive edits to bring it back into synch with LoTR canon.
As for Martin (assuming you mean G.R.R.)… well, he’s already mimicking that other failure mode of ChatGPT - that response times can get long when under load, and eventually the whole session might just time out.