On: The Curse of Recursion: Training on generated data...

[dragonwriter]

> The only way AI can create information is by doing something in the real world.

Everything done is done in the real world, but the only way an AI can gather (not create) information about some particular thing is to interact with that thing. Without interacting with anything external to itself, all information it can gather is the information already gathered to create it.

[tomrod → dragonwriter]

Is there a formalization of this idea? Would love to read more.

[antihero → dragonwriter]

That's a better way of putting it, yes.