The take home here is actually that by modelling the physical process of writing you get a more accurate model. It requires fewer examples partly because of pre-training, and partly because of physics hard coded into the model structure. It's not just the atoms that you feed in, but the entire algorithm is designed around drawing glyphs.
It's not entirely clear how you'd apply these concepts to new problems. Certainly in many cases you could come up with more detailed models of the processes involved. But in others, like text understanding, it's not at all clear how you'd make models more sophisticated.
It's not entirely clear how you'd apply these concepts to new problems. Certainly in many cases you could come up with more detailed models of the processes involved. But in others, like text understanding, it's not at all clear how you'd make models more sophisticated.