On: Beyond self-attention: How a small language model predicts the next token

[xanderlewis]

...in fact, one could argue that not only did it not read the rules — it has no conception of rules whatsoever.