On: I made a transformer to predict a simple sequence ...

[tostadora1]

I always wanted to at least have a shallow understanding of Transformers but the paper was way too technical for me.

This really helped me understand how they work! Or at least I understood your example, it was very clear. And I also got to brush up my matrix stuff from uni lol.

Thanks!