On: Neural Network Diffusion

[hackerlight]

According to Hinton, before transformers were shown to work well, learning model architectures was Google's main focus