Hacker News new | past | comments | ask | show | jobs | submit login

> It's just not true that everything not transformer is outdated.

Am not expert, do you have some links about this? i.e. a neural net construction that outperforms a transformer model of the same size.




ConvNets Match Vision Transformers at Scale (Oct 2023)

https://arxiv.org/abs/2310.16764


Well transformers still have some plausible competition in NLP but besides that, there are other fields of AI where convnets or RNNs still make a lot of sense.




Join us for AI Startup School this June 16-17 in San Francisco!

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: