On: LeCun: Qualcomm working with Meta to run Llama-2 o...

[pavlov]

Ultimately Qualcomm is the one who decides how to allocate die area on their CPUs, right? So it can’t exactly hurt if this is a priority for them now.

[smoldesu → pavlov]

Pretty much all of Qualcomm's SOCs are built using stock ARM core designs. ARMnn is optimized for multicore A-series chips, which constitutes everything from the Snapdragon 410 to the 888 (~2014-modern day).

[fisf → smoldesu]

All the recent qualcomm stuff has some kind of dedicated ai support (special vector extensions, etc.).

Qualcomm has it's own SDK for that (used to be called SNPE), which uses GPU, DSP (hexagon),.. CPU is really only a fallback.