In fact, Qualcomm has announced a "Cloud AI" PCIe card designed for inference (a...

wyldfire on March 21, 2023 | parent | context | favorite | on: Nvidia Announces H100 NVL – Max Memory Server Card...

In fact, Qualcomm has announced a "Cloud AI" PCIe card designed for inference (as opposed to training & inference) [1, 2]. It's populated with NSPs like the ones in mobile SoCs.

[1] https://www.qualcomm.com/products/technology/processors/clou...

[2] https://github.com/quic/software-kit-for-qualcomm-cloud-ai-1...