On: Serving AI from the Basement – 192GB of VRAM Setup

[flixf]

Very interesting! How are the 8 GPUs connected to the motherboard? Based on the article and the pictures, he doesn't appear to be using PCIe risers.

I have a setup with 3 RTX 3090 GPUs and the PCIe risers are a huge source of pain and system crashes.

[lbotos → flixf]

I had the same question. I was curious what retimers he was using.

I've had my eye on these for a bit https://c-payne.com/

[plantain → flixf]

Looks like SlimSAS.