On: My deep learning rig (2022)

[jacquesm]

You'd need a switch too, unless you're going point-to-point but that will eat up PCI slots that you probably would like to use for GPUs.

[tuetuopay → jacquesm]

mikrotik makes some pretty nice hardware for rather cheap. they now offer a 4x100Gbps switch for $800, which is a darn good price.

[jacquesm → tuetuopay]

Indeed, at $200 / port that's really neat if that's all you need. Funny, I remember paying close to $1000 / port for 100 mbps not all that long ago :)

[bradfox2 → jacquesm]

You really want gpu rdma though. It's a bit of a pain to get setup but it's worth it.

[jacquesm → bradfox2]

Not on the 3090 though, isn't it?