On: Nvidia H200 Tensor Core GPU

[schrodingerscow]

This may be a naive question, but all the metrics seem to be for inference. Should we expect similar gains on training?

[p1esk → schrodingerscow]

Yes. Training would especially benefit from the increased memory size.

[schrodingerscow → p1esk]

Interesting thanks. I wonder why they aren’t marketing that more on this page that seems important