I'm undecided on what I think about this since... I frequently get bitten by reproducibility issues of pip packages.
Anything packaged in nixplgs generally rarely fails for me, especially in the more complex cases of cuda/pytorch.
I suppose I'm more likely to want "pytorch except" where that except is a newer dependency or build flag improving performance.