On: DeepSeekMath 7B achieved 51.7% on MATH benchmark

[godelski]

I find this argument weird. I'm not saying you can trust the open evals, I'm just saying you can know their limits. Closed evals you're a lot more blind.