On: Learning to Reason with LLMs

[zamadatix]

You need to know how to validate the answer to your level of confidence, not necessarily already have the answer to compare itself. In some cases this is the same task or (close enough to) that it's not a useful difference, in other cases the two aren't even from the same planet.

[fsloth → zamadatix]

This. There are tasks where implementing something might take up to one hour yourself, that you can validate with high enough confidence in a few seconds to minutes.

Of course not all tasks are like that.