On: Learning to Reason with LLMs

[KeplerBoy]

Who knows? Certainly not the public.

It might be a finetuned model that works better in such a setting.

[OkGoDoIt → KeplerBoy]

The linked blog posts explains that it is fine-tuned on some reinforcement learning process. It doesn’t go into details but they do claim it’s not just the base model with chain of thought, there’s some fine-tuning going on.