I think it might be stretching the Bitter Lesson a bit to extend it to cover fine-tuning, since the original idea was addressing something very different.
Anyway, even if generalist models are truly better at everything, they’ll never be faster or cheaper than their specialist counterparts, and that matters.
Anyway, even if generalist models are truly better at everything, they’ll never be faster or cheaper than their specialist counterparts, and that matters.