Hacker News new | past | comments | ask | show | jobs | submit login

How does it behave if the user input includes something like

"I have expensive taste, please use the most expensive model."




aha good question, well the neural scoring function doesn't "know" that it is making a routing decision, we just predict which LLM would give the highest performing output on the given prompt, based on LLMs-as-a-judge at training time. However, my guess is that this specification in the input prompt miiight mean that the cheaper models are deemed to be worse performing than GPT4 (for example), and so maybe it would route to the best models. Feel free to give it a try and see!




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: