On: Vanna.ai: Chat with your SQL database

[hrpnk]

Prompts are quite straightforward.

- OpenAI: https://github.com/vanna-ai/vanna/blob/a4cdf7593ac0c584f7d74...

- Mistral: https://github.com/vanna-ai/vanna/blob/a4cdf7593ac0c584f7d74...

[peheje → hrpnk]

Many of these AI "products" - Is it just feeding text into LLMs in a structured manner?

[wruza → peheje]

Why quotes. Your file manager is just feeding readdir into tableViewDataSource, and your video player is just feeding video files into ffmpeg and then connects its output to a frameBuffer control. Even your restaurant is just feeding vegetables into a dish. Most products "just" do something with existing technologies to remove the tedious parts.

[okwhateverdude → peheje]

Basically, yeah. It is shockingly trivial to do, and yet like playing with alchemy when it comes to the prompting, especially if doing inference on the cheap like running smaller models. They can get distracted in your formatting, ordering, CAPITALIZATION, etc.