On: Microsoft Phi-3 Cookbook

[nashashmi]

Slightly off topic: what’s the reasonably smallest LLM model i can use to do language processing and rewriting of a large library of word documents? For the purposes of querying information and regurgitating out summaries or detailed information?

My use case is very simple: take 1000 word documents filled with two to three pages of information and pictures. And then output a set of requested information via prompting. Is there something off the shelf? Or do I have to make this?

[ukuina → nashashmi]

Sounds like a good RAG use-case unless all 1k documents need to be comprehended simultaneously.

Look at H2O.ai: https://github.com/h2oai/h2ogpt