On: Mistral releases ‘unmoderated’ chatbot via torrent

[SushiHippie]

What is "dual xeon", two xeon CPUs or dual core? On my laptop with an i7 I had some decent performance with it. Don't know token/s , but it took less than 20s to generate an answer.

Should note that I used q5 quantisation with llama.cpp: https://huggingface.co/TheBloke/Mistral-7B-Instruct-v0.1-GGU...