Hacker News new | past | comments | ask | show | jobs | submit login

I have yet to get any useful output out of the Q5_K_S version; haven't tried any others yet.



Linked is the base model. What you want is the instruct model (also on TheBloke's profile), which has been trained on following instructions.


I used mistral-7b-v0.1.Q5_K_M.gguf and it responded to basic questions.




Consider applying for YC's Spring batch! Applications are open till Feb 11.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: