Hacker News new | past | comments | ask | show | jobs | submit login

Language models range from 1 to 300+ GB when loaded. It depends on how you load them, if you load in int8 you get 4x reduction.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: