Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
smoldesu
on March 31, 2023
|
parent
|
context
|
favorite
| on:
Llama.cpp 30B runs with only 6GB of RAM now
Before ChatGPT was in beta, there were already models that fit into 2gb and smaller. They were complete shit, but they did exist.
wkat4242
on April 1, 2023
[–]
I know but what's changing is that they aren't shit now. Not on par with GPT but getting much closer. Especially with a little massaging like Stanford has done.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
