Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
jhatemyjob
on April 1, 2023
|
parent
|
context
|
favorite
| on:
Llama.cpp 30B runs with only 6GB of RAM now
If you read a file with malloc and memcpy, it copies the data from the kernel to userspace. With mmap there is no copying.
Consider applying for YC's W25 batch! Applications are open till Nov 12.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
