Hacker News new | past | comments | ask | show | jobs | submit login

What kind of specs do I need?



<-- For all of these projects, this is the major question.

I just wish it was standard form to include:

"This project requires __GB of RAM, and, if running on GPU, __GB of VRAM for the _B parameter model. It will generate output at __ tokens per second on a ___ CPU, and __ tokens per second on a ___ GPU."

It's obnoxious as heck as it is right now, since a bunch of things fit, a bunch don't, and there's a lot of overhead to find out.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: