On: Llama.cpp 30B runs with only 6GB of RAM now

[nunobrito]

Still a poor excuse. Had they written this in Java and things wouldn't be so difficult both on performance and maintainability.

Never understood why people think that indented languages are any simpler when in fact they bring all kinds of trouble for getting things done.

[rfoo → nunobrito]

There's deeplearning4j (from Theano days!), go figure why it didn't take off.

[revelio → nunobrito]

There's a Java ML library called Tribuo that might be worth looking at.

[dopidopHN → revelio]

Thanks, the boring aspect of Java is appealing here.