cat /dev/llama is not yet implemented. However we have a module to which you can give a prompt as parameter. It's buggy now.
Our goal is to write a proper kernel module to implement three things:
1. a character device
2. 1st backend is a LLMZip ie you write to say /dev/l2ezip, you get a compressed stream out
3. 2nd backend is a LLM, ie you write a prompt to say /dev/llama2, you get a completion back
So the 1st backend could be useful for compressed telemetry
The second backend could be useful for IoT LLM, or our ambitious plan of responding to telemetry, ie take action, such as control motor speed etc.
Our goal is to write a proper kernel module to implement three things:
1. a character device 2. 1st backend is a LLMZip ie you write to say /dev/l2ezip, you get a compressed stream out 3. 2nd backend is a LLM, ie you write a prompt to say /dev/llama2, you get a completion back
So the 1st backend could be useful for compressed telemetry The second backend could be useful for IoT LLM, or our ambitious plan of responding to telemetry, ie take action, such as control motor speed etc.