On: Jsonformer: Generate structured output from LLMs

[kaba0]

Almost any integration with computer systems would need some structured format, let’s say you want to write an intelligent file manager where you could prompt to “find a file that ends in Final”, and with enough instructions the LLM might give you back something like:

  {
    “command”: “find”,
    “param”: { “type”: “regex”,     “value”: “[^.]*Final\.[^.]*” }
  }

which you can actually interpret and execute for the user. But I’m absolutely a novice at anything ML, so take my comments with a grain of salts.