And writing shell scripts that "mostly" work is what it does.
I don't expect it to work. Just like I don't expect my own code to ever work.
My stuff mostly works too. In either case I will be shaving yaks to sort out where it doesn't work.
At a certain level of complexity, the whole house of cards does break down where LLMs get stuck in a loop.
Then I will try using a different LLM to get it unstuck from the loop, which works well.
You will have cases where both LLMs get stuck in a loop, and you're screwed. Okay.. well, now you're however far ahead you were at that stage.
Essentially, some of us have spent more of our life fixing code, than we have writing it from scratch.
At that level, it's much easier for me to fix code, than write it from scratch. That's the skill you're implementing with LLMs.
This line really struck me and is an excellent way to frame this issue.
And writing shell scripts that "mostly" work is what it does.
I don't expect it to work. Just like I don't expect my own code to ever work.
My stuff mostly works too. In either case I will be shaving yaks to sort out where it doesn't work.
At a certain level of complexity, the whole house of cards does break down where LLMs get stuck in a loop.
Then I will try using a different LLM to get it unstuck from the loop, which works well.
You will have cases where both LLMs get stuck in a loop, and you're screwed. Okay.. well, now you're however far ahead you were at that stage.
Essentially, some of us have spent more of our life fixing code, than we have writing it from scratch.
At that level, it's much easier for me to fix code, than write it from scratch. That's the skill you're implementing with LLMs.