How many tools do you know of that work 100% of the time. As someone that’s worked in software 20 years now, I don’t think there is anything from Linux to eMacs to visual studio to Java which doesn’t have bugs, issues, crashes, shitty stuff, and yet we expect a revolutionary and amazing technology to generate code perfectly?
It’s funny those the LLM haters keep raising the bar to a level that no other software can reach. Chatgpt is a tool like any other and just like a hammer, it can be misused, or it can be incredibly useful if used well. I personally find chatgpt mind boggling and astounding and use it every day multiple times for both coding and non coding purposes. But it’s totally normal and reasonable to me to expect bugs, do you really expect visual studio to run on large solutions and never have crashes or memory issues or slowness? If so you’re going to be disappointed.
Right now one generation is expensive on these big mainframe models.
Query many times on the right model(s) for the question and the correct answer will be there 99.999% of the time as the other hallucinations will be thrown out.
Tools have limitations.