I wonder how much of them finding it hard to say "I don't know" is RLHF pushing them to finish the prompt no matter what. With custom instructions asking the model to be more honest, I do get some reasonable follow on questions, and occasional admissions of lack of knowledge. Not perfect, but that it works at all is interesting.
