Author here. I was surprised to see my post on here while scrolling!
My point about those examples is less that ChatGPT got it wrong, but that it's impossible to know really when it does, because it seems so confident and you only get the one result. To be fair, this is a problem with webpages, but you at least get multiple choices.
> Comes off as a company that sells search solutions looking for reasons this tech won't replace it.
I can see why you'd say that, but that wasn't the goal. I originally wrote this as my own POV for my own blog. I really do think there's a UX problem in this (and, as I mentioned, I am a big fan of recent LLMs).
> [What] about the scalability of search?
You're right, the NN aren't as performant as lexical search. They're getting a lot better though. (We're actually working on this at the moment.) LLMs, though, have a ways to go, so it's hard to use them right now for real time search.
My point about those examples is less that ChatGPT got it wrong, but that it's impossible to know really when it does, because it seems so confident and you only get the one result. To be fair, this is a problem with webpages, but you at least get multiple choices.
> Comes off as a company that sells search solutions looking for reasons this tech won't replace it.
I can see why you'd say that, but that wasn't the goal. I originally wrote this as my own POV for my own blog. I really do think there's a UX problem in this (and, as I mentioned, I am a big fan of recent LLMs).
> [What] about the scalability of search?
You're right, the NN aren't as performant as lexical search. They're getting a lot better though. (We're actually working on this at the moment.) LLMs, though, have a ways to go, so it's hard to use them right now for real time search.