I’m also unsure because if it’s to custom tailor bots and integrate them for custom business needs, like a support channel, this technology sounds too powerful for this because you’ll constantly be looking after them to not be steered out of their purpose. See also Microsoft Bing. Microsoft is fine with spending resources on that because they want to kill Google. But I think for these purposes, a powerful “stupid” bot (there are many services for these) would make more sense than a generic one with vast “skill sets”.
I have been playing around with generating embeddings for some documents, storing those in a Postgres column (pg_vector), generating emeddings for a search term, finding the closest match using pg_vector and sending the results off to GPT3 to be summarized and it seems to work incredibly well. It seems to stay on topic, I’ve been trying to “jailbreak” it and get it to say crazy things for a while. I suppose this is more of one off question answering thing than a chatbot, though (previous questions and results are not fed back in). I have only tried with super simple “documents” so far, I am going to try some more complex ones when I get a chance to get a pipeline setup.
There are many use cases for conversational AI chatbots including customer support agents, game characters, tutoring chatbots, personal assistants, etc. There are 42 examples of AI chatbots here https://chatbotkit.com/examples.
I'm not sure that is really an answer. I tried the customer service example. There was a faux chat log where the bot appeared to be accessing details of a customer's order but in terms of how to provide that functionality under the section about making the chatbot beter the link to interfacing with a dataset was 404. So all I am really left with is 'customer service bot' but no reason to believe gpt3.5 is how best to get there rather than existing 'dumb' bots. Again, blockchain vibes even down to the incomplete website with the facade of ideas.
Still playing with it but if it allows chat against a specific website/dataset that would be cool. I could see it replacing a mediocre site search on my hobby website for that purpose.
I chatted with Algo about how its model was trained and the meaning of beauty until we were interrupted by the interstitial to buy a monthly plan. Too soon!
Anyway, looks like ChatGPT has a good competitor now.
