I was listening to a podcast[1] and they say the cost of inference (responding to a question) in ChatGPT is about 1-2 cent. Is that true? And how would that map to the overall cost microsoft can pay for integrating that into Bing, considering number of search queries in Bing.
1- https://www.nytimes.com/2023/01/06/podcasts/hard-fork-tiktok...