It’s rooted in their new system prompt which heavily pushes to omitting information
A custom user prompt screaming at it to not omit information seems to help somewhat but I suspect there’s a more expensive product in the pipe (we know MS is losing money on copilot)
Oh no the thing that was supposed to replace programmers, and is made by programmers and has to run a ton of very expensive resources to achieve the level of a mediocre starter actually costs too much to replace programmers? But I thought we had an entropy reducing silver bullet on tap from the cloud!
As long as cost of Nvidia hardware the majority of the cost of AI, the cost of AI is entirely dependent on how much money Nvidia needs to extract to meet stock expectations.
Everything else is a tiny factor when it comes to compute
A custom user prompt screaming at it to not omit information seems to help somewhat but I suspect there’s a more expensive product in the pipe (we know MS is losing money on copilot)