> 1. You don't really need the output to be good or correct
> 2. You don't have confidentiality concerns (sending data off to a cloud service)
At $PREVIOUS_COMPANY LLMs were straight up blanket banned for these reasons too. Confidentiality related to both the code and data for the customers.
The possibility that "it might get some things right, some of the time" was nowhere near a good enough trade-off to override the confidentiality concerns.
And we definitely did not have staff/resources to do things local only.
> 2. You don't have confidentiality concerns (sending data off to a cloud service)
At $PREVIOUS_COMPANY LLMs were straight up blanket banned for these reasons too. Confidentiality related to both the code and data for the customers.
The possibility that "it might get some things right, some of the time" was nowhere near a good enough trade-off to override the confidentiality concerns.
And we definitely did not have staff/resources to do things local only.