On: 50% discount on OpenAI pricing if you submit a bat...

[jstummbillig]

It mostly suggests large spikes in usage, no? Which does not seem very surprising.

[tony_cannistra → jstummbillig]

Totally. There are other explanations (like wanting to offer a discount), but my mind initally went to "they have a lot of provisioned compute that they pre-paid for, and they want higher-utilization when API request rates are low."

Just hypothesizing.

[amluto → tony_cannistra]

Or they don't have enough provisioned compute to cover peak usage, and they therefore want to reduce peak usage.