On: Un Ministral, Des Ministraux

[thrance]

In Europe, they are basically the only LLM API provider that is GDPR compliant. This is a big factor here, when selecting a provider.

[TheFragenTaken → thrance]

With the advent of OSS LLMs, it's "just" a matter of renting compute.

[isoprophlex → thrance]

Azure openai is definitely compliant...

[vineyardmike → thrance]

Are all the big clouds not GDPR compliant?

Hard to imagine anyone competing with AWS/GCP/Azure for slices of GPUs/TPU. AFAIK, most major models are available a la carte via API on these providers (with a few exclusives). I can’t imagine how anyone can compete the big clouds on serving an API, and I can’t imagine them staying “non compliant” for long.

[thrance → vineyardmike]

Maybe, but when selling a SAAS here, big clients will always ask what cloud provider you use. Using an European one is always a plus, if it isn't simply required.