Not on premises who are regulated and might have enterprise requirements. If you need eg role based access control you can’t use on prem MLFlow etc. So you could niche down to customers who don’t know this yet. Smaller banks, insurers etc.
Edit: we went through this. Started putzing around with open source things on prem on Openshift. Ended up on Databricks for a variety of reasons. The impact on the business to be wiring up lots of new widgets, maintaining them, training, ability to switch to new components when required. Lean team, so turn Databricks on and secure it properly, exclude PI where possible, sort out ETL and CICD etc, profit. Delegate MLOps stack innovation to the vendor and focus on our own job.
Yep, this journey is exactly the kind of thing I run into when I get prospects who want our product (observability) to be on-prem. What they actually want is assurances around data storage, retention, and controls; and a "throat to choke" to cover their asses in case something goes wrong. At least in this domain, very few people who need Observability actually need things to be on-prem as well.
Edit: we went through this. Started putzing around with open source things on prem on Openshift. Ended up on Databricks for a variety of reasons. The impact on the business to be wiring up lots of new widgets, maintaining them, training, ability to switch to new components when required. Lean team, so turn Databricks on and secure it properly, exclude PI where possible, sort out ETL and CICD etc, profit. Delegate MLOps stack innovation to the vendor and focus on our own job.