Ask HN: What's your cloud setup for large-scale ML *predictions*?

[bobosha]

- Do you really see a cost advantage by using GPUs (over CPUs) for predictions

- which cloud provider is your preferred provider and why, specifically relating to predictions using multiple ML models (conv. nets, xgboost models etc.)