Cloud AI Services or Your Own Models
Every hyperscaler sells ready-made AI services. Whether to use them or run your own comes down to four questions.
TopicGuide
AI & Cloud
GPUs, inference, managed model services and what running AI workloads really needs.
5 articles
All topicsVector Search: What It Is and What It Costs to Run
Vector search finds things by meaning rather than by keyword. The infrastructure question is where the index lives…
GPU Instances: What You Are Renting and What It Costs
GPU instances are the most expensive thing on most cloud price lists, and the easiest to leave running by accident.
Infrastructure Checklist for an AI Workload
Machine learning projects fail on infrastructure more often than on modelling. Most of it is foreseeable.
Training vs Inference: Two Very Different Cost Problems
Training is a large, bounded cost you can plan. Inference is a small, unbounded cost that grows with every user.
Keep reading
The rest of the library covers provider choice, server sizing, security, cost control and deployment.