MLOps & Platforms
The practices that make ML reproducible, testable, deployable and observable — CI, CT and CD distinguished, platform capabilities, cloud primitives before vendors, cost.
Engineering practices and platform capabilities that make ML systems reproducible, testable, deployable, observable and maintainable. Not a product, and not a cluster.
Data → Validation → Training → Evaluation → Artifact → Registry → Deployment → Monitoring. Each stage has a way of failing that the next stage cannot see.
Three different loops with three different triggers. CI proves the code and data are sound; CT proves a new model can be trained; CD proves it is safe to serve. A green one proves only its own claim.
Shared capabilities — dataset access, feature pipelines, training jobs, tracking, registry, serving, monitoring, GPU scheduling — built once for many model teams. Premature before the third model.
Every managed ML service is an implementation of a primitive you should already be able to name — a training job, a GPU, a registry, a hosted endpoint. Learn the primitive, then map the vendor.
A DAG of data → features → train → evaluate → register → deploy, with scheduling, retries and backfills. The ML-specific hazards: a training step that is not idempotent, an evaluation gate, and artifact promotion as a step.
Before buying cheaper GPUs, ask whether a simpler model works, whether training can happen less often, whether inference can be batched, quantized, cached or precomputed. Utilisation is the lever.