StackFollow on WhatAreYouBuilding.AI

MLOps Engineer

Experiment Tracking

DVC

Version control system for machine learning data, models, and pipelines.

MLflow

Open-source platform for tracking experiments and managing the ML lifecycle.

Neptune.ai

Experiment tracking and model registry platform for ML teams.

Weights & Biases

Experiment tracking, dataset versioning, and model management platform.

Model Serving

Kubeflow

Kubernetes-native platform for building and deploying ML workflows.

NVIDIA Triton

Open-source inference server for deploying models at scale across hardware.

Ray Serve

Scalable model-serving library built on the Ray distributed compute framework.

vLLM

High-throughput LLM inference/serving engine; the current standard for self-hosting open-weight LLMs at scale.

Managed ML Platforms

Amazon SageMaker

Fully managed AWS service for building, training, and deploying ML models.

Databricks

Unified data and AI platform built around Apache Spark and the lakehouse.

Feast

Open-source feature store for operationalizing ML features in production.

Google Vertex AI

Google Cloud's unified managed ML platform, its counterpart to SageMaker and Databricks.