Intermediate MLOps & Production
25 MIN READ
ML Pipeline Orchestration: Why Airflow Is Not Pipedream and Kubeflow Is Not Airflow
A precise mental model for ML pipeline orchestration—distinguishing event-driven glue (Pipedream), durable backend workflows (Temporal), data schedulers (Airflow), and production ML systems (Kubeflow/TFX/Ray). Built for engineers who need to answer 'design an ML pipeline' in interviews. Includes 2025-2026 tool updates: Airflow 3, KFP v2, Ray 2.x, MLflow 3.