When to use it
The orchestrator is a mandatory component in the ZenML stack. It is used to store all artifacts produced by pipeline runs, and you are required to configure it in all of your stacks.Orchestrator Flavors
Out of the box, ZenML comes with alocal
orchestrator already part of the default stack that runs pipelines locally. Additional orchestrators are provided by integrations:
Orchestrator | Flavor | Integration | Notes |
---|---|---|---|
LocalOrchestrator | local | built-in | Runs your pipelines locally. |
LocalDockerOrchestrator | local_docker | built-in | Runs your pipelines locally using Docker. |
KubernetesOrchestrator | kubernetes | kubernetes | Runs your pipelines in Kubernetes clusters. |
KubeflowOrchestrator | kubeflow | kubeflow | Runs your pipelines using Kubeflow. |
VertexOrchestrator | vertex | gcp | Runs your pipelines in Vertex AI. |
SagemakerOrchestrator | sagemaker | aws | Runs your pipelines in Sagemaker. |
TektonOrchestrator | tekton | tekton | Runs your pipelines using Tekton. |
AirflowOrchestrator | airflow | airflow | Runs your pipelines using Airflow. |
GitHubActionsOrchestrator | github | github | Runs your pipelines using GitHub Actions. |
Custom Implementation | custom | Extend the orchestrator abstraction and provide your own implementation |