🍃Customized Pipelines

Now it's time to show how can we build customized pipelines in python.

• Luigi allows you to build every stage of a machine learning pipeline, users have the ultimate freedom to customize the operations of each stage.

• Airflow is a platform to programmatically author, schedule, and monitor workflows.

• ZenML saves your efforts when building Airflow based machine learning pipelines.

To manage the garden business, Lady H. only needs to build a small-scale pipeline, which is sufficient with Luigi. Although Airflow supports larger-scale pipelines, it is slightly more challenging to learn compared to Luigi. To enhance your learning experience, Lady H. created two simple pipelines using Airflow and ZenML, covering key components that could serve as a great starting point!

Time to dive into details!