💝Summary
Lady H. summarized the pros & cons of mini pipelines as well as customized pipelines.
Stories Behind the Scenes!
Sometimes, while working hard on something, unexpected surprises can pop up!
Lady H. sought help for an Airflow data transfer issue and received both a solution from Talgat and a suggestion from Hamza to try ZenML. As ZenML's co-founder, Hamza's recommendation was expected, but since Lady H. was exploring alternatives to Luigi and Airflow, his suggestion gave her hope.
Later, it turned out that this extra exploration paid off! ZenML offered a seamless Airflow setup experience, resolving the data transfer issue while providing a more flexible solution. Excited by the progress, Lady H.'s only remaining challenge was to display the DAG on the Airflow UI. She reached out to Hamza again and quickly received a response—it was exciting to hear that he was about to open a ticket to address the issue. In the end, the problem was resolved, making it a valuable learning experience for Lady H.! 💖
Last updated