Understanding the complexities of Apache Airflow can be daunting for newcomers and seasoned data engineers. But with the right guidance, mastering the tool becomes an achievable milestone.
In this episode, Marc Lamberti, Head of Customer Education at Astronomer, joins us to share his journey from Udemy instructor to driving education at Astronomer, and how he's helping over 100,000 learners demystify Airflow.
Key Takeaways:
(02:36) Early exposure to Airflow while addressing inefficiencies in data workflows.
(04:10) Common barriers to implementing open source tools in enterprise settings.
(06:18) The shift from part-time teaching to a full-time focus on Airflow education.
(07:53) A modular, guided approach to structuring educational content.
(09:57) The value of highlighting underused Airflow features for broader adoption.
(12:35) Certifications as a method to assess readiness and uncover knowledge gaps.
(13:25) Coverage of essential Airflow concepts in the Fundamentals exam.
(16:07) The DAG Authoring exam’s emphasis on practical, advanced features.
(20:08) A call for more visible integration of Airflow with AI workflows.
Resources Mentioned:
https://www.linkedin.com/in/marclamberti/
Astronomer | LinkedIn
https://www.linkedin.com/company/astronomer/
https://academy.astronomer.io/
Airflow Fundamentals Certification
https://www.astronomer.io/certification/
https://academy.astronomer.io/plan/astronomer-certification-dag-authoring-for-apache-airflow-exam
Stuff You Should Know
If you've ever wanted to know about champagne, satanism, the Stonewall Uprising, chaos theory, LSD, El Nino, true crime and Rosa Parks, then look no further. Josh and Chuck have you covered.
24/7 News: The Latest
The latest news in 4 minutes updated every hour, every day.
The Joe Rogan Experience
The official podcast of comedian Joe Rogan.