Apache Airflow
PulseAugur coverage of Apache Airflow — every cluster mentioning Apache Airflow across labs, papers, and developer communities, ranked by signal.
No coverage in the last 90 days.
-
Data engineering student builds production-grade infrastructure with Spark, Kafka, Airflow
The Data Engineering Zoomcamp concluded after 10 weeks, with participants progressing from basic scripting to designing complex systems. The program focused on building production-grade infrastructure using tools like S…
-
Shopify CTO details AI integration, new workflows, and deployment challenges
Shopify CTO Mikhail Parakhin discussed the company's extensive AI integration, highlighting a significant shift in model quality around December that accelerated adoption. He emphasized that the primary challenges in AI…
-
Mechanisms for Effective Technical Teams
Eugene Yan's article outlines several mechanisms to enhance the productivity and effectiveness of technical teams, particularly those involved in machine learning. Key practices include End-of-Week Debriefs (EOWDs) for …
-
Eugene Yan reflects on Amazon role and prolific writing in 2020
Eugene Yan's 2020 retrospective details his move to Seattle for a new role at Amazon, where he builds recommender and machine learning systems. He emphasizes learning to scale himself through documentation, system desig…
-
Eugene Yan explains Airflow's scheduling delay for ETL jobs
Eugene Yan's article clarifies a common point of confusion regarding Airflow job scheduling, explaining that Airflow jobs are designed to run one schedule interval *after* the scheduled period has ended. Unlike cron job…