What is Apache Airflow?
Ap ache Air flow is a platform to program matically author , schedule and monitor work flows . Air flow was created as an internal project at Airbnb in October 2014 . The project was open sourced in June 2015 . Air flow has a modular architecture and uses a message queue to orche strate an arbitrary number of workers . Air flow is written in Python and uses the Jin ja tem pl ating engine to generate work flows . Air flow work flows are composed of D AG s ( Direct ed A cycl ic Graph s ). A D AG is a collection of tasks that have dependencies on each other . T asks in Air flow are operators , which perform some sort of action . Oper ators can be written in any language . Air flow sched uler executes your D AG s on an array of workers while following the specified dependencies . When a D AG is executed , the sched uler creates a D AG Run entry in the