Data Migration Pipeline with Apache Airflow

16 Mar

5:30pm UTC

TALKS

Data Migration Pipeline with Apache Airflow

By: Sameer Shukla

Data Migration Pipeline with Apache Airflow Demo Agenda: a) Description of the Problem we solved. b) Details on Pipeline Architechture c) Why do we use Apache Airflow in production and how it helped d) External Systems involved e) Description of the DAG f) Description of Various Operators in the DAG g) Execution - Live Demo, with dummy data on local machine