Automated ETL Pipelines with Apache Airflow
Data Engineering · Airflow 3, Docker, Snowflake, MongoDB
Python
Apache Airflow
Snowflake
Docker
ETL
Scheduled Airflow pipelines that pull weather, stock, and SFTP data, clean it with pandas, and upsert it into Snowflake, with automatic backfill.