Data Engineering, Elt Pipeline, Apache Airflow, Kinesis Firehose, Snowflake Data Cloud.
environment and upload the DAG python file in the your_s3_bucket/dags and requirements.txt file in your_s3_bucket/requirements folder. Requirements.txt includes the libraries which the Airflow cluster will need. In this case, the snowflake connector and the aws CLI package. Choose the DAG file and