Data Engineering, Elt Pipeline, Apache Airflow, Kinesis Firehose, Snowflake Data Cloud.
processing folder and loading the data in the Snowflake database. Then from processing folder to the processed folder. Our raw data was coming from an EC2 to the Landing folder with the help of Kinesis Firehose. Last but not the least, we have to make sure that the IAM role that Airflow is using