Data Engineering, Elt Pipeline, Apache Airflow, Kinesis Firehose, Snowflake Data Cloud.
Cloudwatch error logging needs to be enabled as well. The buffer hints by default is 300 seconds. Which means that the data will be transferred after five minutes. We can make it to 60 seconds for faster transfer. Installing Kinesis Agent and send data to Firehose We have to install the agent for