Data Engineering, Elt Pipeline, Apache Airflow, Kinesis Firehose, Snowflake Data Cloud.
to make sure that the file will be available at /tmp/ directory. Let’s start the agent ! After starting the agent, it should pass the data to firehose delivery stream and the firehose delivery stream should transfer the data to S3. Use the following command. sudo service aws-kinesis-agent start If