Mlops, Airflow, Rabbitmq, Elasticsearch, Filebeat.
Apache Airflow: Airflow schedules, orchestrates and monitors tasks. It allows us to make tasks dependent on other tasks. Also, we can schedule tasks to run every minute using Airflow. We will create a DAG (directed acyclic graph) that contains our tasks. This DAG will run every minute to maintain a