Big Data, Spark, Event Hub, Scala, Azure.
arriving with high frequency from multiple types of sources, performing real-time processing and machine learning to determine health of the system and raising immediate alerts to act upon, and persisting all events into some data lake for historical purposes, and many more. Spark has a concept of