Big Data, Spark, Memsql, Realtime, Datapipeline.
using Spark Streaming. The pipeline is in a prototyping phase as we continue to work with the MemSQL team on productionizing it. Figure 1 shows the elements of the real-time analytics platform we’ve described so far. We’ve been running the Singer -> Kafka -> Secor -> S3 pipeline in production for a