Apache Spark, Data, Ab Testing, Hbase, Memsql.
figure below shows the average execution time of a new job is well below two hours, where before the job would have taken more than four hours. We achieve a better running time by simplifying our pipeline to take advantage of in-memory executions of Spark. Moreover, with Spark we can tune the job