Apache Spark, Data, Ab Testing, Hbase, Memsql.
abstraction helps avoid duplicated codes and reduces the number of jobs in a pipeline to just a handful. We designed and implemented our pipeline with a mindset that our jobs need to be: extensible and generic enough so other teams at Pinterest can extend and add new metrics to the experiment