Big Data, Database, Memsql, Clickhouse, Algorithmic Trading.
tools available that can operate efficiently on flat files stored on local disks or S3 buckets such as: Python (Pandas with Jupyter), Apache Spark, Amazon Redshift Spectrum, and even clickhouse-local. We tried an EMR (Elastic Map Reduce) cluster with Apache Spark on AWS, and while it was relatively