Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
host multiple instances of Jupyter notebook server. Apache Livy: a service that enables interaction with Spark cluster over a REST interface. ✓ Select the number of nodes of each node type, as per required parallelism Master node: manages the cluster by coordinating the distribution of data and