Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
Hadoop Distributed File System (HDFS): a fault-tolerant distributed file system, used by Hadoop and Spark both. HDFS enables splitting a big file into ’n’ chunks & keep in ’n’ nodes. When the file is accessed, then different chunks of data have to be accessed, across the nodes via LAN. Map-Reduce: