Spark, Distributed Systems, Machine Learning, Hadoop, Scalability.
Parallel: Take GBDT for instance. Each decision tree in GBDT is built based on the residues of the previous decision trees. Hence, to train GBDT is inherently a sequential operation, not parallel. However, we can parallelize the building of each decision tree, as the dataset used for left and right