It also creates an intriguing parallel with NNs: greedy-trained partitioning models and SGD-trained NNs (in the mean-field regime) both thrive under specific structural assumptions (eg. MSP) but struggle otherwise. 

However, under MSP, greedy RFs are provably better that SGD-trained 2-NNs!