I think xgboost has some option to create the trees on the GPU, but I’m not sure, if a lot of these methods get a significant performance boost on the GPU.
Sebastian Raschka, as an author of a nice book on this topic, (@rasbt ) will most definitely know more on this topic.