He has been building distributed Machine Learning systems with Spark since version 0.2, before Spark was an Apache Software Foundation project. He's co-author of Deep Learning Pipelines and GraphFrames and author of TensorFrames