The beauty of functional languages in deep learning – Clojure and Haskell
The author seems to be confused and uninformed about how parallelism is implemented in ML libraries. Libraries don&#x27;t mostly rely on spawning threads for parallel execution! Parallelization happens at the hardware level using SIMD by running the calculations for backprop on a GPU&#x2F;TPU&#x2F;DSP. Not by creating new threads on the CPU. Because of this, you get the same type of isolated execution you would have with a functional language.<p>Which leads to the second point. Libraries like TF are already designed around a data flow execution model and provide functional APIs. It is nonsense to assert these libraries are missing something fundamental that Clojure and Haskell would magically fix.