Trade-Offs in Automatic Differentiation: TensorFlow, PyTorch, Jax, and Julia
Interesting read. I was very disappointed when the Swift TensorFlow project withered away. A good general purpose programming language combined with deep learning seemed like a great idea. Apple actually provides a good dev experience with Swift and CoreML (for fun I wrote a Swift/SwiftUI/CoreML app that uses two deep learning models that is in the App Store).Wolfram Language takes an approach similar to Apple’s in providing a good number of pre trained models, but I haven’t yet discovered any automatic differentiation examples.Of the frameworks described in the article, I find Julia most interesting but I need to use Python and TensorFlow in my work.