Ballista: Distributed Compute with Rust, Apache Arrow, and Kubernetes
I congratulate the effort, as I always thought that Spark is great, but the fact it was written in Java hinders it quite badly (GC, tons of memory required for the runtime, jar hell (want to use proto3 in your spark job? Good luck)).<p>I do however worry that rust has a high bar of entry.