Show HN: Bistro – A light-weight column-oriented data processing engine
The core looks close enough to dataframes that I&#x27;d be curious to know how you compare to tablesaw:
<a href="https:&#x2F;&#x2F;github.com&#x2F;jtablesaw&#x2F;tablesaw" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;jtablesaw&#x2F;tablesaw</a><p>This looks neat but I&#x27;m not sure why I would care about this. There&#x27;s a ton of solutions out there in the ecosystem out there already with a columnar like interface.<p>Granted, we wrote our own as well[1] that uses the builder pattern that you then toss to an executor (our main backend is spark for this). One reason we wrote this is for persistence purposes. Being able to encode and persist a series of transforms that you can then load remotely has been very helpful for us in machine learning.<p>We&#x27;ve since migrated this project to the eclipse foundation and intend on doing a rewrite of the interface as well as integrate our baked in tensor library[2] in to certain parts of the pipeline for speed purposes and handling things like computer vision workloads.<p>In general, I always like seeing new takes on the columnar format processing approach but I&#x27;m just not seeing anything novel here. Clarification of intent would be great!<p>[1]: <a href="https:&#x2F;&#x2F;github.com&#x2F;deeplearning4j&#x2F;DataVec" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;deeplearning4j&#x2F;DataVec</a>
[2]: <a href="https:&#x2F;&#x2F;github.com&#x2F;deeplearning4j&#x2F;nd4j" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;deeplearning4j&#x2F;nd4j</a>