Why isn’t there a decent file format for tabular data?
Seems like the problem here is there is several high quality and well-developed formats, but the author and the commenters here dismiss them because of the different trade-offs they make.csv -- Simple for simple use cases, text-based, however many edge cases, feature lacking etcxlsx -- Works in excel, ubiquitous format with a standard, however complicated and missing scientific featuressqlite -- Designed for relational data, somewhat ubiquitous, types defined but not enforcedparquet / hdf5 / apache feather / etc -- Designed for scientific use cases, robust, efficient, less ubiquitouscapn proto, prototype buffers, avro, thrift -- Has specific features for data communication between systemsxml -- Useful if you are programming in early 2000sGDBM, Kyoto Cabinet, etc -- Useful if you are programming in late 1990sPick your poison I guess. Engineering is about trade offs.