Database, Data Engineering, Data Lake, Data Lakehouse.
I/O overhead, speeding up metadata access. Optimizing Iceberg’s Execution Plan When there are too many data files, reading column statistics for all of them is a very resource-intensive task, especially during query planning. Tencent Games pre-calculates and caches column statistics of data files