Consistent schema for the new datasets

#14
by vince62s - opened

Hello team,
Many thank for the new dozen of datasets from pgc.
However, all parquet files (in a given dataset) do not share the same schema creating issues when loading them at once.
Most issues come from the various column names "FRQ_U_..." "FRQ_A_..."
There are workaround by looping over parquet files locally but this is not optimal.
Cheers.

Sign up or log in to comment