Thank you for the feedback Patrick!
I think we would rather work with the code you provided.
It also seems that the data already is part of the Hub which makes ingestion/pre-processing considerably easier than we initially thought. german-nlp-group/german_common_crawl · Datasets at Hugging Face 3