Hi ! When do you experience slow downs or error exactly ?
Have you tried making map write to a local directory first (you can pass cache_file_name to map to specify where to write the Arrow data), and then save it to your cloud storage using save_to_disk ?
This way accessing the data from your processed dataset will be much faster since your dataset will be on your disk.