Great! I expect I’m gonna end up with about 2TB of data.
Do you think I can just zip it and upload it as a single file?
For the metadata I didn’t realize I could also use JSON (I thought it needed to read the closing bracket since it’s a large array). Due to potential special characters, do you think it is a safer format or should I just stick with csv or tsv?