jeremyaRD:

The preprocessing/data formatting is not very clear.


+1 I think we need to document what files/format users need to supply in README.md for examples. I tried for seq2seq: transformers/README.md at 353b8f1e7a7361c0afd9e391381bc226b4a5ca8f · huggingface/transformers · GitHub 4  but I’d definitely appreciate help.
I think in general we don’t experiment/document using private data because we full-time open source developers/researchers mostly use benchmark datasets. We should do better.