Hey @sgugger, could you please consider running my notebook?
https://colab.research.google.com/drive/159Sjlc1sQE1Cq3aLZeui4kB9JDxLeoRN#scrollTo=w8vysLPe_eIz 1
It showcases my current implementation of Tapas. It is still WIP, but I am interested in whether you are interested in adding it to the Transformers library  There is a requirement for the torch-scatter library as PyTorch currently does not include operations on segmented tensors. Could it be possible to add something like this 1 when initializing TapasForQuestionAnswering?