Solved by mortazavi in post #6 
              
              
                The suggestion here 


which has may of the similar set of issues as the task suggested here implies that one may first have to reduce one’s sequence lengths – perhaps, through convolutions with a large stride – before feeding the resulting (shorter) sequences to the transformer layers. 
One or more…