Hi there,
I am training a hierarchical model using Pytorch. This proved to be considerably difficult as the masking needs a sorted list of lengths. In a hierarchical model, I can sort the samples based on sentences and get away with padding sentences. But I will definitely have to mask the words, and Pytorch only supports them in a sorted order.
Is there a reason for enforcing the sorted order, some sort of optimization? Can I make it take inputs without the sorting?
Regards
Sandeep