Custom collate function that pads only to the longest sequence?
Currenty all input is padded to `max_seq_length` but in most cases the longest sequence in a batch is shorter than that, sometimes by a significant amount. If there is a custom collate function that pads only to the longest sequence in a batch, that will probably save quite some memory and time. Is that feasible?
This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.
