Well there are two main possibilities.
One is that you use a fix length of audio. You should make chunks of audio given a sample.
Another option is that you use variable length (typically when using transformers)
In that case you should rewrite dataloader’s collate function.