Assuming you are using a stateful network, you should be able to split your data up into smaller sequences and feed them in to your network one after the other, meaning you will not have to pad each recording to the length of your longest recording.