I am doing an emotion recognition task, where I have images, transcriptions and targets.
The architecture is as follows:

WhatsApp Image 2021-04-23 at 03.47.09531×1038 37.2 KB

where T is the cross attention transformer Layer. And since I can get the the value of L(text seq length) only at runtime from the train loader. I don’t know what to do?