Thanks for the snippet, I see what you meant. Seems a bit similar to other responses here I’ve seen where people actually have to use the non-default batch_first=True. I would definitely try to help debugging but this issue is a bit over my head.