That might be correct. However, I’m currently unsure how your actual model looks like. I assume you are using a loop to create the output features of the CNN, concatenate these activations, and pass it afterwards to the RNN?