Thanks for the information.
In this case, you could use two submodules (each working on the specific data samples) and concatenate these features later in the model.
The concatenation might be applied e.g. on the activation volumes or the linear activation outputs.