I don’t understand the use case completely.
It seems you are trying to concatenate the output of two different loaders.
Are you using any random transformations, such as flipping or rotation?
What would the expected output be?