Solved by ptrblck in post #2 
              
              
                PyTorch models don’t have a shape dependency regarding the batch dimension, so you would be able to pass the test inputs with a batch size of 1 to the model.