Solved by ptrblck in post #8 
              
              
                The mean is calculated in dim0, not the first element. 
Here is a code snippet to show, how this operation works: 
batch_size = 2
nb_classes = 3

# initialize empty list
output_list = []

# append predictions to list
for _ in range(10):
    # Here you would call the model and create the outputs
    …