Solved by ptrblck in post #2 
              
              
                I don’t think you can simply calculate the average of the F1 score, as shown in this small dummy example: 
preds = np.random.randint(0, 2, (100,))
targets = np.random.randint(0, 2, (100,))

f1_ref = f1_score(targets, preds)


f1_running = 0
batch_size = 10
for i in range(0, preds.shape[0], batch_siz…