markdaoust:

I have bumped into a similar issue with compile editing the metric object, and then multiple compile calls stacking up the modifications. This feels a little similar.


I think it works also with:
for i in range(3):
    compiled_model = get_compiled_model()
    eval1 = compiled_model.evaluate(x_train, one_hot_y_train, verbose=2)
    eval2 = compiled_model.evaluate(x_train, one_hot_y_train, verbose=2)
    compiled_model.reset_metrics()