I found a line of code:
out_a, out_p, out_n = model(data_a), model(data_p), model(data_n)    

in:https://github.com/liorshk/facenet_pytorch/blob/master/train_triplet.py
as you can see that the “forward()” is invoked multiple times before “backward()”,question are:
1,Will next invoking override previous computation graph?
2,In my test,the gpu consumption will increase accordingly,so even overriding happened,gpu memory leaking happens,how to solve this problem?