algeriapy:

My main question, since I am not using the CosFace branch to calculate the loss and back propagate it, how it influence my training


It shouldn’t influence the training at all, if you are just calling its forward without using any output.