Alright it does indeed works perfectly.
I never thought about it as I always used an imagenet pretrained network’s weights, but do we always set weights randomly when training a network from scratch ?