hmmm, that looks like very well done analysis. I have to say that Caffe and PyTorch have slightly different formulations of momentum, especially around what momentum decay means. Other than that, at this point I cant think of much else, just evidence that we’ve trained a lot of networks on classification and detection and that they do match their original accuracy.