Initialization & weight decay look different to me, so you might want to do some research on that
(??? vs Xavier)
(decay on all params vs some)
Learning rate looks different too
(0.1 vs 0.01)
another difference could be image data
(range 255 vs range 1)
and batchnorm, but I don’t think these cause worse performance