caveat: I’ve never used spectral norm. With that aside, imagenet has larger input images than cifar. so, perhaps the norm is correspondingly larger, and needs to be eg scaled downwards by the square of the size of the images, or by some hyper-parameter constant?