Hadn’t seen that before, thanks! Although after more testing it appears that this works - although this form only generates very small CNNs that converge quickly and perform poorly. On much larger fc layers it seems to have much better performance. I’ll def use your advice though