title: Adversarially Robust Training through Structured Gradient Regularization
abstract: We propose a novel data-dependent structured gradient regularizer to increase the robustness of neural networks vis-a-vis adversarial perturbations. Our regularizer can be derived as a controlled approximation from first principles, leveraging the fundamental link between training with noise and regularization. It adds very little computational overhead during learning and is simple to implement generically in standard deep learning frameworks. Our experiments provide strong evidence that structured gradient regularization can act as an effective first line of defense against attacks based on long-range correlated signal corruptions.
authors: Kevin Roth Aurelien Lucchi Sebastian Nowozin Thomas Hofmann
hIndex: Thomas Hofmann 61