Deep Learning, Artificial Intelligence, Convolutional Network, Image Classification, Resnet.
parameters) on CIFAR-10 & 100 as well as ImageNet. Training curves for ResNet-101 vs. RevNet-104 on ImageNet Reversibility did not lead to any noticeable per-iteration slowdown in training. Left: angle (degrees) between the gradient computed using stored and reconstructed activations throughout