Machine Learning, Unsupervised Learning, Mnist, Deep Learning, Towards Data Science.
enforce space constraints (promote structure?) SELU is a new activation function for Neural Networks which has the property of self-normalization. If we make a classical autoencoder and switch the activation functions to SELUs, the compressed space converges to a well defined mean and variance.