Why do CNNs generalize so poorly to small image transformations?
I&#x27;ve recently become interested in permutation invariant neural networks. There has been very little work in this area - just PointNet and a few derivatives.<p>Anyway, I think that neural networks are now entering the trough of disillusionment as people begin to discover the limitations. Maybe in the future, somebody will come up with a new machine learning architecture that has better generalization. I&#x27;m not expecting gradient descent to give us general AI.