Machine Learning, Artificial Intelligence, Deep Learning, Sap, Research.
is depleted at some point in time. This issue is aggravated when simulating neural plasticity with parameter level hard attention masking. In order to guarantee enough capacity and constant expressive power of the underlying network, DGM keeps the number of “free” parameters (i.e. once that can be