"RNN units are commonly modeled using various nonlinear activation functions [...] Contrary to this view, we show that single-unit activation functions confer inductive biases that influence the geometry of neural population trajectories"

www.biorxiv.org/content/10.1...

#NeuroAI