Did you try normalizing/scaling your inputs? In my case, normalizing between 0 and 1 led to very small values of the vectors (spectrograms are weird things) and it wouldn’t learn. However, learning happens after properly scaling the inputs.