I found the problem : I applied softmax to the full output, ignoring the fact that part of the ouput is not supposed to be a probability density which destroyed any attempt of training it.
EDIT : even if I correct this, the loss still won’t to zero even though my training sample basically consists of three notes fed over and over … I don’t know what is happening.