I have my RNN/LSTM/GRU outputing a softmax distribution over tokens. How do I decide if to pass the soft-vector or the thresholded/sampled one-hot tensor version of it as input to the next cell?
(teacher training is not possible in my application)