Solved by googlebot in post #6 
              
              
                Well, I’m pretty sure poisson lpdf is the thing to use here. If “overfit” mode doesn’t work, some reasons are: 
1)lr is too low, try tuning it or using Adadelta 
2)LSTM gates are saturated - 18k inputs is kinda extreme, so you’d need normalization, “compressing” layers and/or other strategies to cre…