I just knew that “native replacement of linear model with neural networks would suffer from high correlation between consecutive experiences”. Although I didn’t fully understand this problem, it seems that it is what caused my problem.