@albanD Thanks!
Yes. The wavenet model use the Nth step output_batch as the input_batch of (N+1)th step. The issue happens in training.
Is it possible that the wavenet model is created for each time step, which takes to much memeory? The model is much bigger than the variables.