It doesn’t have issue when running on CPU. I didn’t push contexts to the GPU because of the memory limit. During the forward pass in words embedding I put the input context to the GPU. Do you think I need to put the whole dataset on GPU for training?