Yes you are right, I preallocate some tensors before starting the training (I really need to preallocate them for this application). What would be the best way of resetting them so that they can be backpropped again?