Hi
I checked and the tensor of data_words gives “None”, so it was clear that it is not added to the optimizer appropriately. So I came to these 2 lines:
self.optimizer.add_param_group({“params”: data_phrases})
self.optimizer.add_param_group({“params”: data_words})
and replaced (data_phrases) with (data_words) and when I checked the gradient of (data_words) it was showing values and not “None” while (data_phrases) was the one whose .grad gives “None” this time.
So I guess I need to pass the parameters to the optimizer in a different way? May be in one instruction together?
Thanks in advance for your help
Amir