Hi, thanks for your reply
I got the same result when I used:
w as a conv layer
self.w = nn.Conv1d(in_channels=10, out_channels=23, kernel_size=1, stride = 1)
I will use the out features instead of the one hot vector and update you
Best regards