Hi,
I want to change the softmax results to onehot gate.
for example:
x=nn.Linear(10,20)(input)
task_gate =nn.softmax()(x) (e.g., the results is 0.5, 0.2, 0.3)
I want to change the (0.5, 0.2, 0.3) to (1, 0, 0). Also, x need to be optimized.