Quick question - I want to use nn.Identity as a placeholder.
Like:
layer_one = nn.Linear(input_size, hidden_size) if use_linear else nn.Identity
However, I am worried that during backprop the Identity weight values will be updated. Will it?
Thanks,
Kevin