Hello,
For some reason, I woud like to use the upper triangular tensor as model parameters. I used the self.L = nn.Parameter(torch.rand((d, d)).triu()) to specify the parameters during initialization but this is not right as the total parameter number is still d*d. What I want is to fix the lower part to be 0 all the time. I think I have to unregister those numbers but I didn’t find a clean way to do so. I appreciate if anyone can help me.
Thank you very much!