I would like to implement a sinusoid activation function in torch.nn.functional, this is motivated by the strong results demonstrated using the activation function in Implicit Neural Representations with Periodic Activation Functions (ArXiv 24, paper’s webiste 11, and Github repo 13).
I’m curious about whether this looks like a valuable contribution to PyTorch?