I am trying to train model with audio signal.
Loaded audio signal with librosa.load and mutiplied with 32768 to convert it into integer and changed the dtype to int16 from float32
Initialized a weight in Channel normalization function(didn’t used nn.layernorm) with int16.
when I tried to train, I recieved the below error
RuntimeError: Only Tensors of floating point dtype can require gradients
cant we use autograd with int16?
will changing all the parameters to int16 solve this issue? if so how to change weights to int16?