I cannot throw away x and h as they are being used in downstream tasks. Anyways I have commented out alpha,
   #x = torch.pow(x,alpha)
   #h = torch.pow(h,alpha)

and although it is computed it is not contributing. So should not the dervitaive of loss wrt any paramter in alpha be always 0.