Hi Frank,
Thank you for the information. I will try it on my case latter.
Here is what I did to circumvent this issue:
I converted complex128 tensor to a double channel float64 tensor, with its first channel stores the real part and the second channel stores the imag part. I also custom my own Linear and Conv2d layers, which take in the double channel tensor and perform Mul and Add operations according to the complex operation rules.
After these customization, the network has no complex calculation in its pipeline and could be optimized with traiditional optimizers.
Hope this information would be valuable to anyone in need.
Best,
Yi Zhang