After reproducing the FQGAN implementation, CUDA out of memory occurred while training the model.
However, when I removed the feature quantization part that I implemented myself and ran it, no error occurred.
This means that the error occurs either in the model I implemented or in the FQ part where the loss value is added.
Here is the actual code. Maybe error occurred at Cell No.25/26/34.
[Colab] FQGAN 6
How can I fix the error?