Yes, you need two Optimizers.
The Network structure you have choosen is pretty similar to so called “GAN” Networks. There are a lot of them in the Link below

  
      
      GitHub
  
  
    

eriklindernoren/PyTorch-GAN 51

PyTorch implementations of Generative Adversarial Networks. - eriklindernoren/PyTorch-GAN


  
  
    
    
  
  


Greetings