I have 3 different inputs- I preform 3 forward passes and one backward pass.
when my model has spectral_norm in it’s layers, the backward fails with the following message:
one of the variables needed for gradient computation has been modified by an inplace operation
once I remove spectral_norm from my model it passes.
is there any work around for this that will still let me perform 3 forward passes and one backward?
many thanks