Hi,
I’m a relative beginner compared to many on these fora, so kid gloves please…
I’ve created a Conda env with the latest PyTorch nightly build in a bid to try and use autocast to get a GAN working (https://github.com/eriklindernoren/PyTorch-GAN/blob/master/implementations/relativistic_gan/relativistic_gan.py 27) that currently causes memory errors in my setup (RTX 2070).
I’ve added the relevant code as per the docs - @autocast() to both forward passes, scaler = GradScaler() before training loop, and scaling on loss and backward pass inside the training loop. I’m just missing something basic like an import, or maybe I’ve downloaded the wrong nightly build (I used conda install pytorch torchvision cudatoolkit=10.1 -c pytorch-nightly).
Help please!
Thanks and apologies for luddite question,
Mark