Yes I am using torchvision.models.resnet152 with an input shape of [8, 3, 224, 224]. I am not sure when you say latest Pytorch release? I have installed pytorch using conda install pytorch torchvision torchaudio cudatoolkit=11.1 -c pytorch -c conda-forge which you have shared above so I am assuming the latest release.
Also now I am getting the below shared error now.
RuntimeError: CUDA out of memory. Tried to allocate 1.10 GiB (GPU 0; 4.00 GiB total capacity; 518.64 MiB already allocated; 1.73 GiB free; 564.00 MiB reserved in total by PyTorch)
Request your help on this as well