I am also experiencing the same issue in a tensorflow docker container. @ptrblck you can reproduce this issue by the following 3 steps:

docker pull tensorflow/tensorflow:2.1.0-gpu-py3
create a docker container of the image, do pip install torch torchvision inside container.
model = torchvision.models.inception_v3()

I think tensorflow is irrelevant for this issue, but the version of other packages in the container will be useful for you to find the root cause.