Here is a working solution for this problem when you install from source from varunagrawal 83:
"
I recently encountered this exact problem when compiling from source. A clean install also didn’t help. What worked was removing the libgomp.so.1 library from the torch directory and instead sym-linking it to the one in /usr/lib.
ln -s /usr/lib/libgomp.so.1 path/to/python/site-packages/torch/lib/libgomp.so.1

"