My guess is older libs are under /home/audrius/anaconda3/lib/python3.5 and are mixing up with newer libs under /home/audrius/anaconda3/lib/python3.6.

This was indeed the issue. Had updated from Python 3.5 to 3.6 at one point.
LD_LIBRARY_PATH was pointing to both current /home/audrius/anaconda3/lib/python3.6 and old /home/audrius/anaconda3/lib/python3.5 paths.
Reinstalling anaconda was the solution. PyTorch 0.3.0 is now running.
Thank you for your prompt response and assistance. Much appreciated by this linux newbie.