I got the same problem, anyone managed to solve this?
EDIT: Using Pytorch 1.4.0 and installing tensorboard nightly (2.3.0a I believe I installed) then it worked perfectly for me. Might be worth checking if you run into the same issue.