Both me and I think @albanD gave it a shot in implementing it.
But we realized that before it could be possible to have a nice Tensorboard integration, we would need  either https://github.com/pytorch/pytorch/pull/1912 132 or https://github.com/pytorch/pytorch/pull/1815 102 merged into master.