I have not tried this personally, but from browsing through the code (specifically the tests), it looks like this library should solve your issue: https://github.com/RustingSword/tensorboard_logger 60
Of course, this is not official PyTorch C++ frontend support for TensorBoard, but I am assuming that is not a hard requirement (in the short term).