I don’t know, how TensorFlow uses CUDA and cudnn and if they are packaging it with their wheels/binaries.
I’m not using tensorboard personally, but would guess you would need to install the tensorboard binary to run it.