Hi ptrblck,
Thanks for your reply. It really helps a lot.
The problems turn out to be a silly mistake in the code as I have put the tensorboard code right after model.eval() with torch.no_grad() set, so, it is showing none.
When i have apply your check in the main loop , it shows gradient for the whole model.
Thanks for you help again~~
Dick