If you are using the recommended way of specifying a dict with the per-layer parameters, it should be visible which layers/parameters are using which learning rate.
You could double check the ids of the parameters inside the optimizer and compare it to the parameters in the model.