Yeah as stated by @pascal_notsawo , you pass model.parameters() into the optimizer it automatically removes the tensors with requires_grad = False. So the weight decay will not effect them as they are no longer part of the optimization process.
For the second case, if the inputs are not forwarded then the weight decay will still effect them, this you can check by plotting them on tensorboard or any other visualization