that sounds like a bug, but i cant fathom why.
Because the implementation of Adam is simple, and it just loops over param groups: https://github.com/pytorch/pytorch/blob/master/torch/optim/adam.py#L60 22