no_decay = ['bias', 'LayerNorm.bias', 'LayerNorm.weight']
what does this means? Whay these three kind no decay?
Yes. We are reproducing the behavior of the original optimizer, see [here](https://github.com/google-research/bert/blob/master/optimization.py#L65).<|||||>thanks~<|||||>but why?<|||||>I have the same question, but did this prove to be better? Or is it just to speed up calculations?