[Feature request] Support configurable BertLayerNorm epsilon
It would be great if we could configure `eps` in layer normalization since model like ERNIE uses `eps=1e-5` instead of `1e-12`.
Hi, I'm closing this in favor of #514 to gather all the discussion on ERNIE.