truncated normal initializer
I have a reasonable truncated normal approximation. (Actually that is what tf does).
https://discuss.pytorch.org/t/implementing-truncated-normal-initializer/4778/16?u=ruotianluo

We could try that. Not sure how important it is though. Did you try it?<|||||>Ok I think we will stick to the normal_initializer for now. Thanks for indicating this option!