bert.pooler.dense initialization 
Hey! Sorry if this is redundant. 

I saw 3 other issues asking similar questions but couldn't find these exact layers mentioned. 

Are bert.pooler.dense.weight  &  bert.pooler.dense.bias randomly initialized? 

Thank you so much! 

Hi Jasdeep,
No, they are initialized from Google's pretrained model (they are trained for next sentence prediction task during pretraining).