Thanks for the reply @BramVanroy!  And thanks a lot for correcting me. I was wondering why the weights for sentence order prediction (SOP) classification (or next sentence prediction) weights are not ported/converted, while it is provided by the original implementation? Thanks!