Bump… Anyone?
Note: Though I am aware of HuggingFace's BERT out-of-the-box, for simple non-NLP experiments using custom BERT-like small architectures, I think using PyTorch alone should suffice. PLMK if I’m wrong.