 Training procedure  The model was trained on 32 40GB A100 for approximately 100 hours with the following configurations:  - Base model:      - `bert-large-uncased` - Optimizer settings:     - `optimizer  = AdamW`     - `lr         = 1e-5`     - `schedule   = linear`     - `warmup     = 20,000 steps`     - `batch size = 2048`     - `training steps = 150,000` - MoCo settings:      - `queue size  = 8192`     - `momentum    = 0.999`     - `temperature = 0.05`    