Thanks for your reply.
But in Contrastive Learning I must set dropout of the pretrained part. The tutorial Classify text with BERT | Text | TensorFlow 1 can’t help me. Is there any solution or new features for Contrastive Learning in TFHub? (Reference: [2104.08821] SimCSE: Simple Contrastive Learning of Sentence Embeddings 1)