pretrained model: tapas_masklm_id_3.0, accuracy: 35.657% on epoch 33

pretrained model: tapas_masklm_id_2.0, accuracy: 33.865% on epoch 57

pretrained model: tapas_masklm_id_5.0, accuracy: 30.478% on epoch 16

pretrained model: tapas_masklm_id_1.0, accuracy: 28.088% on epoch 58

pretrained model: tapas_masklm_id_3.0, accuracy: 32.271% on epoch 33

pretrained model: tapas_masklm_id_2.0, accuracy: 31.275% on epoch 32

pretrained model: tapas_masklm_id_1.0, accuracy: 28.486% on epoch 31

masklm 1.0, accuracy 24.701% on epoch 21

masklm 2.1, accuracy 31.275% on epoch 57

masklm 1.0, accuracy 30.876% on epoch 58