sanaz:

this code


Hi,
I am also interested in this topic.
I have a question about how to generate the mask “[MASK]” for the masked token
 input_ids[0][7] = tokenizer.mask_token_id
I was wondering if there is a function that generates “[MASK]” on 15% of the tokens (more accurately generates “[MASK]” on 80% out of the 15%, replaces with random tokens 10% out of the 15%, leaves the tokens as they are in 10% out of the 15%) ?
Or I need to write this function myself?
Thanks,
Ayala