inputs
| mask
masked inputs
| generator (Electraformlm)
gen logits
| gumbel softmax
generated
| discriminator(electraformpretraining)
disc logits
is_replaced = generated == inputs(x)
edited: is_replaced = generated != inputs 
is replaced is the true label for discriminator