Hi Richard, I’m interested in using your script. Since the README says that you train Electra-small from scratch, I was wondering if your script could be used to pre-train Electra-base or Electra-large starting from the already learned weights from google?
Thanks.