readme: # ELECTRA discriminator base
  - pretrained with large Korean corpus datasets (30GB)
  - 113M model parameters (followed google/electra-base-discriminator config)
  - 35,000 vocab size
  - trained for 1,000,000 steps 
  - built on [lassl](https://github.com/lassl/lassl) framework  
    
  
  pretrain-data  
   ┣ korean_corpus.txt  
   ┣ kowiki_latest.txt  
   ┣ modu_dialogue_v1.2.txt  
   ┣ modu_news_v1.1.txt  
   ┣ modu_news_v2.0.txt  
   ┣ modu_np_2021_v1.0.txt  
   ┣ modu_np_v1.1.txt  
   ┣ modu_spoken_v1.2.txt  
   ┗ modu_written_v1.0.txt  