NLP, Transfer Learning, Language Model, Ulmfit, Text Classification.
originally written. To tokenize korean text I tried two tokenization models: korean spacy model that is a wrapper to korean mecab tokenizer. sentencepiece subwords tokenizer model trained on my corpus with 28000 maximum tokens As it’s recommended in the multifit article, I went with the second