hi folks
curious if anyone has experience fine tuning RoBERTa for purposes of text classification for sentiment analysis on a dataset of ~1000 sentences on a model like RoBERTa or BERT large?
similarly, any idea how much it would cost to further pretrain the language model first on 1GB of uncompressed text?
thank you,
mick