Machine Learning, NLP, Computer Vision, Information Retrieval, Transformers.
shouldn’t be constrained to only domains where fully automatic evaluation is possible. Text generation is one such task where fully automatic evaluation is notably hard: BLEU, ROUGE scores correlate with human judgements up to a point, and this correlation breaks down once they become optimization