It’s copied from fairseq, but the basic idea is that you want to know the real probability of BOS, not just force it with probability 1. If I recall (open to being disproved), removing it breaks
RUN_SLOW=1 pytest tests/test_modeling_bart.py