As the model is generating bos token my guess is you didn’t shift labels. For BART we need to prepare labels and deocder_input_ids like this
target_ids = tokenizer("...")
decoder_input_ids = target_ids[:, :-1].contiguous()
labels = target_ids[:, 1:].clone()