Accompaniment Prompt Adherence: A measure for evaluating music accompaniment systems
<|reference_start|>Accompaniment Prompt Adherence: A measure for evaluating music accompaniment systems: Generative systems of musical accompaniments are rapidly growing, yet there are no standardized metrics to evaluate how well generations align with the conditional audio prompt. We introduce a distribution-based measure called Accompaniment Prompt Adherence (APA), and validate it through objective experiments on synthetic data perturbations, and human listening tests. Results show that APA aligns well with human judgments of adherence and is discriminative to transformations that degrade adherence. We release a Python implementation of the metric using the widely adopted pre-trained CLAP embedding model, offering a valuable tool for evaluating and comparing accompaniment generation systems.<|reference_end|>
@article{grachten2024accompaniment,
    title={Accompaniment Prompt Adherence: A measure for evaluating music
  accompaniment systems},
    author={Maarten Grachten, Javier Nistal},
    journal={arXiv preprint arXiv:2404.00775},
    year={2024},
    archivePrefix={arXiv},
    eprint={2404.00775},
    primaryClass={cs.SD eess.AS}
}