Does SAM dream of EIG? Characterizing Interactive Segmenter Performance using Expected Information Gain
<|reference_start|>Does SAM dream of EIG? Characterizing Interactive Segmenter Performance using Expected Information Gain: We introduce an assessment procedure for interactive segmentation models. Based on concepts from Bayesian Experimental Design, the procedure measures a model's understanding of point prompts and their correspondence with the desired segmentation mask. We show that Oracle Dice index measurements are insensitive or even misleading in measuring this property. We demonstrate the use of the proposed procedure on three interactive segmentation models and subsets of two large image segmentation datasets.<|reference_end|>
@article{chung2024does,
    title={Does SAM dream of EIG? Characterizing Interactive Segmenter Performance
  using Expected Information Gain},
    author={Kuan-I Chung and Daniel Moyer},
    journal={arXiv preprint arXiv:2404.16155},
    year={2024},
    archivePrefix={arXiv},
    eprint={2404.16155},
    primaryClass={cs.CV cs.IT cs.LG math.IT}
}