Facilitating Human Feedback for GenAI Prompt Optimization
<|reference_start|>Facilitating Human Feedback for GenAI Prompt Optimization: This study investigates the optimization of Generative AI (GenAI) systems through human feedback, focusing on how varying feedback mechanisms influence the quality of GenAI outputs. We devised a Human-AI training loop where 32 students, divided into two groups, evaluated AI-generated responses based on a single prompt. One group assessed a single output, while the other compared two outputs. Preliminary results from this small-scale experiment suggest that comparative feedback might encourage more nuanced evaluations, highlighting the potential for improved human-AI collaboration in prompt optimization. Future research with larger samples is recommended to validate these findings and further explore effective feedback strategies for GenAI systems.<|reference_end|>
@article{sherson2024facilitating,
    title={Facilitating Human Feedback for GenAI Prompt Optimization},
    author={Jacob Sherson, Florent Vinchon},
    journal={arXiv preprint arXiv:2404.15304},
    year={2024},
    archivePrefix={arXiv},
    eprint={2404.15304},
    primaryClass={cs.HC}
}