Exploring Fact Memorization and Style Imitation in LLMs Using QLoRA: An Experimental Study and Quality Assessment Methods
<|reference_start|>Exploring Fact Memorization and Style Imitation in LLMs Using QLoRA: An Experimental Study and Quality Assessment Methods: There are various methods for adapting LLMs to different domains. The most common methods are prompting, finetuning, and RAG. In this work, we explore the possibility of adapting a model using one of the PEFT methods - QLoRA. The experiment aims to simulate human responses based on their interviews. The simulation quality is assessed by comparing the quality of the style and the quality of the generated facts.<|reference_end|>
@article{vyborov2024exploring,
    title={Exploring Fact Memorization and Style Imitation in LLMs Using QLoRA: An
  Experimental Study and Quality Assessment Methods},
    author={Eugene Vyborov, Oleksiy Osypenko, Serge Sotnyk},
    journal={arXiv preprint arXiv:2406.08582},
    year={2024},
    archivePrefix={arXiv},
    eprint={2406.08582},
    primaryClass={cs.CL}
}