ScholarCopilot: Training Large Language Models for Academic Writing with
  Accurate Citations
Academic writing requires both coherent text generation and precise citation
of relevant literature. Although recent Retrieval-Augmented Generation (RAG)
systems have significantly improved factual accuracy in general-purpose text
generation, their capacity to adequately support professional academic writing
remains limited. In this work, we introduce ScholarCopilot, a unified framework
designed to enhance existing large language models for generating professional
academic articles with accurate and contextually relevant citations.
ScholarCopilot dynamically determines when to retrieve scholarly references by
generating a retrieval token [RET], and then utilizes its representation to
look up relevant citations from a database. The retrieved references are fed
into the model to augment the generation process. We jointly optimize both the
generation and citation tasks within a single framework to increase efficiency.
Trained on 500K papers from arXiv, our model achieves a top-1 retrieval
accuracy of 40.1% on our evaluation dataset, outperforming baselines such as
E5-Mistral-7B-Instruct (15.0%) and BM25 (9.8%). On a dataset of 1,000 academic
writing samples, ScholarCopilot scores 16.2/25 in generation quality (measured
across relevance, coherence, academic rigor, completeness, and innovation),
surpassing models with 10x more parameters such as Qwen-2.5-72B-Instruct
(15.8/25). Human studies also confirm ScholarCopilot's superior performance in
citation recall, writing efficiency, and overall user experience, confirming
the effectiveness of our approach.
67ede79d21d7e74ee3e2832a
Yubo Wang
claimed_verified
2025-04-08T06:57:08.264Z
636a35eff8d9af4aea181608
https://cdn-avatars.huggingface.co/v1/production/uploads/636a35eff8d9af4aea181608/s9GFJYd_QXVbg0Lb4JpKj.jpeg
yubo
user
ubowang
67ede79d21d7e74ee3e2832b
Xueguang Ma
admin_assigned
2025-04-03T13:59:15.484Z
5ec82854968f6028e0559f70
/avatars/45b58d912f7d00cb351947cd79d5eeb4.svg
Xueguang Ma
user
MrLight
67ede79d21d7e74ee3e2832c
Ping Nie
admin_assigned
2025-04-03T13:59:44.386Z
65358802a920f38780b3248a
/avatars/9415510b598079973c2b0436ad12db9c.svg
Ping Nie
user
pingnieuk
67ede79d21d7e74ee3e2832d
Huaye Zeng
67ede79d21d7e74ee3e2832e
Zhiheng Lyu
admin_assigned
2025-04-03T13:59:50.957Z
6114ea319ae90b69cb29fc92
https://cdn-avatars.huggingface.co/v1/production/uploads/6114ea319ae90b69cb29fc92/uw2n4iiXGD5v5iUocmbxE.jpeg
Zhiheng Lyu
user
cogito233
67ede79d21d7e74ee3e2832f
Yuxuan Zhang
admin_assigned
2025-04-04T14:10:46.545Z
63b908d0e3c78740d8e950d0
/avatars/3e80075e92aebdfea712f70b00d5ec7d.svg
Yuxuan Zhang
user
Reacherx
67ede79d21d7e74ee3e28330
Benjamin Schneider
admin_assigned
2025-04-03T14:00:40.436Z
6669ffeecf27eed0f2f2581e
/avatars/6a1012cce15da12fa3bd6f9e0f87d100.svg
Benjamin Schneider
user
BenSchneider
67ede79d21d7e74ee3e28331
Yi Lu
67ede79d21d7e74ee3e28332
Xiang Yue
admin_assigned
2025-04-03T14:00:53.880Z
6230d750d93e84e233882dbc
https://cdn-avatars.huggingface.co/v1/production/uploads/6230d750d93e84e233882dbc/4MGEekLW3oWzqeFWDWvIK.jpeg
Xiang Yue
user
yuexiang96
67ede79d21d7e74ee3e28333
Wenhu Chen
admin_assigned
2025-04-03T13:59:08.344Z
6313a86154e6e5d9f0f94e04
https://cdn-avatars.huggingface.co/v1/production/uploads/1662232951344-6313a86154e6e5d9f0f94e04.jpeg
Wenhu Chen
user
wenhu
ScholarCopilot: Training Large Language Models for Academic Writing with
  Accurate Citations
Academic writing requires both coherent text generation and precise citation
of relevant literature. Although recent Retrieval-Augmented Generation (RAG)
systems have significantly improved factual accuracy in general-purpose text
generation, their capacity to adequately support professional academic writing
remains limited. In this work, we introduce ScholarCopilot, a unified framework
designed to enhance existing large language models for generating professional
academic articles with accurate and contextually relevant citations.
ScholarCopilot dynamically determines when to retrieve scholarly references by
generating a retrieval token [RET], and then utilizes its representation to
look up relevant citations from a database. The retrieved references are fed
into the model to augment the generation process. We jointly optimize both the
generation and citation tasks within a single framework to increase efficiency.
Trained on 500K papers from arXiv, our model achieves a top-1 retrieval
accuracy of 40.1% on our evaluation dataset, outperforming baselines such as
E5-Mistral-7B-Instruct (15.0%) and BM25 (9.8%). On a dataset of 1,000 academic
writing samples, ScholarCopilot scores 16.2/25 in generation quality (measured
across relevance, coherence, academic rigor, completeness, and innovation),
surpassing models with 10x more parameters such as Qwen-2.5-72B-Instruct
(15.8/25). Human studies also confirm ScholarCopilot's superior performance in
citation recall, writing efficiency, and overall user experience, confirming
the effectiveness of our approach.
ScholarCopilot is a unified framework that enhances large language models by dynamically retrieving and integrating scholarly citations, improving accuracy and effectiveness in academic text generation.
Retrieval-Augmented Generation (RAG) ScholarCopilot retrieval token academic writing large language models citation recall writing efficiency user experience