ljvmiranda921 commited on
Commit
b8ff57b
·
verified ·
1 Parent(s): 0992d13

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +50 -0
README.md ADDED
@@ -0,0 +1,50 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - en
5
+ datasets:
6
+ - rubricreward/R3-Dataset-4K
7
+ base_model:
8
+ - Qwen/Qwen3-14B
9
+ pipeline_tag: text-generation
10
+ library_name: transformers
11
+ ---
12
+
13
+ <img alt="R3 Logo" src="https://cdn-avatars.huggingface.co/v1/production/uploads/651803f834c26962535eb022/hj3UEN9_9wlkmvMfUY1OL.png" width="150px">
14
+
15
+ # R3-Qwen3-14B-LoRA-4k
16
+
17
+ R3-Qwen3-14B-LoRA-4k is part of the R3 family, a series of **R**obust **R**ubric-Agnostic **R**eward Models.
18
+ We perform SFT on the Qwen3 model family on the 4B, 8B, and 14B scales as well as on Phi-4-reasoning plus.
19
+ Check out [our paper](https://arxiv.org/abs/2505.13388) for more information!
20
+
21
+
22
+ ## Model description
23
+
24
+ - **Model type:** A reward model trained on a curated R3 dataset collected from 45 diverse sources that covers
25
+ tasks such as classification, preference optimization, and question answering. Each example in the dataset contains an instruction and task description, input, response(s),
26
+ evaluation rubrics, and a score along with the corresponding reasoning.
27
+ - **Language(s) (NLP):** English
28
+ - **License:** Apache 2.0
29
+ - **Finetuned from model:** Qwen/Qwen3-14B
30
+
31
+ ### Model Sources
32
+
33
+ - **Project Page:** https://rubricreward.github.io
34
+ - **Repository:** https://github.com/rubricreward/r3
35
+ - **Paper:** https://arxiv.org/abs/2505.13388
36
+
37
+ ## License and use
38
+
39
+ R3 is licensed under the Apache 2.0 license.
40
+
41
+ ## Citation
42
+
43
+ ```bibtex
44
+ @article{anugraha2025r3,
45
+ title={R3: Robust Rubric-Agnostic Reward Models},
46
+ author={Anugraha, David and Tang, Zilu and Miranda, Lester James V. and Zhao, Hanyang and Farhansyah, Mohammad Rifqi and Kuwanto, Garry and Wijaya, Derry and Winata, Genta Indra},
47
+ journal={arXiv preprint arXiv:2505.13388},
48
+ year={2025}
49
+ }
50
+ ```