Reward-Reasoning commited on
Commit
5f7beed
·
verified ·
1 Parent(s): 0b24fae

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -0
README.md CHANGED
@@ -3,6 +3,11 @@
3
  <!-- markdownlint-disable html -->
4
  <!-- markdownlint-disable no-duplicate-header -->
5
 
 
 
 
 
 
6
  ## 1. Introduction
7
 
8
  We propose **Reward Reasoning Models (RRMs)**. Unlike existing reward models, RRMs frames reward modeling as a reasoning task, wherein the model first produces a long chain-of-thought reasoning process before generating the final rewards.
@@ -190,3 +195,17 @@ The generated text:
190
  Okay, so I need to figure out which assistant is better for the given instruction. The instruction is asking, \"How do I detail a car?\" \n\nLooking at Assistant 1's response, it gives a brief overview of what detailing involves. It mentions washing the exterior and interior, polishing and waxing the exterior, and some interior cleaning steps like vacuuming, cleaning upholstery, and dusting. It also notes that polishing and waxing depend on the paint condition. But it's pretty short and doesn't go into much detail about the process.\n\nAssistant 2, on the other hand, provides a much more comprehensive guide. It breaks down the process into exterior and interior detailing with specific steps. For the exterior, it includes washing, drying, clay bar treatment, polishing, waxing, cleaning windows, and applying tire and trim dressing. For the interior, it covers removing trash, vacuuming, shampooing carpets, cleaning hard surfaces, windows, air vents, and final touches. It also adds additional tips about working in the shade, using separate buckets, gentle materials, and systematic cleaning.\n\nThe instruction is straightforward, asking how to detail a car. Assistant 1 gives a general idea but lacks the detailed steps that someone might need to actually perform the task. Assistant 2 provides a thorough, step-by-step guide that would be more helpful for someone looking to detail their car properly. \n\nConsidering the evaluation rules, the response should precisely execute the instruction. Assistant 2 does this by providing a detailed, organized approach, which is more helpful and accurate. It doesn't add unnecessary information but covers all necessary steps. \n\nTherefore, Assistant 2 is better because it offers a more precise, helpful, and detailed response to the instruction.\n</think>\n\nThe better response is provided by Assistant 2, as it offers a comprehensive and detailed guide to car detailing, which is more helpful and precise than the brief overview given by Assistant 1.\n\n\\boxed{Assistant 2}
191
  ```
192
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
3
  <!-- markdownlint-disable html -->
4
  <!-- markdownlint-disable no-duplicate-header -->
5
 
6
+ <center>
7
+ <h2><a href="https://arxiv.org/abs/2505.14674">Paper Link👀</a></h2>
8
+ </center>
9
+
10
+
11
  ## 1. Introduction
12
 
13
  We propose **Reward Reasoning Models (RRMs)**. Unlike existing reward models, RRMs frames reward modeling as a reasoning task, wherein the model first produces a long chain-of-thought reasoning process before generating the final rewards.
 
195
  Okay, so I need to figure out which assistant is better for the given instruction. The instruction is asking, \"How do I detail a car?\" \n\nLooking at Assistant 1's response, it gives a brief overview of what detailing involves. It mentions washing the exterior and interior, polishing and waxing the exterior, and some interior cleaning steps like vacuuming, cleaning upholstery, and dusting. It also notes that polishing and waxing depend on the paint condition. But it's pretty short and doesn't go into much detail about the process.\n\nAssistant 2, on the other hand, provides a much more comprehensive guide. It breaks down the process into exterior and interior detailing with specific steps. For the exterior, it includes washing, drying, clay bar treatment, polishing, waxing, cleaning windows, and applying tire and trim dressing. For the interior, it covers removing trash, vacuuming, shampooing carpets, cleaning hard surfaces, windows, air vents, and final touches. It also adds additional tips about working in the shade, using separate buckets, gentle materials, and systematic cleaning.\n\nThe instruction is straightforward, asking how to detail a car. Assistant 1 gives a general idea but lacks the detailed steps that someone might need to actually perform the task. Assistant 2 provides a thorough, step-by-step guide that would be more helpful for someone looking to detail their car properly. \n\nConsidering the evaluation rules, the response should precisely execute the instruction. Assistant 2 does this by providing a detailed, organized approach, which is more helpful and accurate. It doesn't add unnecessary information but covers all necessary steps. \n\nTherefore, Assistant 2 is better because it offers a more precise, helpful, and detailed response to the instruction.\n</think>\n\nThe better response is provided by Assistant 2, as it offers a comprehensive and detailed guide to car detailing, which is more helpful and precise than the brief overview given by Assistant 1.\n\n\\boxed{Assistant 2}
196
  ```
197
 
198
+
199
+ ## 6. Citation
200
+
201
+ ```
202
+ @misc{rewardreasoningmodel,
203
+ title={Reward Reasoning Model},
204
+ author={Jiaxin Guo and Zewen Chi and Li Dong and Qingxiu Dong and Xun Wu and Shaohan Huang and Furu Wei},
205
+ year={2025},
206
+ eprint={2505.14674},
207
+ archivePrefix={arXiv},
208
+ primaryClass={cs.CL},
209
+ url={https://arxiv.org/abs/2505.14674},
210
+ }
211
+ ```