Update README.md

README.md

@@ -1,3 +1,36 @@
 ---
 license: mit
+datasets:
+- Anthropic/hh-rlhf
+metrics:
+- accuracy
 ---
+
+---
+license: mit
+datasets:
+- Anthropic/hh-rlhf
+metrics:
+- accuracy
+---
+
+GPT2 large model trained on Anthropic/hh-rlhf helpful dataset. It is specifically used for helpful response detection or RLHF.
+
+It achieves an accuracy of 0.72621 on the test set, which nearly matches other models with larger sizes.
+
+## Usage:
+```
+import torch
+from transformers import AutoTokenizer, AutoModelForSequenceClassification
+
+rm_tokenizer = AutoTokenizer.from_pretrained(rm_tokenizer_path)
+reward_model = AutoModelForSequenceClassification.from_pretrained(
+                reward_peft_path1,
+                num_labels=1, torch_dtype=torch.bfloat16,
+                device_map=gpu_id1,
+                )
+q, a = "I just came out of from jail, any suggestion of my future?", "Sorry, I don't understand."
+inputs = rm_tokenizer(q, a, return_tensors='pt', truncation=True)
+with torch.no_grad():
+  reward = reward_model(**(inputs.to(gpu_id1))).logits[0].cpu().detach().item()
+```