Skegma-GPTJ / README.md
leaderboard-pr-bot's picture
Adding Evaluation Results
8046490
|
raw
history blame
909 Bytes
metadata
license: creativeml-openrail-m

This is a 50/50 weight merge of KoboldAI's adventure based language model GPT-J-6B-Skein, and PygmalionAI's Pygmalion-6b.

https://huggingface.co/KoboldAI/GPT-J-6B-Skein https://huggingface.co/PygmalionAI/pygmalion-6b

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 34.87
ARC (25-shot) 43.77
HellaSwag (10-shot) 69.22
MMLU (5-shot) 25.37
TruthfulQA (0-shot) 34.67
Winogrande (5-shot) 64.64
GSM8K (5-shot) 1.52
DROP (3-shot) 4.91