Explanation

  • With the base model, attached the DPO applied Adapter

Base Model

Adapter Base Model

Adapter Corpus

Score

Average ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K
76.09 73.89 88.94 65.03 71.24 87.61 69.83

Log

  • 2024.02.13: Initial version Upload

LICENSE

  • MIT
Downloads last month
36
Safetensors
Model size
12.9B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.

Dataset used to train dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach