2x7B AWQ
Collection
Mixture of experts 2 x 7B.
•
20 items
•
Updated
R136a1/InfinityKuno-2x7B AWQ
- Model creator: R136a1
- Original model: InfinityKuno-2x7B
Model Sumamry
Experimental model from Endevor/InfinityRP-v1-7B and SanjiWatsuki/Kunoichi-DPO-v2-7B models. Merged to MoE model with 2x7B parameters.
Prompt format:
Alpaca, Extended Alpaca, Roleplay-Alpaca. (Use any Alpaca based prompt formatting and you should be fine.)
- Downloads last month
- 75
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
HF Inference API has been turned off for this model.
Model tree for solidrust/InfinityKuno-2x7B-AWQ
Base model
R136a1/InfinityKuno-2x7BCollection including solidrust/InfinityKuno-2x7B-AWQ
Evaluation results
- normalized accuracy on AI2 Reasoning Challenge (25-Shot)test set Open LLM Leaderboard69.620
- normalized accuracy on HellaSwag (10-Shot)validation set Open LLM Leaderboard87.440
- accuracy on MMLU (5-Shot)test set Open LLM Leaderboard64.490
- mc2 on TruthfulQA (0-shot)validation set Open LLM Leaderboard63.280
- accuracy on Winogrande (5-shot)validation set Open LLM Leaderboard82.720
- accuracy on GSM8k (5-shot)test set Open LLM Leaderboard66.340