Hugging Face's logo

IkariDev
/
Athena-v4

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
2
Athena-v4
File size: 3,006 Bytes 
7141f7d
 
 
 
 
 
 
 
dde6405
 
7141f7d
 
 
 
 
 
 
73905b8
7141f7d
73905b8
7141f7d
73905b8
7141f7d
73905b8
7141f7d
3288913
7141f7d
73905b8
 
7141f7d
 
 
 
 
e57ce41
 
 
7141f7d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
68a4631
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
 
---
license: cc-by-nc-4.0
---

![image/png](https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/XKvu-iA8ZJaw2rRLm1sVn.png)

Experimental Athena v4 model. Use Alpaca format. Suitable for RP, ERP and general stuff.

I should state here that this is a HIGHLY experimental model!

<!-- description start -->
## Description

<!-- [Recommended settings - contributed by localfultonextractor](https://files.catbox.moe/ue0tja.json) -->

This repo contains fp16 files of Athena-V4.

[GGUF - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GGUF)

[GPTQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-GPTQ)

[exl2 - by waldie](https://huggingface.co/waldie/Athena-v4-8bpw-h8-exl2)

[AWQ - By TheBloke](https://huggingface.co/TheBloke/Athena-v4-AWQ)

[fp16 - by IkariDev+Undi95](https://huggingface.co/IkariDev/Athena-v4)

<!-- [GGUF - by IkariDev](https://huggingface.co/IkariDev/Athena-v4-GGUF)-->
[OLD(GGUF - by IkariDev+Undi95)](https://huggingface.co/IkariDev/Athena-v4-GGUF)

## Ratings:

Note: I have permission of all users to upload their ratings, i DONT screenshot random reviews without asking if i can put them here!

![image/png](https://cdn-uploads.huggingface.co/production/uploads/630dfb008df86f1e5becadc3/8kA_i7BVItCTiUGRdHkoy.png)

If you want your rating to be here, send me a message over on DC and ill put up a screenshot of it here. DC name is "ikaridev".

<!-- description end -->
<!-- description start -->
## Models+loras used and recipe

- Athena-v3
- Xwin-LM/Xwin-LM-13B-V0.1
- Undi95/PsyMedRP-v1-13B
- cgato/Thespis-13b-v0.2
- jondurbin/airoboros-l2-13b-3.0
```
Athena-v4-tmp1 = [ Athena-v3(0.85)+Xwin-LM/Xwin-LM-13B-V0.1(0.15) ]
Athena-v4-tmp2 = [ Undi95/PsyMedRP-v1-13B(0.55)+cgato/Thespis-13b-v0.2(0.45) ]

Athena-v4-tmp3 = Athena-v4-tmp1(0.55) + Athena-v4-tmp2(0.35)

Athena-v4 = Athena-v4-tmp3 + jondurbin/airoboros-l2-13b-3.0(0.1)
```
<!-- description end -->
<!-- prompt-template start -->
## Prompt template: Alpaca

```
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
{prompt}

### Response:

```

Thanks to [Undi95](https://huggingface.co/Undi95) for providing the machine for Athena v2 and Athena v3, and giving me infos about how things work. Going forward i will use a merging server provided by a friend.
# [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard)
Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_IkariDev__Athena-v4)

| Metric                | Value                     |
|-----------------------|---------------------------|
| Avg.                  | 50.92   |
| ARC (25-shot)         | 62.54          |
| HellaSwag (10-shot)   | 84.19    |
| MMLU (5-shot)         | 57.33         |
| TruthfulQA (0-shot)   | 50.87   |
| Winogrande (5-shot)   | 76.48   |
| GSM8K (5-shot)        | 11.98        |
| DROP (3-shot)         | 13.09         |