File size: 1,433 Bytes
4bf173a 8c29cd5 4bf173a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 |
---
license: apache-2.0
datasets:
- adamo1139/4chan_archive_ShareGPT_only5
- adamo1139/HESOYAM_v0.4
- adamo1139/uninstruct-v1-experimental-chatml
language:
- en
base_model:
- h2oai/h2o-danube3-4b-base
pipeline_tag: text-generation
---
# GGUF Quants
Quants for [adamo1139/danube3-4b-4chan-hesoyam-2510](https://huggingface.co/adamo1139/danube3-4b-4chan-hesoyam-2510) are available in this repo
# Model Details
I finetuned Danube3 4B Base on [adamo1139/uninstruct-v1-experimental-chatml](https://huggingface.co/datasets/adamo1139/uninstruct-v1-experimental-chatml) dataset with the goal being making AI assistant slop less likely.
Then I did finetuning on [adamo1139/4chan_archive_ShareGPT_only5](https://huggingface.co/datasets/adamo1139/4chan_archive_ShareGPT_only5) which is a filtered collection of 4chan threads from various boards for 1 epoch to introduce 4chan-specific slang.
Then I did finetuning on [adamo1139/HESOYAM_v0.4](https://huggingface.co/datasets/adamo1139/HESOYAM_v0.4) for 3 epochs to improve 1-on-1 chat capabilities.
This is a resulting model.
# Prompt format
Use ChatML prompt format.
System message should be in the format as below:
```
A chat on 4chan board /3/
A chat on 4chan board /g/
A chat on 4chan board /x/
A chat on 4chan board /pol/
```
# Evaluation
I am still vibe-checking the model but initial results are good. I might have put in a bit too much reddit style from HESOYAM, not sure.
|