File size: 1,930 Bytes
d2d00cb 44670f4 d77ce7d d2d00cb 065153e 1873e25 d2d00cb 5c71dd0 d2d00cb 5c71dd0 7333164 d2d00cb 060e29a e864562 d2d00cb |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 |
---
datasets:
- neph1/bellman-7b-finetune
language:
- sv
tags:
- unsloth
license: llama3
---
License: https://llama.meta.com/llama3/license
240608: Now deprecated in favor of https://huggingface.co/neph1/llama-3-instruct-bellman-8b-swedish
240508: Where is the real version?
There's been a number of issues with llama 3 finetuning, and most recently an issue with the tokenizer for ggufs. I'm holding back any release until the situation has stabilizied.
240421: Bellman's back!
This is a preliminary test run, run on mostly the same settings and dataset as bellman-mistral-instruct (But not the dpo pass). Context length is 3072.
I've done some basic testing, and it's not a total mess. Whether it's an improvement to llama-3-instruct, I'm not sure, because that's REALLY good.
I'll try to make a pass on full context length soon. And hopefully improve the results more.
Make sure to use the correct chat template (llama-3) for best results. I tested with koboldcpp.
Let me know if you'd like any specific version. To save time I only put the one up for this 'preview'.
Trained with Unsloth (https://github.com/unslothai/unsloth).
User: Vem var Edward Teach?
AI: Edward Teach, även känd som Svartskägg, var en engelsk sjörövare och piratkapten under 1700-talet. Han anses vara en av de mest berömda sjörövarna i historien.
User: Träffade han Gustav Vasa?
AI: Nej, Edward Teach, även känd som Svartskägg, levde mellan ca 1680-1720, medan Gustav Vasa dog 1560. Deras tidslinjer korsades inte.
User: Berätta om selma lagerlöf
AI: Selma Lagerlöf var en svensk författare som vann Nobelpriset i litteratur 1909. Hon är mest känd för sina verk 'Nils Holgerssons underbara resa genom Sverige' och 'Jerusalem'. Hennes skrivande inspirerades ofta av den svenska naturen och folket. |