datasets:
- neph1/bellman-7b-finetune
language:
- sv
tags:
- unsloth
license: llama3
License: https://llama.meta.com/llama3/license
240608: Now deprecated in favor of https://huggingface.co/neph1/llama-3-instruct-bellman-8b-swedish
240508: Where is the real version?
There's been a number of issues with llama 3 finetuning, and most recently an issue with the tokenizer for ggufs. I'm holding back any release until the situation has stabilizied.
240421: Bellman's back! This is a preliminary test run, run on mostly the same settings and dataset as bellman-mistral-instruct (But not the dpo pass). Context length is 3072. I've done some basic testing, and it's not a total mess. Whether it's an improvement to llama-3-instruct, I'm not sure, because that's REALLY good.
I'll try to make a pass on full context length soon. And hopefully improve the results more.
Make sure to use the correct chat template (llama-3) for best results. I tested with koboldcpp.
Let me know if you'd like any specific version. To save time I only put the one up for this 'preview'.
Trained with Unsloth (https://github.com/unslothai/unsloth).
User: Vem var Edward Teach?
AI: Edward Teach, även känd som Svartskägg, var en engelsk sjörövare och piratkapten under 1700-talet. Han anses vara en av de mest berömda sjörövarna i historien.
User: Träffade han Gustav Vasa?
AI: Nej, Edward Teach, även känd som Svartskägg, levde mellan ca 1680-1720, medan Gustav Vasa dog 1560. Deras tidslinjer korsades inte.
User: Berätta om selma lagerlöf
AI: Selma Lagerlöf var en svensk författare som vann Nobelpriset i litteratur 1909. Hon är mest känd för sina verk 'Nils Holgerssons underbara resa genom Sverige' och 'Jerusalem'. Hennes skrivande inspirerades ofta av den svenska naturen och folket.