File size: 1,572 Bytes
17c1c43 d12b8ec 17c1c43 d25ffea d12b8ec 17c1c43 d12b8ec ce88851 d12b8ec dd7ad2c ce88851 ad713b3 d12b8ec ce88851 19051cc ba7395f de253dd dd7ad2c |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 |
---
license: llama3
---
Llama 3 Verus 8b (name subject to change) is an LLM trained specifically to help people understand Verus — an open-source multi-chain blockchain protocol with unlimited scale. It's trained mainly on QA-style data produced by [Verustoolkit](https://github.com/e-p-armstrong/verustoolkit).
Everything about Llama 3 Verus is open-source, from the data generation code to the datasets themselves to the training configs.
This model has been trained both to memorize facts about Verus, and to use RAG. It should achieve good performance without RAG so long as enough latent space activation is supplied via the system prompt (shown below) -- but RAG will be an extra guard against hallucinations, especially at the lower quantization levels.
Axolotl configs are provided, as are a number of GGUF quants created using the imatrix method. The imatrix itself is also provided with this repo.
Prompt template: ChatML.
Recommended: use the lmstudio config in the `files` section of this repo!
Temperature recommendation: 0.05 or something else that's low.
Recommended: if you're on a computer, you should probably use ggml-model-Q8_0.gguf -- this is the quantized version with the highest precision and best quality.
Example conversation (No RAG used!)
Created with 💙 by Evan Armstrong for the Verus Community
Built with Meta Llama 3
If you're curious about Verus and its mission, feel free to check out https://verus.io/ |