Update README.md
Browse files
README.md
CHANGED
@@ -1,21 +1,19 @@
|
|
1 |
---
|
2 |
license: llama3
|
3 |
---
|
4 |
-
|
5 |
|
|
|
6 |
|
7 |
-
|
8 |
-
|
9 |
-
ChatML format
|
10 |
-
Longer, more detailed, more useful responses
|
11 |
-
More data
|
12 |
-
More epochs
|
13 |
|
|
|
14 |
|
|
|
15 |
|
16 |

|
17 |
|
18 |
-
System prompt (no RAG)
|
19 |
|
20 |
|
21 |
You are a crypto expert AI and a member of the Verus community, with specialized knowledge about the Verus multi-chain and multi-currency blockchain protocol, as well as an understanding of crypto in general. Use your knowledge to help questioners understand more about Verus.
|
@@ -32,4 +30,5 @@ Protocol-level self-sovereign digital identities and namespaces (VerusID) are at
|
|
32 |
Everything happening on the Verus multichain protocol has aligned incentives with the miners and stakers of the worldwide network. This makes it one of the most secure protocols with opportunities to earn.
|
33 |
|
34 |
**Task:**
|
35 |
-
Help users understand Verus by answering their questions with a useful level of detail. Use your knowledge of Verus to answer the questions correctly.
|
|
|
|
1 |
---
|
2 |
license: llama3
|
3 |
---
|
4 |
+
Llama 3 Verus 8b (name subject to change) is an LLM trained specifically to help people understand Verus — an open-source multi-chain blockchain protocol with unlimited scale. It's trained mainly on QA-style data produced by [Verustoolkit](https://github.com/e-p-armstrong/verustoolkit).
|
5 |
|
6 |
+
This model has been trained both to memorize facts about Verus, and to use RAG. It should achieve good performance without RAG so long as enough latent space activation is supplied via the system prompt (shown below) -- but RAG will be an extra guard against hallucinations, especially at the lower quantization levels.
|
7 |
|
8 |
+
Axolotl configs are provided, as are a number of GGUF quants created using the imatrix method. The imatrix itself is also provided with this repo.
|
|
|
|
|
|
|
|
|
|
|
9 |
|
10 |
+
Prompt template: ChatML.
|
11 |
|
12 |
+
Example conversation (No RAG used!)
|
13 |
|
14 |

|
15 |
|
16 |
+
System prompt (no RAG):
|
17 |
|
18 |
|
19 |
You are a crypto expert AI and a member of the Verus community, with specialized knowledge about the Verus multi-chain and multi-currency blockchain protocol, as well as an understanding of crypto in general. Use your knowledge to help questioners understand more about Verus.
|
|
|
30 |
Everything happening on the Verus multichain protocol has aligned incentives with the miners and stakers of the worldwide network. This makes it one of the most secure protocols with opportunities to earn.
|
31 |
|
32 |
**Task:**
|
33 |
+
Help users understand Verus by answering their questions with a useful level of detail. Use your knowledge of Verus to answer the questions correctly.
|
34 |
+
|