learning_rate: 7e-6
epoch: 3
context_length: 1024
prompt:

[
    {“role”: “system”, “content”: “從<Document>裡找到答案並利用該答案回答<Query>所敘述的問題”},
    {“role”: “system”, “content”: “<Document>{Q}{A}</Document>”},
    {“role”: “user”, “content”: “<Query>{Q}</Query>”},
    {“role”: “assistant”, “content”: {A}},
]
Downloads last month
2
GGUF
Model size
8.03B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for cool9203/Llama3.1-8B-Chinese-Chat-iii_finance-ctx_1024-GGUF