|
|
--- |
|
|
license: other |
|
|
inference: false |
|
|
language: |
|
|
- en |
|
|
pipeline_tag: text-generation |
|
|
tags: |
|
|
- transformers |
|
|
- gguf |
|
|
- imatrix |
|
|
- wizardlm |
|
|
--- |
|
|
Quantizations of https://huggingface.co/dreamgen/WizardLM-2-7B |
|
|
|
|
|
# From original readme |
|
|
|
|
|
## Usage |
|
|
|
|
|
❗<b>Note for model system prompts usage:</b> |
|
|
|
|
|
|
|
|
<b>WizardLM-2</b> adopts the prompt format from <b>Vicuna</b> and supports **multi-turn** conversation. The prompt should be as following: |
|
|
|
|
|
``` |
|
|
A chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, |
|
|
detailed, and polite answers to the user's questions. USER: Hi ASSISTANT: Hello.</s> |
|
|
USER: Who are you? ASSISTANT: I am WizardLM.</s>...... |
|
|
``` |
|
|
|
|
|
<b> Inference WizardLM-2 Demo Script</b> |
|
|
|
|
|
We provide a WizardLM-2 inference demo [code](https://github.com/nlpxucan/WizardLM/tree/main/demo) on our github. |
|
|
|
