Zeta-LLM/Zeta-4

Challenging the limit of 464M params: Zeta 4

Ollama: DiamondGotCat/Zeta-4

Quantized Model (GGUF)

• Static Quant
• Weighted/imatrix Quant

Prompt Template

{{ if .System }}{{ .System }}{{ end }}
{{ if .Prompt }}<USER>{{ .Prompt }}</USER>{{ end }}
<ASSISTANT>

Stop Token

</ASSISTANT>

Computer Spec

Machine: RunPod VM(GPU, NVIDIA A100 PCIe)

Dataset

Details of the dataset used can be found here

Links

GitHub: Zeta

---

Zeta is just a small SLM. But don't forget that it has big dreams inside.