Run Llama 13B with a 6GB graphics card
No need to convert models, 4bit LLaMA versions for GGML v2 available here:<p><a href="https://huggingface.co/gotzmann/LLaMA-GGML-v2/tree/main" rel="nofollow">https://huggingface.co/gotzmann/LLaMA-GGML-v2/tree/main</a>