Running LLaMA 7B on a 64GB M2 MacBook Pro with Llama.cpp
Why is nobody commenting about the quality of these models?<p>I totally understand that quantization is decreasing quality and capabilities a bit but I haven&#x27;t seen anybody verifying the claim: LLaMA 13B &gt; GPT-3.  I was expecting LLaMA 65B to be as coherent as GPT-3 but LLaMA 65B (when run quantized) seems to think 2012 is in the future.