NexesQuants/MaziyarPanahi_calme-2.3-llama3.1-70b-f16-iMat-CQ-GGUF
Updated
•
5
My quants for my test models and other favs.
Space to share Nexesenex's quants.
IQx_K quants and Q6_0 quants (or those having E60 in the name) require IK_Llama.cpp or Croco.cpp to be used.
NXS Quants are IK_Llama quants made with my NXS Llama.cpp mainline fork, so benefiniting from the last commits of Llama.cpp at the date of the quant publication.
Mradermarcher's quants of my models can mostly be found here : https://huggingface.co/mradermacher?search_models=Llama_3.