Nexes Quantizations

community

AI & ML interests

My quants for my test models and other favs.

Recent Activity

Space to share Nexesenex's quants.

IQx_K quants and Q6_0 quants (or those having E60 in the name) require IK_Llama.cpp or Croco.cpp to be used.

NXS Quants are IK_Llama quants made with my NXS Llama.cpp mainline fork, so benefiniting from the last commits of Llama.cpp at the date of the quant publication.


Mradermarcher's quants of my models can mostly be found here : https://huggingface.co/mradermacher?search_models=Llama_3.

datasets 0

None public yet