Dear all,
text
Dear all,
new_line
new_line
We are happy to share that we have just open-sourced over 200 low-bit LLMs. For the MLX community, we have prepared 2-4 bit versions of mainstream LLMs. You can visit the following collection to access them: 
text
We are happy to share that we have just open-sourced over 200 low-bit LLMs. For the MLX community, we have prepared 2-4 bit versions of mainstream LLMs. You can visit the following collection to access them: 
https://huggingface.co/collections/GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58
GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58
collection
resource
https://huggingface.co/collections/GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58
. 
text
. 
new_line
new_line
These low-bit models can be conveniently used through our open-source tool at 
text
These low-bit models can be conveniently used through our open-source tool at 
https://github.com/GreenBitAI/gbx-lm
https://github.com/GreenBitAI/gbx-lm
link
. 
text
. 
new_line
new_line
Compared to other open-source quantization algorithms, these models provide better accuracy retention. We have provided some model evaluation results here: 
text
Compared to other open-source quantization algorithms, these models provide better accuracy retention. We have provided some model evaluation results here: 
new_line
https://github.com/GreenBitAI/green-bit-llm/blob/main/green_bit_llm/evaluation/README.md
https://github.com/GreenBitAI/green-bit-llm/blob/main/green_bit_llm/evaluation/README.md
link
. 
text
. 
new_line
new_line
You can also evaluate the models yourself using the evaluation script we provided.
text
You can also evaluate the models yourself using the evaluation script we provided.
Dear all,

We are happy to share that we have just open-sourced over 200 low-bit LLMs. For the MLX community, we have prepared 2-4 bit versions of mainstream LLMs. You can visit the following collection to access them: https://huggingface.co/collections/GreenBitAI/greenbitai-mlx-llm-6614eb6ceb8da657c2b4ed58. 

These low-bit models can be conveniently used through our open-source tool at https://github.com/GreenBitAI/gbx-lm. 

Compared to other open-source quantization algorithms, these models provide better accuracy retention. We have provided some model evaluation results here: 
https://github.com/GreenBitAI/green-bit-llm/blob/main/green_bit_llm/evaluation/README.md. 

You can also evaluate the models yourself using the evaluation script we provided.
🔥
YaTharThShaRma999 victor yanghaojin alobnayis NicoNico KingNish adhisetiawan clem
👍
NicoNico adhisetiawan clem
64b9f4569d8360edd98a9b62
https://cdn-avatars.huggingface.co/v1/production/uploads/64b9f4569d8360edd98a9b62/HsPmCGBbgcrtj0VLVY_ex.png
fhsp
fhsp93
user