experimental 4-bit dynamic quant using unsloth, these model will be used for inference and RoPE fine-tuning.
huggingkot
huggingkot
AI & ML interests
None yet
Recent Activity
liked
a model
14 days ago
nari-labs/Dia-1.6B
updated
a model
about 1 month ago
huggingkot/Llama-3-Karamaru-v1-q4f16_1-MLC
updated
a model
about 1 month ago
huggingkot/Llama-3-ELYZA-JP-8B-q4f16_1-MLC
Organizations
None yet
Collections
8
-
huggingkot/Qwen2.5-Coder-14B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Qwen2.5-Coder-7B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Qwen2.5-Coder-3B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Qwen2.5-Coder-1.5B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1
models
68
huggingkot/Llama-3-Karamaru-v1-q4f16_1-MLC
Text Generation
•
Updated
•
4
huggingkot/Llama-3-ELYZA-JP-8B-q4f16_1-MLC
Text Generation
•
Updated
•
3
huggingkot/Llama-3-ELYZA-JP-8B-bnb-4bit
Updated
•
2
huggingkot/Llama-3-Karamaru-v1-bnb-4bit
Updated
•
2
huggingkot/Rei-V2-12B-q4f16_1-MLC
Text Generation
•
Updated
•
2
huggingkot/Llama-3.1-Nemotron-Nano-8B-v1-bnb-4bit
Updated
•
56
huggingkot/Llama-3.1-Nemotron-Nano-8B-v1-q4f16_1-MLC
Text Generation
•
Updated
•
1
huggingkot/Fiendish_LLAMA_3B-bnb-4bit
Updated
•
2
•
1
huggingkot/Impish_LLAMA_3B-bnb-4bit
Updated
huggingkot/Impish_LLAMA_3B-q4f16_1-MLC
Text Generation
•
Updated
datasets
0
None public yet