experimental 4-bit dynamic quant using unsloth, these model will be used for inference and RoPE fine-tuning.
huggingkot
huggingkot
AI & ML interests
None yet
Recent Activity
updated
a model
10 days ago
huggingkot/Impish_Nemo_12B-q4f16_1-MLC
updated
a collection
10 days ago
mlc-ai-rp-12b
published
a model
10 days ago
huggingkot/Impish_Nemo_12B-q4f16_1-MLC
Organizations
None yet
for model less than 8b
-
huggingkot/Dolphin3.0-Qwen2.5-3b-q4f16_1-MLC
Text Generation • Updated • 2 -
huggingkot/Dolphin3.0-Qwen2.5-1.5B-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Dolphin3.0-Qwen2.5-0.5B-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Dolphin3.0-Llama3.1-8B-q4f16_1-MLC
Text Generation • Updated • 5
https://llm.mlc.ai/docs
-
huggingkot/DeepScaleR-1.5B-Preview-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Llama-3-8B-Instruct-abliterated-v2-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/aya-expanse-8b-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/LLAMA-3_8B_Unaligned_BETA-q4f16_1-MLC
Text Generation • Updated • 2
bookmark
-
huggingkot/Qwen2.5-Coder-14B-Instruct-q4f16_1-MLC
Text Generation • Updated • 3 -
huggingkot/Qwen2.5-Coder-7B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Qwen2.5-Coder-3B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Qwen2.5-Coder-1.5B-Instruct-q4f16_1-MLC
Text Generation • Updated • 2
experimental 4-bit dynamic quant using unsloth, these model will be used for inference and RoPE fine-tuning.
for model less than 8b
-
huggingkot/Dolphin3.0-Qwen2.5-3b-q4f16_1-MLC
Text Generation • Updated • 2 -
huggingkot/Dolphin3.0-Qwen2.5-1.5B-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Dolphin3.0-Qwen2.5-0.5B-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Dolphin3.0-Llama3.1-8B-q4f16_1-MLC
Text Generation • Updated • 5
-
huggingkot/Qwen2.5-Coder-14B-Instruct-q4f16_1-MLC
Text Generation • Updated • 3 -
huggingkot/Qwen2.5-Coder-7B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Qwen2.5-Coder-3B-Instruct-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Qwen2.5-Coder-1.5B-Instruct-q4f16_1-MLC
Text Generation • Updated • 2
https://llm.mlc.ai/docs
-
huggingkot/DeepScaleR-1.5B-Preview-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/Llama-3-8B-Instruct-abliterated-v2-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/aya-expanse-8b-q4f16_1-MLC
Text Generation • Updated • 1 -
huggingkot/LLAMA-3_8B_Unaligned_BETA-q4f16_1-MLC
Text Generation • Updated • 2
bookmark