Gemma-3-27B-Roblox-Luau
A fine tune of google/gemma-3-27b-it using boatbomber/roblox-info-dump and boatbomber/the-luau-stack for Roblox domain knowledge.
Available quants:
Quant | Size | Notes |
---|---|---|
Q8_O | 30.21GB | High resource use, but generally acceptable. Use only when accuracy is crucial. |
Q6_K | 23.32GB | Uses Q6_K for all tensors. Good for high end GPUs. |
Q5_K_M | 20.24GB | Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q5_K |
Q4_K_M | 17.34GB | Recommended. Uses Q6_K for half of the attention.wv and feed_forward.w2 tensors, else Q4_K |
Q3_K_M | 14.04GB | Uses Q4_K for the attention.wv, attention.wo, and feed_forward.w2 tensors, else Q3_K. Quality is noticeably degraded. |
- Downloads last month
- 12
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.