numen-tech's picture
Add weights
744bd08
metadata
license: gemma
base_model: cognitivecomputations/dolphin-2.9.4-gemma2-2b
base_model_relation: quantized
library_name: mlc-llm
pipeline_tag: text-generation

4-bit OmniQuant quantized version of dolphin-2.9.4-gemma2-2b for inference with the Private LLM app.