shisa-ai
/

shisa-v2-mistral-nemo-12b-W8A8-INT8

8-bit precision

compressed-tensors

Model card Files Files and versions Community

leonardlin commited on Apr 15

Commit

82b3545

·

verified ·

1 Parent(s): 5e0f288

Create README.md

Files changed (1) hide show

README.md +9 -0

README.md ADDED Viewed

	@@ -0,0 +1,9 @@

+---
+license: apache-2.0
+base_model:
+- shisa-ai/shisa-v2-mistral-nemo-12b
+language:
+- ja
+- en
+---
+Quantized w/ [llm-compressor](https://github.com/vllm-project/llm-compressor)