Quantization Tests
Collection
Comparing Efficiency and Quality of various formats
•
9 items
•
Updated
FP8-Dynamic (Linear layers, PTQ activations) quant of cyberagent/Mistral-Nemo-Japanese-Instruct-2408 w/ LLM Compressor 0.4.0
- Downloads last month
- 3
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no library tag.
Model tree for shisa-ai/Mistral-Nemo-Japanese-Instruct-FP8-Dynamic
Base model
mistralai/Mistral-Nemo-Base-2407