only ct2 int8 convert
ct2-transformers-converter --model facebook/nllb-200-distilled-600M --quantization int8 --trust_remote_code --output_dir nllb-200-distilled-600M-ct2-int8
Original author: Facebook
Original author model URL: facebook/nllb-200-distilled-600M
- Downloads last month
- 126
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
HF Inference deployability: The model has no pipeline_tag.