Original model is https://huggingface.co/ByteDance-Seed/BAGEL-7B-MoT
ema-FP8.safetensors is float8_e4m3fn.
float8_e4m3fn weight of: https://huggingface.co/ByteDance-Seed/BAGEL-7B-MoT
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support