YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

WIP model using LUT-B compression pathways on mlp layers, not yet supported in vllm

Downloads last month
10
Safetensors
Model size
5B params
Tensor type
BF16
路
F8_E4M3
路
U8
路
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support