Llamacpp experimental Quantizations of gpt-oss-20b by Open AI

Using llama.cpp branch gpt-oss-mxfp4, PR here: https://github.com/ggml-org/llama.cpp/pull/15091

You must use that branch in order to run the model

This is a single static quant in the new MXFP4 format, rest of sizes will come after PR is merged

GGUF

Model size

20.9B params

Architecture

gpt-oss

Hardware compatibility

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for bartowski/openai_gpt-oss-20b-GGUF-MXFP4-Experimental

Base model

Quantized

(67)

this model