Upload README.md with huggingface_hub

README.md

@@ -6,6 +6,23 @@ pipeline_tag: text-generation
 base_model: Qwen/Qwen3-30B-A3B
 ---
 
+# usage with sglang
+
+Currently, upstream sglang doesn't load this quant correctly due to a few minor issues. Until upstream is fixed, a working fork is available at https://github.com/nytopop/sglang/tree/qwen-30b-a3b:
+
+```shell
+uv venv --python 3.12
+
+# vllm is needed to load w4a16 quant scheme
+uv pip install vllm>=0.8.5
+
+# use patched sglang from git
+uv pip install git+https://github.com/nytopop/sglang.git@qwen-30b-a3b#subdirectory=python[all] --find-links https://flashinfer.ai/whl/cu124/torch2.5/flashinfer-python
+
+# run
+uv run python -m sglang.launch_server --model-path nytopop/Qwen3-30B-A3B.w4a16 --reasoning-parser qwen3 --dtype float16
+```
+
 # creation
 
 ```python