Any plans for int8 quantized.w8a8?
#5 opened about 1 month ago
by
traphix
Error running on A100?
2
#4 opened about 1 month ago
by
traphix
can this verison use tp 8 in vllm?
#3 opened about 1 month ago
by
yangwan218
How many RAM in GBs when quantizing Qwen3-235B-A22B?
#2 opened about 1 month ago
by
traphix