Vortex Collection ModelCloud optimized and validated quants that pass/meet strict quality assurance on multiple benchmarks. No one quantize • 18 items • Updated Mar 28 • 10
view article Article Accelerating LLM Inference: Fast Sampling with Gumbel-Max Trick By cxdu • Oct 24, 2024 • 12