view article Article 180B Parameters, 32GB of RAM: Pushing MoE Inference to the Limit with Transformers tarekziade • 1 day ago • 9
view article Article llama.cpp v1.0.0 : A stronger foundation for the local AI ecosystem ggml-org • 6 days ago • 221
view article Article Sort your prompts: a free speed-up for MoE batch inference badaoui • Oct 19 • 10
view article Article Transformers now runs llama.cpp quants +1 marcsun13, ArthurZ, lysandre • Sep 22 • 122
view article Article Async GRPO with LoRA across HF Jobs: a bucket, a proxy, and no NCCL +2 aminediroHF, qgallouedec, kashif, sergiopaniego • Sep 10 • 55
Muse Glimmer Collection Muse Glimmer 30B: multimodal agentic model for local deployment. BF16 weights, GGUF k-quants, ExecuTorch builds, DFlash drafter. • 4 items • Updated Aug 10 • 131
view article Article Hugging Face on AMD Instinct MI455X: First Transformers Results badaoui • Jul 23 • 19
view article Article Be Ready Before the Attack: A Practical Guide to Self-Hosting an Open Model for Cyber Defense jeffboudier • Jul 20 • 24
view article Article Hugging Face on AMD Instinct MI300 GPU +2 fxmarty, mohitsha, seungrokj, mfuntowicz • May 21, 2024 • 17
AMD Developer Cloud One Click Models Collection One Click Models List on HF • 50 items • Updated 3 days ago • 6
view article Article Hugging Face and Cerebras bring Gemma 4 to real-time voice AI +2 A-Mahla, andito, lvwerra, vyassaurabh • Jul 1 • 108
view article Article Featuring Every Eval Ever Results on Hugging Face Model Pages +5 deepmage121, evijit, SaylorTwift, janbatzner, borgr, irenesolaiman, julien-c • Jun 30 • 55
view article Article Arcee Becomes the First Major American AI Lab to Replace AWS S3 with Hugging Face Private Storage, in a Multi-Million Dollar Commercial Partnership clem • Jun 9 • 36
view article Article Profiling in PyTorch (Part 1): A Beginner's Guide to torch.profiler +3 ariG23498, sayakpaul, sergiopaniego, ror, pcuenq • May 29 • 189
view article Article The Open Source Community is backing OpenEnv for Agentic RL +18 burtenshaw, spisakjo, lysandre, darktex, willcb, qjoy, pawalt, cwing-nv, danielhanchen, andrewzhou, thegovind, shimmyshimmer, Hamid-Nazeri, Sanyam, zkwentz, emre0, lewtun, sergiopaniego, banghua, unseenmars • Jun 8 • 124
view article Article Designing the hf CLI as an agent-optimized way to work with the Hub celinah, Wauplin • Jun 4 • 61