Marc Sun's picture

Marc Sun

marcsun13

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

Organizations

Hugging Face's profile picture 🧨Diffusers's profile picture Hugging Face Internal Testing Organization's profile picture pytorch's profile picture HuggingFaceM4's profile picture Hugging Face OSS Metrics's profile picture accelerate's profile picture Hugging Face Smol Models Research's profile picture Quanto library's profile picture LocalLLaMA's profile picture MLX Community's profile picture Hugging Face 1Bit LLMs's profile picture Paris AI Running Club's profile picture LLHF's profile picture SLLHF's profile picture Hugging Quants's profile picture Hugging Face Party @ PyTorch Conference's profile picture qrias's profile picture wut?'s profile picture DDUF's profile picture gg-hf-g's profile picture Bitsandbytes Community's profile picture yofo's profile picture

marcsun13's activity

reacted to sayakpaul's post with 🚀🤗 6 days ago
view post
Post
2324
Diffusers supports a good variety of quantization backends. It can be challenging to navigate through them, given the complex nature of diffusion pipelines in general.

So, @derekl35 set out to write a comprehensive guide that puts users in the front seat. Explore the different backends we support, learn the trade-offs they offer, and finally, check out the cool space we built that lets you compare quantization results.

Give it a go here:
https://lnkd.in/gf8Pi4-2
upvoted 2 articles 12 days ago
view article
Article

The Transformers Library: standardizing model definitions

By lysandre and 3 others •
• 108
view article
Article

Exploring Quantization Backends in Diffusers

By derekl35 and 2 others •
• 31
published an article 13 days ago
view article
Article

Exploring Quantization Backends in Diffusers

By derekl35 and 2 others •
• 31
New activity in hf-accelerate/accelerate_examples 13 days ago