6
InferBench
🥇
A cost/quality/speed Leaderboard for Inference Providers!
Nils Fleischmann
nifleisch
AI & ML interests
Making generative models smaller, faster, and greener.
Recent Activity
liked
a Space
3 days ago
PrunaAI/InferBench
liked
a model
6 days ago
HiDream-ai/HiDream-I1-Full
Organizations
nifleisch's activity
liked
a
Space
3 days ago
liked
a
model
6 days ago
reacted to
sharpenb's
post with 🔥
27 days ago
Post
3079
We open-sourced the
- Github repo: https://github.com/PrunaAI/pruna
- Documentation: https://docs.pruna.ai/en/stable/index.html
With open-sourcing, people can now inspect and contribute to the open code. Beyond the code, we provide detailed readme, tutorials, benchmarks, and documentation to make transparent compression, evaluation, and saving/loading/serving of AI models.
Happy to share it with you and always interested in collecting your feedback :)
pruna package that can be easily installed with pip install pruna :) It allows to easily ccompress and evaluate AI models including transformers and diffusers.- Github repo: https://github.com/PrunaAI/pruna
- Documentation: https://docs.pruna.ai/en/stable/index.html
With open-sourcing, people can now inspect and contribute to the open code. Beyond the code, we provide detailed readme, tutorials, benchmarks, and documentation to make transparent compression, evaluation, and saving/loading/serving of AI models.
Happy to share it with you and always interested in collecting your feedback :)
- 1 reply
liked
a
model
30 days ago
updated
a
model
3 months ago
Upload folder using huggingface_hub
2
#2 opened 3 months ago
by
nifleisch
published
a
model
3 months ago
Upload folder using huggingface_hub
2
#1 opened 3 months ago
by
nifleisch
updated
a
model
3 months ago
Upload folder using huggingface_hub
2
#2 opened 3 months ago
by
nifleisch
published
a
model
3 months ago
Upload folder using huggingface_hub
2
#1 opened 3 months ago
by
nifleisch
reacted to
sharpenb's
post with 🔥🚀
3 months ago
Post
1907
We compressed SmolLMs to make 135 variations of them (see
PrunaAI
) with different quantization configurations with
We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
PrunaAI
) with different quantization configurations with pruna (https://docs.pruna.ai/en/latest/). We made a blog to summarize our findings (see https://www.pruna.ai/blog/smollm2-smaller-faster) and small LM can be made smaller! :)
- 3 replies
Upload folder using huggingface_hub
2
#3 opened 3 months ago
by
nifleisch
updated
a
model
3 months ago
Why don't you include the tokenizer ?
1
3
#2 opened 3 months ago
by
Jeronymous
published
a
model
3 months ago
Upload folder using huggingface_hub
2
#1 opened 3 months ago
by
nifleisch