Sylvestre Bcht's picture

Sylvestre Bcht

Sylvestre

·

Kakulukian

AI & ML interests

None yet

Recent Activity

upvoted an article about 19 hours ago

Why We Built the OpenMDW License: A Comprehensive License for ML Models

reacted to anakin87's post with ➕ 1 day ago

🧰 Free up space on the Hub with `super_squash_history` 🧹 As you may know, Hugging Face Hub has storage limits on private repos (100 GB for free users, 1 TB for PROs). This weekend I did some cleanup on my private repos I went 1.58 TB down to 1 GB. 😅 Besides deleting old, unused models, the main tool I used was a lesser-known command: `super_squash_history`. When you train a model, you often push multiple checkpoints to the Hub. Each checkpoint = a commit. A 2.6B model in BF16 is ~5 GB. So 10 checkpoints = 50 GB. That adds up fast. While full commit history can be useful for rollbacks, it's often unnecessary for older experiments where only the final model matters. In these cases, you can use `super_squash_history`: it reduces your entire repo history to a single commit. https://huggingface.co/docs/huggingface_hub/main/en/package_reference/hf_api#huggingface_hub.HfApi.super_squash_history ⚠️ super_squash_history is a non-revertible operation. Once squashed, the commit history cannot be retrieved. Hope this is useful to others.

liked a model 1 day ago

katanemo/Arch-Router-1.5B

View all activity

Organizations

Sylvestre 's datasets 1

Sylvestre/my-wonderful-dataset

Updated Jun 12, 2024 • 11