Hugging Face's logo
Rajat Arya's picture
3 13

Rajat Arya

rajatarya
erinys's profile picture sugatoray's profile picture qgallouedec's profile picture
·
https://rajatarya.com

AI & ML interests

None yet

Recent Activity

new activity 4 days ago
xet-team/README:Xet Storage Not Deduplicating for Even Simple Binary Files
upvoted a collection 16 days ago
Qwen3
new activity about 1 month ago
meta-llama/Llama-4-Maverick-17B-128E-Instruct:[request for feedback] faster downloads with xet
View all activity

Organizations

Hugging Face's profile picture Xet Team's profile picture

rajatarya's activity

New activity in xet-team/README 4 days ago

Xet Storage Not Deduplicating for Even Simple Binary Files

8
#3 opened 6 days ago by
lyk
upvoted a collection 16 days ago
New activity in meta-llama/Llama-4-Maverick-17B-128E-Instruct about 1 month ago

[request for feedback] faster downloads with xet

4
#18 opened about 2 months ago by
clem
New activity in meta-llama/Llama-4-Scout-17B-16E-Instruct about 2 months ago

[request for feedback] Faster downloads with Xet

🔥 12
18
#16 opened about 2 months ago by
clem
upvoted a collection about 2 months ago
upvoted an article about 2 months ago
view article
Article

Welcome Llama 4 Maverick & Scout on Hugging Face!

By burtenshaw and 6 others •
• 144
published an article about 2 months ago
view article
Article

Welcome Llama 4 Maverick & Scout on Hugging Face!

By burtenshaw and 6 others •
• 144
published a model about 2 months ago
replied to jsulz's post 2 months ago
view reply

Let's go! Get on the waitlist - can't wait to get you onboarded with Xet. From a customer onboarding last week, "Yeah, it's pretty seamless.... oh wait, that was fast."
reacted to jsulz's post with ❤️🚀 2 months ago
view post
Post
1456
It's finally here ❤️

Build faster than ever with lightning fast upload and download speeds starting today on the Hub ⚡

Xet storage is rolling out access across the Hub - join the waitlist here https://huggingface.co/join/xet

You can apply for yourself, or your entire organization. Head over to your account settings for more information or join anywhere you see the Xet logo on a repository you know.

Have questions? Join the conversation below 👇 or open a discussion on the Xet team page xet-team/README
·
upvoted an article 3 months ago
view article
Article

From Chunks to Blocks: Accelerating Uploads and Downloads on the Hub

By jsulz and 3 others •
• 64
reacted to jsulz's post with 👀👍🔥 5 months ago
view post
Post
1450
Doing a lot of benchmarking and visualization work, which means I'm always searching for interesting repos in terms of file types, size, branches, and overall structure.

To help, I built a Space jsulz/repo-info that lets you search for any repo and get back:

- Treemap of the repository, color coded by file/directory size
- Repo branches and their size
- Cumulative size of different file types (e.g., the total size of all the safetensors in the repo)

And because I'm interested in how this will fit in our work to leverage content-defined chunking for versioning repos on the Hub
- https://huggingface.co/blog/from-files-to-chunks - everything has the number of chunks (1 chunk = 64KB) as well as the total size in bytes.

Some of the treemaps are pretty cool. Attached are black-forest-labs/FLUX.1-dev and for fun laion/laion-audio-preview (which has nearly 10k .tar files 🤯)

  • 2 replies
·
upvoted 2 articles 6 months ago
view article
Article

Introducing Observers: AI Observability with Hugging Face datasets through a lightweight SDK

By davidberenstein1957 and 1 other •
• 35
replied to cfahlgren1's post 6 months ago
view reply

Also - easily reference your datasets in your research, giving conference committees greater confidence in the reproducibility of your results (ex. share the dataset, the model, the paper, and the analysis - all on the Hub).

Research needs reproducibility, use HF Hub for collaboration & dissemination:
upvoted an article 8 months ago
upvoted an article 9 months ago