content.raw: Doing a lot of benchmarking and visualization work, which means I'm always searching for interesting repos in terms of file types, size, branches, and overall structure. 
content.type: text
content.value: Doing a lot of benchmarking and visualization work, which means I'm always searching for interesting repos in terms of file types, size, branches, and overall structure. 
content.type: new_line
content.type: new_line
content.raw: To help, I built a Space 
content.type: text
content.value: To help, I built a Space 
content.raw: https://huggingface.co/spaces/jsulz/repo-info
content.id: jsulz/repo-info
content.type: space
content.type: resource
content.url: https://huggingface.co/spaces/jsulz/repo-info
content.raw:  that lets you search for any repo and get back: 
content.type: text
content.value:  that lets you search for any repo and get back: 
content.type: new_line
content.type: new_line
content.raw: - Treemap of the repository, color coded by file/directory size
content.type: text
content.value: - Treemap of the repository, color coded by file/directory size
content.type: new_line
content.raw: -  Repo branches and their size
content.type: text
content.value: -  Repo branches and their size
content.type: new_line
content.raw: - Cumulative size of different file types (e.g., the total size of all the safetensors in the repo)
content.type: text
content.value: - Cumulative size of different file types (e.g., the total size of all the safetensors in the repo)
content.type: new_line
content.type: new_line
content.raw: And because I'm interested in how this will fit in our work to leverage content-defined chunking for versioning repos on the Hub 
content.type: text
content.value: And because I'm interested in how this will fit in our work to leverage content-defined chunking for versioning repos on the Hub 
content.type: new_line
content.raw:  - 
content.type: text
content.value:  - 
content.href: https://huggingface.co/blog/from-files-to-chunks
content.raw: https://huggingface.co/blog/from-files-to-chunks
content.type: link
content.raw:  - everything has the number of chunks (1 chunk = 64KB) as well as the total size in bytes. 
content.type: text
content.value:  - everything has the number of chunks (1 chunk = 64KB) as well as the total size in bytes. 
content.type: new_line
content.type: new_line
content.raw: Some of the treemaps are pretty cool. Attached are 
content.type: text
content.value: Some of the treemaps are pretty cool. Attached are 
content.raw: https://huggingface.co/black-forest-labs/FLUX.1-dev
content.id: black-forest-labs/FLUX.1-dev
content.type: model
content.type: resource
content.url: https://huggingface.co/black-forest-labs/FLUX.1-dev
content.raw:  and for fun 
content.type: text
content.value:  and for fun 
content.raw: https://huggingface.co/datasets/laion/laion-audio-preview
content.id: laion/laion-audio-preview
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/laion/laion-audio-preview
content.raw:  (which has nearly 10k .tar files 🤯)
content.type: text
content.value:  (which has nearly 10k .tar files 🤯)
content.type: new_line
content.type: new_line
rawContent: Doing a lot of benchmarking and visualization work, which means I'm always searching for interesting repos in terms of file types, size, branches, and overall structure. 
  
  To help, I built a Space https://huggingface.co/spaces/jsulz/repo-info that lets you search for any repo and get back: 
  
  - Treemap of the repository, color coded by file/directory size
  -  Repo branches and their size
  - Cumulative size of different file types (e.g., the total size of all the safetensors in the repo)
  
  And because I'm interested in how this will fit in our work to leverage content-defined chunking for versioning repos on the Hub 
   - https://huggingface.co/blog/from-files-to-chunks - everything has the number of chunks (1 chunk = 64KB) as well as the total size in bytes. 
  
  Some of the treemaps are pretty cool. Attached are https://huggingface.co/black-forest-labs/FLUX.1-dev and for fun https://huggingface.co/datasets/laion/laion-audio-preview (which has nearly 10k .tar files 🤯)
  
  
reactions.reaction: 👀
reactions.users: John6666 julien-c den0620 rajatarya
reactions.reaction: 🔥
reactions.users: julien-c port8080 rajatarya Azathothas
reactions.reaction: 👍
reactions.users: Aurelien-Morgan port8080 rajatarya
commentators._id: 65d50e9ef9cbfa798c590004
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65d50e9ef9cbfa798c590004/FlVe8chafigMfrPpMeJRL.jpeg
commentators.fullname: Jared Sulzdorf
commentators.name: jsulz
commentators.type: user