Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation
  for Generative AI
In the dynamic landscape of generative NLP, traditional text processing
pipelines limit research flexibility and reproducibility, as they are tailored
to specific dataset, task, and model combinations. The escalating complexity,
involving system prompts, model-specific formats, instructions, and more, calls
for a shift to a structured, modular, and customizable solution. Addressing
this need, we present Unitxt, an innovative library for customizable textual
data preparation and evaluation tailored to generative language models. Unitxt
natively integrates with common libraries like HuggingFace and LM-eval-harness
and deconstructs processing flows into modular components, enabling easy
customization and sharing between practitioners. These components encompass
model-specific formats, task prompts, and many other comprehensive dataset
processing definitions. The Unitxt-Catalog centralizes these components,
fostering collaboration and exploration in modern textual data workflows.
Beyond being a tool, Unitxt is a community-driven platform, empowering users to
build, share, and advance their pipelines collaboratively. Join the Unitxt
community at https://github.com/IBM/unitxt!
65b31aa18627e4cca319973e
Elron Bandel
admin_assigned
2024-01-26T09:52:55.318Z
5fc0292de45c5468456e022b
https://cdn-avatars.huggingface.co/v1/production/uploads/5fc0292de45c5468456e022b/MEuHFEf6LtTbcptc0heoM.png
Elron Bandel
user
Elron
65b31aa18627e4cca319973f
Yotam Perlitz
admin_assigned
2024-01-26T09:53:07.694Z
61e01a92a24b774dac1f32d7
/avatars/307aac0c6cfe1879f6a5e5e1d6c10413.svg
Yotam Perlitz
user
per
65b31aa18627e4cca3199740
Elad Venezian
admin_assigned
2024-01-26T09:53:14.387Z
62fcd609c1588e1d4c6526ea
/avatars/11eb8818ed43e14584e3d42930308fc8.svg
Elad Venezian
user
eladven
65b31aa18627e4cca3199741
Roni Friedman-Melamed
65b31aa18627e4cca3199742
Ofir Arviv
admin_assigned
2024-01-26T09:53:39.090Z
632ae2606cb20ba0ae8007d8
/avatars/023eb4536e9bfcebbcc42eaea7167596.svg
Ofir Arviv
user
OfirArviv
65b31aa18627e4cca3199743
Matan Orbach
claimed_verified
2024-01-29T08:26:16.417Z
65b60c17729ea1912ef74718
/avatars/49880599a977a45ce03bc5112edf8a1a.svg
matan orbach
user
matanor
65b31aa18627e4cca3199744
Shachar Don-Yehyia
claimed_verified
2024-01-26T10:16:09.060Z
652e3800f7431c19a99c91e9
/avatars/df1c1d66e52b06af4dbe5791c4819782.svg
Shachar Don-Yehiya
user
shachar-don
65b31aa18627e4cca3199745
Dafna Sheinwald
admin_assigned
2024-01-26T09:53:57.470Z
654a153ef39b362cffa91eac
/avatars/6e8940c6c8e13e78a31cecf140b185ab.svg
Dafna Sheinwald
user
dafnashein
65b31aa18627e4cca3199746
Ariel Gera
admin_assigned
2024-01-26T09:54:04.079Z
6415ebd2107962562e9a0712
/avatars/dfd2e6d42c6110bb64b6a73c96eeb3f3.svg
Ariel Gera
user
arielgera
65b31aa18627e4cca3199747
Leshem Choshen
admin_assigned
2024-01-26T09:54:09.866Z
61bf40824b4300d0fb0acf59
https://cdn-avatars.huggingface.co/v1/production/uploads/1644224872623-61bf40824b4300d0fb0acf59.jpeg
Leshem Choshen
user
borgr
65b31aa18627e4cca3199748
Michal Shmueli-Scheuer
65b31aa18627e4cca3199749
Yoav Katz
Unitxt: Flexible, Shareable and Reusable Data Preparation and Evaluation
  for Generative AI
In the dynamic landscape of generative NLP, traditional text processing
pipelines limit research flexibility and reproducibility, as they are tailored
to specific dataset, task, and model combinations. The escalating complexity,
involving system prompts, model-specific formats, instructions, and more, calls
for a shift to a structured, modular, and customizable solution. Addressing
this need, we present Unitxt, an innovative library for customizable textual
data preparation and evaluation tailored to generative language models. Unitxt
natively integrates with common libraries like HuggingFace and LM-eval-harness
and deconstructs processing flows into modular components, enabling easy
customization and sharing between practitioners. These components encompass
model-specific formats, task prompts, and many other comprehensive dataset
processing definitions. The Unitxt-Catalog centralizes these components,
fostering collaboration and exploration in modern textual data workflows.
Beyond being a tool, Unitxt is a community-driven platform, empowering users to
build, share, and advance their pipelines collaboratively. Join the Unitxt
community at https://github.com/IBM/unitxt!
Unitxt is a modular and customizable library for preparing and evaluating textual data for generative language models, promoting collaboration and flexibility in the field.
generative NLP HuggingFace LM-eval-harness model-specific formats task prompts dataset processing Unitxt-Catalog