Fix HFValidationError caused by wrong repo_id

#15
by albertvillanova HF staff - opened
Demo leaderboard with an integrated backend org
edited 15 days ago

Fix HFValidationError caused by wrong repo_id:

huggingface_hub.errors.HFValidationError: Repo id must be in the form 'repo_name' or 'namespace/repo_name'

This is caused when trying to push the details dataset:

  • to repo_id: OWNER/results/details_MODEL_ID
  • instead of repo_id: OWNER/details_MODEL_ID

This is fixed by passing OWNER (instead of RESULTS_REPO) to hub_results_org parameter.

CC: @clefourrier

Demo leaderboard with an integrated backend org

Hm this feels like something we need to fix ligtheval side rather than here

Demo leaderboard with an integrated backend org

@clefourrier lighteval expects an organization name, but here we pass a repo id instead.

clefourrier changed pull request status to merged

Sign up or log in to comment