Spaces:

open-llm-leaderboard
/

open_llm_leaderboard

Running on CPU Upgrade

App Files Files Community

1012

Is there an issue with adding bos in the new evaluation?

#852

by lingyun1 - opened Jul 19

Discussion

lingyun1

Jul 19

I set add_bos_token to True in the tokenizer_config.json, but it didn't take effect during the evaluation. Could it be that the new evaluation hasn't noticed this issue?

alozowski

Open LLM Leaderboard org Jul 19

Hi @lingyun1 ,

Could you please provide me the requests file for the model? I'll be able to check what model revision was set there

clefourrier

Open LLM Leaderboard org Jul 26

Closing for inactivity

clefourrier changed discussion status to closed Jul 26

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment