Qwen
/

tokenizer.model tokenizer.json

#3
by karbon2 - opened

Hi, I’m trying to use Qwen-1.8B-Chat in an offline environment (embedded system). However, tokenizer.model or a compatible tokenizer.json is missing. Can you provide a tokenizer file that works standalone for this model?

Sign up or log in to comment