Hugging Face's logo

01-ai
/
Yi-1.5-34B-Chat

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Model card Files Community
16

Adding a fast tokenizer

#10
by Narsil HF Staff - opened
base: refs/heads/main
←
from: refs/pr/10
Discussion Files changed
+174153
-0
Adding a fast tokenizere401a5d6
Narsil

No thorough check was made yet.

YShow

hi, thank you for your contribution. We have supported the fast tokenizer

Narsil

Thanks !

Cannot merge
This branch has merge conflicts in the following files:
  • tokenizer.json
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment