Hugging Face's logo

Spaces:
Jhayase
/
superbpe-tokenizer-playground
Running

App Files Community
superbpe-tokenizer-playground / assets

Commit History

Update tokenizers
cafb8f5

Jhayase commited on

Updates for SuperBPE website embed
98c69b7

Jhayase commited on

Prettify
65ddd4a

Jhayase commited on

Update title
124de93

Jhayase commited on

Add reference tokenizers
b7055d5

Jhayase commited on

Set default to SuperBPE t180k
ee8ca32

Jhayase commited on

Add SuperBPE tokenizers
a8729e9

Jhayase commited on

Upload 4 files
2cb5f4f
verified

Xenova HF Staff commited on

Delete assets
189140a
verified

Xenova HF Staff commited on

Upload 4 files
77c778e
verified

Xenova HF Staff commited on

Delete assets
8ace142
verified

Xenova HF Staff commited on

Upload 4 files
8331b04
verified

Xenova HF Staff commited on

Upload 4 files
fd3231d
verified

Xenova HF Staff commited on

Upload 4 files
69a87d9
verified

Xenova HF Staff commited on

Upload 4 files
f7a204a
verified

Xenova HF Staff commited on

Upload 4 files
324909a
verified

Xenova HF Staff commited on

Upload 4 files
483fee5
verified

Xenova HF Staff commited on

Add Gemma (#4)
dd1d9dd
verified

Xenova HF Staff commited on

Upload 3 files
62eec78
verified

Xenova HF Staff commited on

Delete assets
54f1f86
verified

Xenova HF Staff commited on

Update transformers.js version
7ab5247
verified

Xenova HF Staff commited on

Upload 5 files
8531cdc

Xenova HF Staff commited on

Upload 5 files
b815f27

Xenova HF Staff commited on

Upload 5 files
4318466

Xenova HF Staff commited on

Upload 5 files
b603052

Xenova HF Staff commited on

Upload 5 files
71afaf8

Xenova HF Staff commited on