darija_gemma_3n_tokenizer / tokenizer.json
mohamed-stifi's picture
Add Darija-adapted Gemma tokenizer from dataset mohamed-stifi/darija-combined-dataset
1293cfa verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
805156362cdfab4f2a503172ecfa62e3ef61e7433d92a07faf004d5661244c35
Pointer size:
133 Bytes
·
Size of remote file:
38.3 MB
·
Xet backed hash:
b5ad9486d226635192df4290a5ca16942e0ec90f77eb74ce65ff76334715724f

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.