Hugging Face's logo

blester125
/
supervocab-tokenmonster-englishcode-32000-consistent-v1

Model card Files Community
blester125 commited on
Commit
ffdfc0b
·
verified ·
1 Parent(s): 547b1d5

Upload folder using huggingface_hub

Browse files
Files changed (4) hide show
  1. model.pth +1 -1
  2. tokenmonster--englishcode-32000-consistent-v1.yaml +4 -0
  3. tokenmonster--englishcode-32000-consistent-v1_info.json +1 -1
  4. tokenmonster--englishcode-32000-consistent-v1_super_mapping.json +0 -0
model.pth CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0779fd01bbca25c810014a578fd8a8c5fab258cdcacf3ee0b014031462026ff7
3
  size 5662788450
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a3461b2f3d9bd91b761901db20a46bca617d0b9cdb9d9ad6aab44bc2bca58a2d
3
  size 5662788450
tokenmonster--englishcode-32000-consistent-v1.yaml ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ data:
2
+ tokenizer:
3
+ name: tokenmonster
4
+ path: englishcode-32000-consistent-v1
tokenmonster--englishcode-32000-consistent-v1_info.json CHANGED
@@ -1 +1 @@
1
- {"backend": "tokenmonster", "name": "englishcode-32000-consistent-v1"}
 
1
+ {"data": {"tokenizer": {"name": "tokenmonster", "path": "englishcode-32000-consistent-v1"}}}
tokenmonster--englishcode-32000-consistent-v1_super_mapping.json CHANGED
The diff for this file is too large to render. See raw diff