masato12
/

bert-base-japanese-v3-jsts-with-tokenizer

Text Classification

Model card Files Files and versions Community

bert-base-japanese-v3-jsts-with-tokenizer

Ctrl+K

Ctrl+K

2 contributors

History: 2 commits

masato12's picture

feat: generate tokenizer.json

f9ef2f7 12 months ago

.gitattributes

1.48 kB

Duplicate from llm-book/bert-base-japanese-v3-jsts 12 months ago
README.md

1.71 kB

Duplicate from llm-book/bert-base-japanese-v3-jsts 12 months ago
config.json

796 Bytes

Duplicate from llm-book/bert-base-japanese-v3-jsts 12 months ago
generate_tokenizer.py

848 Bytes

feat: generate tokenizer.json 12 months ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.LongStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.FloatStorage"
What is a pickle import?
445 MB
LFS

Duplicate from llm-book/bert-base-japanese-v3-jsts 12 months ago
special_tokens_map.json

125 Bytes

Duplicate from llm-book/bert-base-japanese-v3-jsts 12 months ago
tokenizer.json

746 kB

feat: generate tokenizer.json 12 months ago
tokenizer_config.json

606 Bytes

Duplicate from llm-book/bert-base-japanese-v3-jsts 12 months ago
vocab.txt

231 kB

Duplicate from llm-book/bert-base-japanese-v3-jsts 12 months ago