uaritm
/

ukrt5-base

text2text-generation

text-generation-inference

Model card Files Files and versions Community

ukrt5-base / tokenizer_config.json

uaritm's picture

Upload tokenizer_config.json

e4b3f43 about 3 years ago

190 Bytes

	{
	"additional_special_tokens": null,
	"eos_token": "</s>",
	"extra_ids": 0,
	"pad_token": "<pad>",
	"sp_model_kwargs": {},
	"tokenizer_class": "T5Tokenizer",
	"unk_token": "<unk>"
	}