ardauzunoglu
/

mod_tokenizer

Model card Files Files and versions

mod_tokenizer / token_mapping.txt

ardauzunoglu's picture

Upload folder using huggingface_hub

b762d2c verified 2 months ago

history blame contribute delete

109 Bytes

	Token ID
	<pad> 0
	<s> 1
	</s> 2
	<unk> 3
	0 4
	1 5
	2 6
	3 7
	4 8
	5 9
	6 10
	7 11
	8 12
	9 13
	EQUALS 14
	MOD_10 15
	END 16