[tokenizer] AlternateTokenizer - a minpeter Collection

minpeter 's Collections

[Dataset] unified standard function calling

[Models] Small size high performance BFCL instruction

[Model] BFCL Top Rank Model

[Model] Latest Llama base model

[Model] FMO INT8

[tokenizer] AlternateTokenizer

[Merged] Experimental merge model

[QLoRA] Llama 3.2 1B

[Dataset] Function Calling

[tokenizer] AlternateTokenizer

updated 20 days ago

A series of modified tokenizers for tuning chatml inspired by teknium and hermes.

minpeter/Llama-3.x-AlternateTokenizer

Updated Feb 11 • 1

Note An alternative tokenizer for the final form of the Llama 3.x series.
teknium/Llama-3.1-AlternateTokenizer

Text Generation • Updated Jul 27, 2024 • 120 • 4
minpeter/Llama-3.2-1B-AlternateTokenizer-chatml

Text Generation • Updated Feb 9 • 35
minpeter/Llama-3.2-1B-AlternateTokenizer-tool-chatml

Text Generation • Updated Feb 10 • 60
philschmid/gemma-tokenizer-chatml

Updated Feb 29, 2024 • 30