Models

israel/AmhWordPieceTokenizer

Updated Oct 17, 2022

TWO/sutra-mlt256-v2

Updated May 24, 2024 • 11

amirakhlaghiqqq/persian-llama2

Updated Nov 2, 2024 • 3

tamang0000/assamese-tokenizer-50k

Updated Jul 7, 2024 • 1

TencentARC/IBQ-Tokenizer-1024

Updated Dec 30, 2024 • 12

TencentARC/IBQ-Tokenizer-8192

Updated Dec 30, 2024 • 2

TencentARC/IBQ-Tokenizer-16384

Updated Dec 30, 2024 • 18 • 1

TencentARC/IBQ-Tokenizer-262144

Updated Dec 30, 2024 • 14 • 1

TencentARC/IBQ-AR-B

Updated Dec 30, 2024 • 2 • 1

TencentARC/IBQ-AR-L

Updated Dec 30, 2024 • 5 • 1

TencentARC/IBQ-AR-XL

Updated Dec 30, 2024 • 5

TencentARC/IBQ-AR-XXL

Updated Dec 30, 2024 • 10 • 1

TencentARC/Open-MAGVIT2-Tokenizer-128-resolution

Updated Jan 2 • 28 • 1

TencentARC/Open-MAGVIT2-Tokenizer-256-resolution

Updated Jan 2 • 8 • 1

TencentARC/Open-MAGVIT2-AR-B-256-resolution

Updated Jan 2 • 6

TencentARC/Open-MAGVIT2-AR-L-256-resolution

Updated Jan 2 • 3

TencentARC/Open-MAGVIT2-AR-XL-256-resolution

Updated Jan 2 • 6 • 1

TencentARC/TokLIP

Updated Jun 5 • 32 • 8