Spaces:

Duplicated from TWO/sutra-tokenizer-comparison

salmankhanpm
/

Telugu_Vocab_Evaluation

Sleeping

App Files Files Community

Telugu_Vocab_Evaluation / app.py

Commit History

include ollama3

7e840a4
verified

salmankhanpm commited on 10 days ago

include custom telugu tokenizer expansion of gemma3 tokenizer

0ee82fd
verified

salmankhanpm commited on Oct 6

Include Gemma 3 270 M

07d05e5
verified

salmankhanpm commited on Aug 16

use tiktoken for gpt4o

4c72ea7
verified

salmankhanpm commited on Aug 6

only use tiktoken for gpt4o

937bfb7
verified

salmankhanpm commited on Aug 6

include gpt-oss-20b

06d3ff1
verified

salmankhanpm commited on Aug 6

Upload app.py

929a20d
verified

salmankhanpm commited on Jul 26

Rename app.py to _app.py

5ccf71d
verified

salmankhanpm commited on Jul 26

Include new slm for Comparison

6d9092b
verified

salmankhanpm commited on Jul 26

include qwen3

bfa227b
verified

salmankhanpm commited on Jul 24

Update app.py

b681c49
verified

salmankhanpm commited on Jul 19

updating list of models in comparison

8374dfe

Michael Sapienza commited on Oct 16, 2024

minor

e27441b

Michael Sapienza commited on Jul 23, 2024

Update app.py

37174c1
verified

mikesapi commited on Jul 23, 2024

Update app.py

3cbcc1b
verified

mikesapi commited on Jun 5, 2024

adding more examples

5be3066

Michael Sapienza commited on May 30, 2024

Update app.py

1ea8367
verified

mikesapi commited on May 27, 2024

Update app.py

404658d
verified

mikesapi commited on May 24, 2024

cleaning up

c2e2189

Michael Sapienza commited on May 24, 2024

adding sutra tokenizer inspector app

145530a

Michael Sapienza commited on May 24, 2024