Thai Language Models MLX 8bit
Collection
A list of Large Language Models which is support Thai language and converted into MLX quantize with 8bit
•
16 items
•
Updated
tawankri/llama3.2-typhoon2-t1-3b-research-preview-8bit
The Model tawankri/llama3.2-typhoon2-t1-3b-research-preview-8bit was converted to MLX format from scb10x/llama3.2-typhoon2-t1-3b-research-preview using mlx-lm version 0.21.5.
Use with mlx
pip install mlx-lm
from mlx_lm import load, generate
model, tokenizer = load("tawankri/llama3.2-typhoon2-t1-3b-research-preview-8bit")
prompt="hello"
if hasattr(tokenizer, "apply_chat_template") and tokenizer.chat_template is not None:
messages = [{"role": "user", "content": prompt}]
prompt = tokenizer.apply_chat_template(
messages, tokenize=False, add_generation_prompt=True
)
response = generate(model, tokenizer, prompt=prompt, verbose=True)
- Downloads last month
- 3
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Model tree for tawankri/llama3.2-typhoon2-t1-3b-research-preview-mlx-8bit
Base model
scb10x/llama3.2-typhoon2-3b-instruct