rkstgr/typer-1.5b-instruct-concise-gguf

This repository contains GGUF quantized versions of rkstgr/typer-1.5b-instruct-concise.

Usage with Ollama

ollama run hf.co/rkstgr/typer-1.5b-instruct-concise-gguf

Usage with llama.cpp

# Download the model
wget https://huggingface.co/rkstgr/typer-1.5b-instruct-concise-gguf/resolve/main/{model_file}.gguf

# Run with llama.cpp
./llama-cli -m {model_file}.gguf -p "Your prompt here"

Model Details

• Base Model: rkstgr/typer-1.5b-instruct-concise
• Training: Fine-tuned using Unsloth