teleboas
/

alpaca_mistral-7b-v0.2-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Model description

Developed by: teleboas
License: apache-2.0
Finetuned from model : unsloth/mistral-7b-v0.2-bnb-4bit

This is the GGUF version of the model, made for the llama.cpp inference engine.

If you are looking for the transformers/fp16 model, it is available here: https://huggingface.co/teleboas/alpaca_mistral-7b-v0.2

Downloads last month: 7

GGUF

Model size

7.24B params

Architecture

llama

8-bit

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Model tree for teleboas/alpaca_mistral-7b-v0.2-GGUF

Base model

unsloth/mistral-7b-v0.2-bnb-4bit

Quantized

(26)

this model

Dataset used to train teleboas/alpaca_mistral-7b-v0.2-GGUF