Hugging Face's logo

LumiOpen
/
Poro-34B-chat-GGUF

GGUF
Finnish
English
Inference Endpoints
conversational
Model card Files Community

Original model: Poro-34B-chat

Description

GGUF-format model files quantized using llama.cpp

We have Q4_K_M and Q5_K_M quantized models available.

Downloads last month
90
GGUF
Model size
35.1B params
Architecture
bloom

4-bit

5-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Collection including LumiOpen/Poro-34B-chat-GGUF