Hugging Face's logo

DevQuasar
/
ibm-granite.granite-3.1-8b-instruct-GGUF

Text Generation
GGUF
Inference Endpoints
conversational
Model card Files Community

I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.

If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar

Also feel free to visit my website https://devquasar.com/

Downloads last month
154
GGUF
Model size
8.17B params
Architecture
granite

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.

Model tree for DevQuasar/ibm-granite.granite-3.1-8b-instruct-GGUF

Base model

ibm-granite/granite-3.1-8b-base
Finetuned
ibm-granite/granite-3.1-8b-instruct
Quantized
(23)
this model

Collection including DevQuasar/ibm-granite.granite-3.1-8b-instruct-GGUF