|
|
--- |
|
|
pipeline_tag: text-generation |
|
|
inference: false |
|
|
license: apache-2.0 |
|
|
library_name: transformers |
|
|
tags: |
|
|
- language |
|
|
- granite-3.2 |
|
|
- gguf |
|
|
base_model: |
|
|
- ibm-granite/granite-3.2-2b-instruct |
|
|
--- |
|
|
|
|
|
> [!NOTE] |
|
|
> This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model. |
|
|
> |
|
|
> Please reference the base model's full model card here: |
|
|
> https://huggingface.co/ibm-granite/granite-3.2-2b-instruct |
|
|
|
|
|
# Granite-3.2-2B-Instruct-GGUF |
|
|
|
|
|
**Model Summary:** |
|
|
Granite-3.2-2B-Instruct is an 2-billion-parameter, long-context AI model fine-tuned for thinking capabilities. Built on top of [Granite-3.1-2B-Instruct](https://huggingface.co/ibm-granite/granite-3.1-2b-instruct), it has been trained using a mix of permissively licensed open-source datasets and internally generated synthetic data designed for reasoning tasks. The model allows controllability of its thinking capability, ensuring it is applied only when required. |
|
|
|
|
|
- **Developers:** Granite Team, IBM |
|
|
- **Website**: [Granite Docs](https://www.ibm.com/granite/docs/) |
|
|
- **Release Date**: February 26th, 2025 |
|
|
- **License:** [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0) |
|
|
|
|
|
**Supported Languages:** |
|
|
English, German, Spanish, French, Japanese, Portuguese, Arabic, Czech, Italian, Korean, Dutch, and Chinese. However, users may finetune this Granite model for languages beyond these 12 languages. |
|
|
|
|
|
**Intended Use:** |
|
|
This model is designed to handle general instruction-following tasks and can be integrated into AI assistants across various domains, including business applications. |
|
|
|
|
|
**Capabilities** |
|
|
* **Thinking** |
|
|
* Summarization |
|
|
* Text classification |
|
|
* Text extraction |
|
|
* Question-answering |
|
|
* Retrieval Augmented Generation (RAG) |
|
|
* Code related tasks |
|
|
* Function-calling tasks |
|
|
* Multilingual dialog use cases |
|
|
* Long-context tasks including long document/meeting summarization, long document QA, etc. |
|
|
|
