Granite 3.2 Models (GGUF)
Collection
GGUF-formatted versions of IBM Granite 3.2 models. Licensed under the Apache 2.0 license.
•
3 items
•
Updated
•
1
YAML Metadata
Warning:
empty or missing yaml metadata in repo card
(https://huggingface.co/docs/hub/model-cards#model-card-metadata)
This repository contains models that have been converted to the GGUF format with various quantizations from an IBM Granite base model.
Please reference the base model's model card here: https://huggingface.co/ibm-granite/granite-3.2-8b-instruct
- Downloads last month
- 780
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.