metadata
base_model: unsloth/llama-3.2-3b-instruct-unsloth-bnb-4bit
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft
license: apache-2.0
language:
- en
Description
A model tailored to be conversational and execute function calls with LocalAI. This model is based on llama3.2 (3B).
- llama3.2-1b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-1b-v0.4
- llama3.2-3b version: https://huggingface.co/mudler/LocalAI-functioncall-llama3.2-3b-v0.5
- phi-4 version: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3
- qwen2.5 (7b) version: https://huggingface.co/mudler/LocalAI-functioncall-qwen2.5-7b-v0.5
How to run
With LocalAI:
local-ai run LocalAI-functioncall-llama3.2-3b-v0.5
Updates
This is the 5th iteration based on llama3.2 3B