Hugging Face's logo

balnazzar
/
Frankie-tiny

Text Generation
Transformers
Safetensors
mistral
Merge
mergekit
lazymergekit
Locutusque/TinyMistral-248M-v2-Instruct
text-generation-inference
Inference Endpoints
Model card Files Community

Frankie-tiny

Frankie-tiny is a (franken)merge of the following models using mergekit:

🧩 Configuration 

slices:
  - sources:
    - model: Locutusque/TinyMistral-248M-v2-Instruct
      layer_range: [0, 12]
  - sources:
    - model: Locutusque/TinyMistral-248M-v2-Instruct
      layer_range: [8, 12]
merge_method: passthrough
dtype: float16
Downloads last month
1
Safetensors
Model size
309M params
Tensor type
FP16
·
Inference Providers NEW
Text Generation
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.