brittlewis12/Qwen1.5-0.5B-OpenHermes-2.5-GGUF

Qwen1.5-0.5B-OpenHermes-2.5 GGUF

Original model: Qwen1.5-0.5B-OpenHermes-2.5 Model creator: minghaowu

This repo contains GGUF format model files for minghaowu’s Qwen1.5-0.5B-OpenHermes-2.5.

This model is a fine-tuned version of Qwen/Qwen1.5-0.5B on the teknium/OpenHermes-2.5 dataset.

What is GGUF?

GGUF is a file format for representing AI models. It is the third version of the format, introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp. Converted using llama.cpp b2116 (f026f81)

Prompt template: ChatML

  <|im_start|>system
  {{system_message}}<|im_end|>
  <|im_start|>user
  {{prompt}}<|im_end|>
  <|im_start|>assistant

---

Download & run with cnvrs on iPhone, iPad, and Mac!

cnvrs is the best app for private, local AI on your device:

• create & save Characters with custom system prompts & temperature settings
• download and experiment with any GGUF model you can find on HuggingFace!
• make it your own with custom Theme colors
• powered by Metal ⚡️ & Llama.cpp, with haptics during response streaming!
• try it out yourself today, on Testflight!
• follow cnvrs on twitter to stay up to date

---