🚀 Welcome to the GGUF Model Community!

This is a central hub for users to discover, access, and contribute to a vast collection of quantized models in the GGUF format. We're building a vibrant space for exchanging, searching for, and sharing models that cater to diverse needs and requirements within the GGUF ecosystem.

✨ Why GGUF?

GGUF is a modern file format for storing models optimized for efficient inference, particularly on consumer-grade hardware. This makes it easier for researchers, developers, and hobbyists to experiment with and deploy large language models.

🤝 How to Join the Community

We're excited to welcome new contributors! To join our community, you should have at least 80 quantized models in GGUF format ready to share. This ensures active participation and contribution to the collective knowledge base.

Once you meet this requirement, please reach out to us [insert method of contacting, e.g., via the Discussions tab, a specific user, etc.]. We'll be happy to discuss your application and welcome you aboard!

🎁 What We Offer

• A Comprehensive Collection of GGUF Models: Find models tailored for various tasks, sizes, and architectures.
• A Platform for Sharing and Discovery: Contribute your models and explore the contributions of others.
• A Thriving Community: Connect with like-minded individuals passionate about GGUF and its potential.
• Organized Collections for Easy Navigation: Browse models categorized by architecture, application, and more.
• Increased Visibility for Your Models: Sharing your models within the community increases their discoverability and potential impact.

➕ Adding Models to Category-Specific Collections (Model Families)

Community members have the privilege of contributing models from their personal accounts to the community's carefully curated, category-specific collections. These collections focus on particular model architectures or families.

A model can be included in a category-specific collection if it meets one of the following criteria:

1. Exact Match: The model is the specified foundational model itself (e.g., Llama-3-8B-GGUF).
2. Based On: The model is a fine-tuned or adapted version of the specified foundational model (e.g., Llama-3-Tulu-3-8B-GGUF).

Examples of Category-Specific Collections:

• 🦙 Llama: Dedicated to Llama family of models.
• ✨ Gemma: Dedicated to Gemma family of models.
• 🦉 Mistral: Dedicated to Mistral family of models.

➕ Creating General Collections (Thematic Groupings)

In addition to contributing to existing category-specific collections, members can create general collections to group different models under a common theme or application.

Examples of General Collections:

• 💬 Chat: Models optimized for conversational AI and chatbot applications.
• 🛡️ Guard: Models designed for identifying and mitigating harmful or unsafe content, promoting responsible AI.
• 🧠 Reasoning: Models that excel at logical reasoning, problem-solving, and knowledge application.

Collection Naming Convention:

Each collection must adhere to the following naming convention: [Emoji][Name]. For example: 💬Chat.

• Choose an emoji that visually represents the collection's theme.
• Use a clear and descriptive name for the collection.

💡 Inspiration & Examples

Explore our existing collections for inspiration and guidance on how to organize and present your models: Collections Page

This page provides a wealth of examples and showcases the different ways you can contribute to the community.

🚀 Let's Build Together!

We eagerly anticipate your participation and contributions! Together, we can foster a vibrant and collaborative ecosystem for GGUF models. Feel free to reach out with any questions.

Thank you for being a part of the GGUF Model Community!