gguf endpoints_compatible region:us conversational
---
{}
---
Quantization made by Richard Erkhov.

[Github](https://github.com/RichardErkhov)

[Discord](https://discord.gg/pvy7H8DZMG)

[Request more models](https://github.com/RichardErkhov/quant_request)


gemma-ko-7b-it-v0.41 - GGUF
- Model creator: https://huggingface.co/lemon-mint/
- Original model: https://huggingface.co/lemon-mint/gemma-ko-7b-it-v0.41/


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [gemma-ko-7b-it-v0.41.Q2_K.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q2_K.gguf) | Q2_K | 3.24GB |
| [gemma-ko-7b-it-v0.41.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.IQ3_XS.gguf) | IQ3_XS | 3.54GB |
| [gemma-ko-7b-it-v0.41.IQ3_S.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.IQ3_S.gguf) | IQ3_S | 3.71GB |
| [gemma-ko-7b-it-v0.41.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q3_K_S.gguf) | Q3_K_S | 3.71GB |
| [gemma-ko-7b-it-v0.41.IQ3_M.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.IQ3_M.gguf) | IQ3_M | 3.82GB |
| [gemma-ko-7b-it-v0.41.Q3_K.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q3_K.gguf) | Q3_K | 4.07GB |
| [gemma-ko-7b-it-v0.41.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q3_K_M.gguf) | Q3_K_M | 4.07GB |
| [gemma-ko-7b-it-v0.41.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q3_K_L.gguf) | Q3_K_L | 4.39GB |
| [gemma-ko-7b-it-v0.41.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.IQ4_XS.gguf) | IQ4_XS | 4.48GB |
| [gemma-ko-7b-it-v0.41.Q4_0.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q4_0.gguf) | Q4_0 | 4.67GB |
| [gemma-ko-7b-it-v0.41.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.IQ4_NL.gguf) | IQ4_NL | 4.69GB |
| [gemma-ko-7b-it-v0.41.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q4_K_S.gguf) | Q4_K_S | 4.7GB |
| [gemma-ko-7b-it-v0.41.Q4_K.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q4_K.gguf) | Q4_K | 4.96GB |
| [gemma-ko-7b-it-v0.41.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q4_K_M.gguf) | Q4_K_M | 4.96GB |
| [gemma-ko-7b-it-v0.41.Q4_1.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q4_1.gguf) | Q4_1 | 5.12GB |
| [gemma-ko-7b-it-v0.41.Q5_0.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q5_0.gguf) | Q5_0 | 5.57GB |
| [gemma-ko-7b-it-v0.41.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q5_K_S.gguf) | Q5_K_S | 5.57GB |
| [gemma-ko-7b-it-v0.41.Q5_K.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q5_K.gguf) | Q5_K | 5.72GB |
| [gemma-ko-7b-it-v0.41.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q5_K_M.gguf) | Q5_K_M | 5.72GB |
| [gemma-ko-7b-it-v0.41.Q5_1.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q5_1.gguf) | Q5_1 | 6.02GB |
| [gemma-ko-7b-it-v0.41.Q6_K.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q6_K.gguf) | Q6_K | 6.53GB |
| [gemma-ko-7b-it-v0.41.Q8_0.gguf](https://huggingface.co/RichardErkhov/lemon-mint_-_gemma-ko-7b-it-v0.41-gguf/blob/main/gemma-ko-7b-it-v0.41.Q8_0.gguf) | Q8_0 | 8.45GB |




Original model description:
---
library_name: transformers
license: other
license_name: gemma-terms-of-use
license_link: https://ai.google.dev/gemma/terms
language:
- ko
- en
tags:
- korean
- gemma
- pytorch
pipeline_tag: text-generation
---

![image/png](https://cdn-uploads.huggingface.co/production/uploads/6332f1a52b866de639ee0279/jYH2isQRcP7LQfydwbOj_.png)

# Gemma Ko 7B Instruct v0.41

- Eval Loss: `1.21711`
- lr: `1e-5`
- optimizer: adamw
- lr_scheduler_type: cosine

## Model Details

### Model Description

The Gemma 7B Ko Instruct v0.41 model is designed for generating human-like text in the Korean language.
It can be used for a variety of natural language processing tasks, such as language translation, text summarization, question answering, and conversation generation.
This model is particularly well-suited for applications that require high-quality, coherent, and contextually relevant Korean text generation.

- **Developed by:** `lemon-mint`
- **Model type:** Gemma
- **Language(s) (NLP):** Korean, English
- **License:** [gemma-terms-of-use](https://ai.google.dev/gemma/terms)
- **Finetuned from model:** [google/gemma-7b-it](https://huggingface.co/google/gemma-7b-it)

# Limitations and Ethical Considerations

As Gemma Ko 7B has been trained on extensive web data, biases present in the training data may be reflected in the model. Additionally, there is a possibility that it may generate sentences containing errors or incorrect information. Therefore, rather than blindly trusting the model's output, it is necessary to refer to it with caution.


