gguf endpoints_compatible region:us conversational
---
{}
---
Quantization made by Richard Erkhov.

[Github](https://github.com/RichardErkhov)

[Discord](https://discord.gg/pvy7H8DZMG)

[Request more models](https://github.com/RichardErkhov/quant_request)


llama3-8b-it-translation-tech-en-ko-1sent - GGUF
- Model creator: https://huggingface.co/nayohan/
- Original model: https://huggingface.co/nayohan/llama3-8b-it-translation-tech-en-ko-1sent/


| Name | Quant method | Size |
| ---- | ---- | ---- |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q2_K.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q2_K.gguf) | Q2_K | 2.96GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.IQ3_XS.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.IQ3_XS.gguf) | IQ3_XS | 3.28GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.IQ3_S.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.IQ3_S.gguf) | IQ3_S | 3.43GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q3_K_S.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q3_K_S.gguf) | Q3_K_S | 3.41GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.IQ3_M.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.IQ3_M.gguf) | IQ3_M | 3.52GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q3_K.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q3_K.gguf) | Q3_K | 3.74GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q3_K_M.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q3_K_M.gguf) | Q3_K_M | 3.74GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q3_K_L.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q3_K_L.gguf) | Q3_K_L | 4.03GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.IQ4_XS.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.IQ4_XS.gguf) | IQ4_XS | 4.18GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q4_0.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q4_0.gguf) | Q4_0 | 4.34GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.IQ4_NL.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.IQ4_NL.gguf) | IQ4_NL | 4.38GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q4_K_S.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q4_K_S.gguf) | Q4_K_S | 4.37GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q4_K.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q4_K.gguf) | Q4_K | 4.58GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q4_K_M.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q4_K_M.gguf) | Q4_K_M | 4.58GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q4_1.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q4_1.gguf) | Q4_1 | 4.78GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q5_0.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q5_0.gguf) | Q5_0 | 5.21GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q5_K_S.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q5_K_S.gguf) | Q5_K_S | 5.21GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q5_K.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q5_K.gguf) | Q5_K | 5.34GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q5_K_M.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q5_K_M.gguf) | Q5_K_M | 5.34GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q5_1.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q5_1.gguf) | Q5_1 | 5.65GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q6_K.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q6_K.gguf) | Q6_K | 6.14GB |
| [llama3-8b-it-translation-tech-en-ko-1sent.Q8_0.gguf](https://huggingface.co/RichardErkhov/nayohan_-_llama3-8b-it-translation-tech-en-ko-1sent-gguf/blob/main/llama3-8b-it-translation-tech-en-ko-1sent.Q8_0.gguf) | Q8_0 | 7.95GB |




Original model description:
---
language:
- en
- ko
license: llama3
library_name: transformers
tags:
- tech
- translation
- enko
- ko
base_model:
- meta-llama/Meta-Llama-3-8B-Instruct
datasets:
- nayohan/026_tech_translation
pipeline_tag: text-generation
---

# **Introduction**
The model was trained to translate a single sentence from English to Korean with a 1.3M dataset in the technology science domain.
Dataset: [nayohan/tech_science_translation](https://huggingface.co/datasets/nayohan/tech_science_translation)

### **Loading the Model**

Use the following Python code to load the model:

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "nayohan/llama3-8b-translation-en-ko-1sent"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(
  model_name,
  device_map="auto",
  torch_dtype=torch.bfloat16
)
```

### **Generating Text**
To generate text, use the following Python code: No support for other languages or reverse direction and styles at this time.
```python
source="en"
target="ko"
style="written"
SYSTEM_PROMPT=f"Acts as a translator. Translate {source} sentences into {target} sentences in {style} style."
s = "The aerospace industry is a flower in the field of technology and science."
conversation = [{'role': 'system', 'content': SYSTEM_PROMPT},
                {'role': 'user', 'content': s}]

inputs = tokenizer.apply_chat_template(
  conversation,
  tokenize=True,
  add_generation_prompt=True,
  return_tensors='pt'
).to("cuda")

outputs = model.generate(inputs, max_new_tokens=256)
print(tokenizer.decode(outputs[0][len(inputs[0]):]))
```
```
# Result
# INPUT: <|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nActs as a translator. Translate en sentences into ko sentences in written style.<|eot_id|><|start_header_id|>user<|end_header_id|>\n\nThe aerospace industry is a flower in the field of technology and science.<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n
# OUTPUT: 항공 우주 산업은 기술과 과학 분야의 꽃이라고 할 수 있다.

## [Warning!] In multiple sentences, there is a tendency to output in a single sentence.
# INPUT: <|begin_of_text|><|start_header_id|>system<|end_header_id|>\n\nActs as a translator. Translate ko sentences into en sentences in written style.<|eot_id|><|start_header_id|>user<|end_header_id|>\n\n
Technical and basic sciences are very important in terms of research. It has a significant impact on the industrial development of a country. Government policies control the research budget.<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n
# OUTPUT: 연구 측면에서 기술 및 기초 과학은 국가의 산업 발전에 큰 영향을 미치며 정부 정책은 연구 예산을 통제한다.
```

### **Citation**
```bibtex
@article{llama3modelcard,
        title={Llama 3 Model Card},
        author={AI@Meta},
        year={2024},
        url={https://github.com/meta-llama/llama3/blob/main/MODEL_CARD.md}
}
```
Our trainig code can be found here: [TBD]

