safetensors autotrain text-generation conversational license:other region:us
---
datasets:
- omar07ibrahim/660K_AZERBAIJAN-ENGLISH_PARALLEL
- omar07ibrahim/datasetaz
- omar07ibrahim/testlimOcrCA
- omar07ibrahim/orca_firstpart_AZ
- omar07ibrahim/alpaca-cleaned_AZERBAIJANI
- omar07ibrahim/azcon
- omar07ibrahim/ultrafeedback_binarized-BIZIM
- omar07ibrahim/orca
- omar07ibrahim/Alpaca_Stanford_Azerbaijan
language:
- az
license: other
pipeline_tag: text-generation
tags:
- text-generation
- dpo
- llama
- AzeriLLM
thumbnail: https://i.ibb.co/whF2f6Pk/793y-M4-XVrh-U.jpg
---




<p align="center">
  <img src="https://i.ibb.co/5hX2bGqV/Frame-32.png" width="200" style="border-radius: 50%; box-shadow: 0 0 20px rgba(0,0,0,0.2);">
</p>

<h1 align="center">🚀 AzeriLLM(unt-7b): Empowering Azerbaijani NLP 🚀</h1>

<p align="center">
  <em>"🌟 Building an inclusive digital future, one language at a time 🌟"</em>
</p>

---

## 🌌 **About Me**

Hey there! 👋 I'm **Omar Ibrahim**, a passionate 17-year-old NLP researcher dedicated to enhancing accessibility and innovation for Azerbaijani speakers with advanced AI technology. **AzeriLLM(unt-7b)** symbolizes this vision.

---

## 🔥 **Why AzeriLLM?**

✨ **First Azerbaijani-focused Large Language Model (LLM)** based on the scalable LLaMA architecture.  
✨ **Bridging linguistic divides**, providing cutting-edge NLP to Azerbaijani communities worldwide.

---

## 🚨 **Exclusive Advanced Training Pipeline**

✅ **🧬 Synthetic Data Creation**: 2.7M bilingual (EN↔AZ) carefully generated segments.  
✅ **🔄 Custom NLLB Translation**: Optimized multilingual model tailored specifically for Azerbaijani.  
✅ **⚡ Direct Preference Optimization (DPO)**: Human-level quality assurance, ensuring top-notch performance.

---

## 📊 **Outstanding Technical Metrics**

| Metric                                     | Base LLaMA | AzeriLLM | AzeriLLM + DPO |
|--------------------------------------------|------------|----------|----------------|
| 🎯 **Perplexity ↓**                        | 42.3       | 15.8     | 🚀 **13.4**    |
| 🌍 **BLEU Score (EN→AZ) ↑**                | 12.4       | 34.1     | 📈 **36.7**    |
| 💬 **Fluency (Human Eval.) ↑**             | 3.1/5.0    | 4.4/5.0  | 🌟 **4.7/5.0** |
| 🧩 **Coherence (Human Eval.) ↑**           | 2.9/5.0    | 4.3/5.0  | 🌟 **4.6/5.0** |
| 📌 **Factual Accuracy (Human Eval.) ↑**    | 2.5/5.0    | 4.2/5.0  | 🌟 **4.5/5.0** |

---

## 🛠️ **Quick Start Guide**

Easily integrate AzeriLLM into your projects:

```python
from transformers import AutoModelForCausalLM, AutoTokenizer

model_name = "omar07ibrahim/unt-7b"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModelForCausalLM.from_pretrained(model_name)

prompt = "Azərbaycanın gələcəyi üçün"
input_ids = tokenizer.encode(prompt, return_tensors="pt")

output = model.generate(input_ids, max_length=60, num_beams=5)
print(tokenizer.decode(output[0], skip_special_tokens=True))
```

💡 **Example Output:**

```markdown
Azərbaycanın gələcəyi üçün təhsil, texnologiya və innovasiyaya yatırımların artırılması önəmlidir, çünki bu sahələr ölkənin davamlı inkişafını və beynəlxalq rəqabət qabiliyyətini təmin edir...
```

---

## 🏆 **Community & Global Impact**

- 🎤 Presented at **TurkLang 2024**
- 📚 Supported by **DOST Digital Innovation Center**
- 🌐 Actively cited in international NLP research

---

## 🌟 **Stay Connected**

<p align="center">
  <a href="https://huggingface.co/omar07ibrahim">🤗 HuggingFace</a> •
  <a href="https://github.com/omar07ibrahim">🐙 GitHub</a> •
  <a href="https://omar07ibrahim.netlify.app">🌍 Website</a>
</p>

---

## 📖 **Citation**

If AzeriLLM assists your work, please cite:

```bibtex
@misc{azeriLLM2025,
  author = {Israfil, Omar Ibrahim},
  title = {AzeriLLM(unt-7b): Comprehensive Azerbaijani Language Model},
  year = {2025},
  publisher = {HuggingFace},
  url = {https://huggingface.co/omar07ibrahim/unt-7b}
}
```

---

## 🚀 **Vision & Mission**

> 🌌 "AzeriLLM is the first step toward genuinely inclusive AI. Together, let's empower every language in the digital era." 🌌

<p align="center">
  <img src="https://i.ibb.co/KxRZrPfp/Ibrahim-2.jpg" width="500" style="border-radius: 15px; box-shadow: 0 0 15px rgba(0,0,0,0.2);">
</p>

<p align="center">
  ✨ <em>Innovate • Empower • Transform</em> ✨
</p>