transformers pytorch llama text-generation text-generation-inference unsloth en dataset:Yogeshwaran10/fact-extraction-dataset license:apache-2.0 autotrain_compatible endpoints_compatible region:us
---
base_model: unsloth/meta-llama-3.1-8b-bnb-4bit
datasets:
- Yogeshwaran10/fact-extraction-dataset
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
---

# 🦙 LLaMA-3.1-8B Fine-Tuned for Fact Extraction  

[![Made with Unsloth](https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png)](https://github.com/unslothai/unsloth)  

- **Developed by:** [Yogeshwaran10](https://huggingface.co/Yogeshwaran10)  
- **License:** Apache-2.0  
- **Fine-tuned from:** [unsloth/meta-llama-3.1-8b-bnb-4bit](https://huggingface.co/unsloth/meta-llama-3.1-8b-bnb-4bit)  
- **Training Method:** Unsloth + Hugging Face TRL  

## 🚀 Model Overview  
This model is a fine-tuned version of **LLaMA-3.1-8B**, specifically optimized for **Fact Extraction**. It is capable of identifying and extracting factual statements from input text while filtering out opinions, speculations, and subjective claims.  

### ✅ Key Features  
- Extracts **only factual information** from given text.  
- **Instruction-tuned** using **Alpaca-style prompting**.  
- Fine-tuned **2× faster** using [Unsloth](https://github.com/unslothai/unsloth).  
- Suitable for **research**, **fact-checking**, and **knowledge retrieval** tasks.  

---

## ⚡ How to Use This Model  

This model follows an **instruction-based approach**, where the user provides a command along with the input text.   

---

## 📌 Example Prompt & Expected Output  

### 🔹 Input Prompt
```
### Instruction:
Extract only the factual statements from the following text. Do not truncate, summarize, or modify them in any way.

### Input:
The Eiffel Tower is one of the most famous landmarks in the world.
Many people believe it is the tallest tower in the world, but that is not true.
It was constructed in 1889 by Gustave Eiffel.
Some think it was meant to be a permanent structure, but it was originally planned to be dismantled after 20 years.

### Output:
```

### ✅ Expected Model Response
```
The Eiffel Tower is one of the most famous landmarks in the world.
It was constructed in 1889 by Gustave Eiffel.
It was originally planned to be dismantled after 20 years.
```

---

## 🚀 Applications
✅ Extracting factual content from **news articles**  
✅ Filtering **opinions and biases** in text processing  
✅ Assisting in **research and knowledge retrieval**  
✅ Enhancing fact-based **summarization models**  

---

## 📌 Notes & Limitations  
- ❌ The model **does not summarize** text—it only extracts facts.  
- ❌ It may not be 100% accurate in distinguishing fact from opinion.  
- ❌ Fine-tuning for **specific domains** (medical, legal, etc.) may be required for better accuracy.  

---

## 🤖 Model Access  
This model is available on **Hugging Face** and can be accessed via the `transformers` library.  

🔗 **Try it now:** [Yogeshwaran10/Llama-3.1-8B-finetuned](https://huggingface.co/Yogeshwaran10/Llama-3.1-8B-finetuned)