transformers safetensors bert text-classification uz dataset:abdumalikov/bert-text-classification base_model:google-bert/bert-base-uncased base_model:finetune:google-bert/bert-base-uncased license:mit autotrain_compatible endpoints_compatible region:us
---
base_model:
- google-bert/bert-base-uncased
datasets:
- abdumalikov/bert-text-classification
language:
- uz
library_name: transformers
license: mit
metrics:
- f1
- accuracy
pipeline_tag: text-classification
---

# Uzbek Text Classification Model(BERT)

This model is a fine-tuned BERT model for text classification in the Uzbek language. It has been trained to classify Uzbek text into various categories such as sports, politics, technology, etc. The model was fine-tuned using Hugging Face's `transformers` library.

## Model Details

### Model Description

- **Developed by:** Abdumalikov Aziz
- **Model type:** BERT for Sequence Classification
- **Language:** Uzbek
- **License:** Apache 2.0
- **Fine-tuned from:** `bert-base-multilingual-cased`

This model can classify Uzbek text into 15 different categories, such as "Sport," "Dunyo," "Jamiyat," and more.

### Model Sources

- **Repository:** [https://huggingface.co/abdumalikov/bert-finetuned-uzbek](https://huggingface.co/abdumalikov/bert-finetuned-uzbek)

## Uses

### Direct Use

The model can be used directly for text classification tasks in the Uzbek language. It is suitable for tasks like news categorization, sentiment analysis, and more.

### Downstream Use

The model can be fine-tuned further for specific tasks or used as part of a larger NLP pipeline.

### Out-of-Scope Use

The model is not suitable for generating text or for tasks outside text classification in Uzbek.

## Bias, Risks, and Limitations

### Bias

The model may have biases present in the training data, especially since the data may represent specific viewpoints or cultural contexts.

### Risks

The model may misclassify text that does not fit well into the predefined categories. Users should be cautious when applying the model to texts outside the training domain.

### Limitations

The model is limited to text classification and is not suitable for tasks such as question-answering or text generation.

## How to Get Started with the Model

Here is an example of how to use the model with Hugging Face's `pipeline`:

```python
from transformers import pipeline

pipe = pipeline("text-classification", model="abdumalikov/bert-finetuned-uzbek-text-classification")

pipe("Bugun o'zbekiston jamoasi volleybol bo'yicha jaxon chempioni bo'ldi")
```

## Training Details

### Training Data

The model was trained on a custom dataset of Uzbek text, which includes various categories such as sports, politics, technology, and more. The dataset consists of approximately 512,750 labeled examples.

### Training Procedure

The model was fine-tuned using the following hyperparameters:

- **Epochs:** 5
- **Batch size:** 16
- **Learning rate:** 2e-5
- **Optimizer:** AdamW

#### Preprocessing

The data was tokenized using the BERT tokenizer. Special tokens were added for sentence boundaries.

## Evaluation

### Testing Data

The model was tested on a separate dataset of 50,000 examples.

### Metrics

The following metrics were used to evaluate the model:

- **Accuracy:** 86%
- **F1-score:** 87%

## Model Examination

The model's predictions were examined to ensure that it performs well across all categories.

## Environmental Impact

- **Hardware Type:** GeForce RTX 3090&#x20;

- **Hours used:** 5 hours

- **Carbon Emitted:** Approximately 10 kg CO2eq

## Technical Specifications

### Model Architecture

The model is based on the BERT architecture for sequence classification.

### Compute Infrastructure

The model was trained on an GeForce RTX 3090 GPU using the Hugging Face Trainer API.

## Citation

**BibTeX:**

```bibtex
@misc{abdumalikov2025uzbekbert,
  title={Uzbek Text Classification using BERT},
  author={Abdumalikov},
  year={2025},
  publisher={Hugging Face},
  howpublished={\url{https://huggingface.co/abdumalikov/bert-finetuned-uzbek}}
}
```

## Model Card Authors

- Abdumalikov Aziz

## Model Card Contact

For questions or feedback, please contact abdumalikov via the Hugging Face platform.