Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,87 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-4.0
|
3 |
+
tags:
|
4 |
+
- sentiment-classification
|
5 |
+
- telugu
|
6 |
+
- indicbert
|
7 |
+
- indian-languages
|
8 |
+
- baseline
|
9 |
+
language: te
|
10 |
+
datasets:
|
11 |
+
- DSL-13-SRMAP/TeSent_Benchmark-Dataset
|
12 |
+
model_name: IndicBERT_WOR
|
13 |
+
---
|
14 |
+
|
15 |
+
# IndicBERT_WOR: IndicBERT Telugu Sentiment Classification Model (Without Rationale)
|
16 |
+
|
17 |
+
## Model Overview
|
18 |
+
|
19 |
+
**IndicBERT_WOR** is a Telugu sentiment classification model based on **IndicBERT (ai4bharat/indicBERTv2-MLM-only)**, a multilingual BERT-like transformer developed by AI4Bharat.
|
20 |
+
The "WOR" in the model name stands for "**Without Rationale**", meaning this model is trained only with sentiment labels from the TeSent_Benchmark-Dataset and **does not use human-annotated rationales**.
|
21 |
+
|
22 |
+
---
|
23 |
+
|
24 |
+
## Model Details
|
25 |
+
|
26 |
+
- **Architecture:** IndicBERT (BERT-like, multilingual for Indian languages)
|
27 |
+
- **Pretraining Data:** OSCAR and AI4Bharat curated corpora for 12 Indian languages (including Telugu and English)
|
28 |
+
- **Pretraining Objective:** Masked Language Modeling (MLM)
|
29 |
+
- **Fine-tuning Data:** [TeSent_Benchmark-Dataset](https://huggingface.co/datasets/dsl-13-srmap/tesent_benchmark-dataset), using only sentence-level sentiment labels (positive, negative, neutral); rationale annotations are disregarded
|
30 |
+
- **Task:** Sentence-level sentiment classification (3-way)
|
31 |
+
- **Rationale Usage:** **Not used** during training or inference ("WOR" = Without Rationale)
|
32 |
+
|
33 |
+
---
|
34 |
+
|
35 |
+
## Intended Use
|
36 |
+
|
37 |
+
- **Primary Use:** Benchmarking Telugu sentiment classification on the TeSent_Benchmark-Dataset as a **baseline** for models trained without rationales
|
38 |
+
- **Research Setting:** Well suited for monolingual Telugu NLP tasks, especially in low-resource and explainable AI research
|
39 |
+
|
40 |
+
---
|
41 |
+
|
42 |
+
## Why IndicBERT?
|
43 |
+
|
44 |
+
IndicBERT provides language-aware tokenization, clean embeddings, and faster training for Indian languages.
|
45 |
+
It is well suited for monolingual Telugu tasks, but does not support code-mixed data or cross-lingual transfer. For Telugu sentiment classification, IndicBERT delivers efficient and accurate results due to its tailored pretraining.
|
46 |
+
|
47 |
+
---
|
48 |
+
|
49 |
+
## Performance and Limitations
|
50 |
+
|
51 |
+
**Strengths:**
|
52 |
+
- Language-aware tokenization and embeddings for Telugu
|
53 |
+
- Faster training and inference compared to larger multilingual models
|
54 |
+
- Robust baseline for monolingual Telugu sentiment classification
|
55 |
+
|
56 |
+
**Limitations:**
|
57 |
+
- Not suitable for code-mixed or cross-lingual tasks
|
58 |
+
- Telugu-specific models may outperform on highly nuanced or domain-specific data
|
59 |
+
- Since rationales are not used, the model cannot provide explicit explanations for its predictions
|
60 |
+
|
61 |
+
---
|
62 |
+
|
63 |
+
## Training Data
|
64 |
+
|
65 |
+
- **Dataset:** [TeSent_Benchmark-Dataset](https://huggingface.co/datasets/dsl-13-srmap/tesent_benchmark-dataset)
|
66 |
+
- **Data Used:** Only the **Content** (Telugu sentence) and **Label** (sentiment label) columns; **rationale** annotations are ignored for IndicBERT_WOR training
|
67 |
+
|
68 |
+
---
|
69 |
+
|
70 |
+
## Language Coverage
|
71 |
+
|
72 |
+
- **Language:** Telugu (`te`)
|
73 |
+
- **Model Scope:** Strictly monolingual Telugu sentiment classification
|
74 |
+
|
75 |
+
---
|
76 |
+
|
77 |
+
## Citation and More Details
|
78 |
+
|
79 |
+
For detailed experimental setup, evaluation metrics, and comparisons with rationale-based models, **please refer to our paper**.
|
80 |
+
|
81 |
+
|
82 |
+
|
83 |
+
---
|
84 |
+
|
85 |
+
## License
|
86 |
+
|
87 |
+
Released under [CC BY 4.0](LICENSE).
|