Raj411 commited on
Commit
868e6ca
·
verified ·
1 Parent(s): 632c047

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +87 -0
README.md ADDED
@@ -0,0 +1,87 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-4.0
3
+ tags:
4
+ - sentiment-classification
5
+ - telugu
6
+ - indicbert
7
+ - indian-languages
8
+ - baseline
9
+ language: te
10
+ datasets:
11
+ - DSL-13-SRMAP/TeSent_Benchmark-Dataset
12
+ model_name: IndicBERT_WOR
13
+ ---
14
+
15
+ # IndicBERT_WOR: IndicBERT Telugu Sentiment Classification Model (Without Rationale)
16
+
17
+ ## Model Overview
18
+
19
+ **IndicBERT_WOR** is a Telugu sentiment classification model based on **IndicBERT (ai4bharat/indicBERTv2-MLM-only)**, a multilingual BERT-like transformer developed by AI4Bharat.
20
+ The "WOR" in the model name stands for "**Without Rationale**", meaning this model is trained only with sentiment labels from the TeSent_Benchmark-Dataset and **does not use human-annotated rationales**.
21
+
22
+ ---
23
+
24
+ ## Model Details
25
+
26
+ - **Architecture:** IndicBERT (BERT-like, multilingual for Indian languages)
27
+ - **Pretraining Data:** OSCAR and AI4Bharat curated corpora for 12 Indian languages (including Telugu and English)
28
+ - **Pretraining Objective:** Masked Language Modeling (MLM)
29
+ - **Fine-tuning Data:** [TeSent_Benchmark-Dataset](https://huggingface.co/datasets/dsl-13-srmap/tesent_benchmark-dataset), using only sentence-level sentiment labels (positive, negative, neutral); rationale annotations are disregarded
30
+ - **Task:** Sentence-level sentiment classification (3-way)
31
+ - **Rationale Usage:** **Not used** during training or inference ("WOR" = Without Rationale)
32
+
33
+ ---
34
+
35
+ ## Intended Use
36
+
37
+ - **Primary Use:** Benchmarking Telugu sentiment classification on the TeSent_Benchmark-Dataset as a **baseline** for models trained without rationales
38
+ - **Research Setting:** Well suited for monolingual Telugu NLP tasks, especially in low-resource and explainable AI research
39
+
40
+ ---
41
+
42
+ ## Why IndicBERT?
43
+
44
+ IndicBERT provides language-aware tokenization, clean embeddings, and faster training for Indian languages.
45
+ It is well suited for monolingual Telugu tasks, but does not support code-mixed data or cross-lingual transfer. For Telugu sentiment classification, IndicBERT delivers efficient and accurate results due to its tailored pretraining.
46
+
47
+ ---
48
+
49
+ ## Performance and Limitations
50
+
51
+ **Strengths:**
52
+ - Language-aware tokenization and embeddings for Telugu
53
+ - Faster training and inference compared to larger multilingual models
54
+ - Robust baseline for monolingual Telugu sentiment classification
55
+
56
+ **Limitations:**
57
+ - Not suitable for code-mixed or cross-lingual tasks
58
+ - Telugu-specific models may outperform on highly nuanced or domain-specific data
59
+ - Since rationales are not used, the model cannot provide explicit explanations for its predictions
60
+
61
+ ---
62
+
63
+ ## Training Data
64
+
65
+ - **Dataset:** [TeSent_Benchmark-Dataset](https://huggingface.co/datasets/dsl-13-srmap/tesent_benchmark-dataset)
66
+ - **Data Used:** Only the **Content** (Telugu sentence) and **Label** (sentiment label) columns; **rationale** annotations are ignored for IndicBERT_WOR training
67
+
68
+ ---
69
+
70
+ ## Language Coverage
71
+
72
+ - **Language:** Telugu (`te`)
73
+ - **Model Scope:** Strictly monolingual Telugu sentiment classification
74
+
75
+ ---
76
+
77
+ ## Citation and More Details
78
+
79
+ For detailed experimental setup, evaluation metrics, and comparisons with rationale-based models, **please refer to our paper**.
80
+
81
+
82
+
83
+ ---
84
+
85
+ ## License
86
+
87
+ Released under [CC BY 4.0](LICENSE).