Sentiment Analysis of Lithuanian Online Reviews Using Large Language
  Models
Sentiment analysis is a widely researched area within Natural Language
Processing (NLP), attracting significant interest due to the advent of
automated solutions. Despite this, the task remains challenging because of the
inherent complexity of languages and the subjective nature of sentiments. It is
even more challenging for less-studied and less-resourced languages such as
Lithuanian. Our review of existing Lithuanian NLP research reveals that
traditional machine learning methods and classification algorithms have limited
effectiveness for the task. In this work, we address sentiment analysis of
Lithuanian five-star-based online reviews from multiple domains that we collect
and clean. We apply transformer models to this task for the first time,
exploring the capabilities of pre-trained multilingual Large Language Models
(LLMs), specifically focusing on fine-tuning BERT and T5 models. Given the
inherent difficulty of the task, the fine-tuned models perform quite well,
especially when the sentiments themselves are less ambiguous: 80.74% and 89.61%
testing recognition accuracy of the most popular one- and five-star reviews
respectively. They significantly outperform current commercial state-of-the-art
general-purpose LLM GPT-4. We openly share our fine-tuned LLMs online.
66a866bacd3dd5ec13aad34c
Brigita Vileikytė
admin_assigned
2024-07-30T09:07:25.043Z
65587d2323e43ac218a79ffc
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/ez80XQ_DER34OSgGtv_wv.jpeg
Brigita Vileikytė
user
brivil1
66a866bacd3dd5ec13aad34d
Mantas Lukoševičius
66a866bacd3dd5ec13aad34e
Lukas Stankevičius
admin_assigned
2024-07-30T09:07:40.972Z
60801904237f7a0189f2a87a
/avatars/3e46067979a4772ed533f49c3eeb1bec.svg
Lukas Stankevičius
user
LukasStankevicius
Sentiment Analysis of Lithuanian Online Reviews Using Large Language
  Models
Sentiment analysis is a widely researched area within Natural Language
Processing (NLP), attracting significant interest due to the advent of
automated solutions. Despite this, the task remains challenging because of the
inherent complexity of languages and the subjective nature of sentiments. It is
even more challenging for less-studied and less-resourced languages such as
Lithuanian. Our review of existing Lithuanian NLP research reveals that
traditional machine learning methods and classification algorithms have limited
effectiveness for the task. In this work, we address sentiment analysis of
Lithuanian five-star-based online reviews from multiple domains that we collect
and clean. We apply transformer models to this task for the first time,
exploring the capabilities of pre-trained multilingual Large Language Models
(LLMs), specifically focusing on fine-tuning BERT and T5 models. Given the
inherent difficulty of the task, the fine-tuned models perform quite well,
especially when the sentiments themselves are less ambiguous: 80.74% and 89.61%
testing recognition accuracy of the most popular one- and five-star reviews
respectively. They significantly outperform current commercial state-of-the-art
general-purpose LLM GPT-4. We openly share our fine-tuned LLMs online.
Transformer models, particularly BERT and T5, perform well in sentiment analysis of Lithuanian online reviews, surpassing commercial state-of-the-art models.
transformer models pre-trained multilingual Large Language Models (LLMs) fine-tuning BERT T5 sentiment analysis online reviews testing recognition accuracy GPT-4