title: RuOpinionNE-2024: Extraction of Opinion Tuples from Russian News Texts
summary: In this paper, we introduce the Dialogue Evaluation shared task on extraction
  of structured opinions from Russian news texts. The task of the contest is to
  extract opinion tuples for a given sentence; the tuples are composed of a
  sentiment holder, its target, an expression and sentiment from the holder to
  the target. In total, the task received more than 100 submissions. The
  participants experimented mainly with large language models in zero-shot,
  few-shot and fine-tuning formats. The best result on the test set was obtained
  with fine-tuning of a large language model. We also compared 30 prompts and 11
  open source language models with 3-32 billion parameters in the 1-shot and
  10-shot settings and found the best models and prompts.
paper_authors._id: 67f78485cfcd3569910c99ab
paper_authors.name: Natalia Loukachevitch
paper_authors._id: 67f78485cfcd3569910c99ac
paper_authors.name: Natalia Tkachenko
paper_authors._id: 67f78485cfcd3569910c99ad
paper_authors.name: Anna Lapanitsyna
paper_authors._id: 67f78485cfcd3569910c99ae
paper_authors.name: Mikhail Tikhomirov
paper_authors.status: extracted_confirmed
paper_authors.statusLastChangedAt: 2025-04-10T09:18:43.707Z
paper_authors._id: 652cedbdf120598322ae358a
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/652cedbdf120598322ae358a/RrxrP0gtQus4SfNwfyAg_.jpeg
paper_authors.fullname: Mikhail
paper_authors.type: user
paper_authors.user: RefalMachine
paper_authors._id: 67f78485cfcd3569910c99af
paper_authors.name: Nicolay Rusnachenko
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-04-10T09:57:54.353Z
paper_authors._id: 64e62d11d27a8292c3637f86
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64e62d11d27a8292c3637f86/aptDeBHpCJxcREj6KPLN1.jpeg
paper_authors.fullname: Nicolay Rusnachenko
paper_authors.type: user
paper_authors.user: nicolay-r
paper_title: RuOpinionNE-2024: Extraction of Opinion Tuples from Russian News Texts
paper_summary: In this paper, we introduce the Dialogue Evaluation shared task on extraction
  of structured opinions from Russian news texts. The task of the contest is to
  extract opinion tuples for a given sentence; the tuples are composed of a
  sentiment holder, its target, an expression and sentiment from the holder to
  the target. In total, the task received more than 100 submissions. The
  participants experimented mainly with large language models in zero-shot,
  few-shot and fine-tuning formats. The best result on the test set was obtained
  with fine-tuning of a large language model. We also compared 30 prompts and 11
  open source language models with 3-32 billion parameters in the 1-shot and
  10-shot settings and found the best models and prompts.
paper_ai_summary: The paper describes a Dialogue Evaluation shared task for extracting structured opinions from Russian news texts using large language models in various settings, with fine-tuning delivering the best results.
paper_ai_keywords: large language models zero-shot few-shot fine-tuning opinion tuples sentiment holder target expression sentiment prompts