title: Evaluating Multimodal Generative AI with Korean Educational Standards
summary: This paper presents the Korean National Educational Test Benchmark (KoNET), a
  new benchmark designed to evaluate Multimodal Generative AI Systems using
  Korean national educational tests. KoNET comprises four exams: the Korean
  Elementary General Educational Development Test (KoEGED), Middle (KoMGED), High
  (KoHGED), and College Scholastic Ability Test (KoCSAT). These exams are
  renowned for their rigorous standards and diverse questions, facilitating a
  comprehensive analysis of AI performance across different educational levels.
  By focusing on Korean, KoNET provides insights into model performance in
  less-explored languages. We assess a range of models - open-source,
  open-access, and closed APIs - by examining difficulties, subject diversity,
  and human error rates. The code and dataset builder will be made fully
  open-sourced at https://github.com/naver-ai/KoNET.
paper_authors._id: 67bc53ad670ece8d919a8fe1
paper_authors.name: Sanghee Park
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-24T11:54:51.633Z
paper_authors._id: 6639f75a910d619c288f8a86
paper_authors.avatarUrl: /avatars/4b20a056798c009eaf665b0e3021db60.svg
paper_authors.fullname: sanghee park
paper_authors.type: user
paper_authors.user: sangheeeee
paper_authors._id: 67bc53ad670ece8d919a8fe2
paper_authors.name: Geewook Kim
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-24T13:04:57.334Z
paper_authors._id: 6298362c9d3de7b32fd11526
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1658473855720-6298362c9d3de7b32fd11526.jpeg
paper_authors.fullname: Geewook Kim
paper_authors.type: user
paper_authors.user: gwkrsrch
paper_title: Evaluating Multimodal Generative AI with Korean Educational Standards
paper_summary: This paper presents the Korean National Educational Test Benchmark (KoNET), a
  new benchmark designed to evaluate Multimodal Generative AI Systems using
  Korean national educational tests. KoNET comprises four exams: the Korean
  Elementary General Educational Development Test (KoEGED), Middle (KoMGED), High
  (KoHGED), and College Scholastic Ability Test (KoCSAT). These exams are
  renowned for their rigorous standards and diverse questions, facilitating a
  comprehensive analysis of AI performance across different educational levels.
  By focusing on Korean, KoNET provides insights into model performance in
  less-explored languages. We assess a range of models - open-source,
  open-access, and closed APIs - by examining difficulties, subject diversity,
  and human error rates. The code and dataset builder will be made fully
  open-sourced at https://github.com/naver-ai/KoNET.
paper_ai_summary: KoNET evaluates Multimodal Generative AI Systems using Korean national educational tests across various levels, focusing on language-specific performance.
paper_ai_keywords: Multimodal Generative AI Systems KoNET KoEGED KoMGED KoHGED KoCSAT