title: VARCO-VISION: Expanding Frontiers in Korean Vision-Language Models
summary: In this paper, we introduce an open-source Korean-English vision-language
  model (VLM), VARCO-VISION. We incorporate a step-by-step training strategy that
  allows a model learn both linguistic and visual information while preserving
  the backbone model's knowledge. Our model demonstrates outstanding performance
  in diverse settings requiring bilingual image-text understanding and generation
  abilities compared to models of similar size. VARCO-VISION is also capable of
  grounding, referring, and OCR, expanding its usage and potential applications
  for real-world scenarios. In addition to the model, we release five Korean
  evaluation datasets, including four closed-set and one openset benchmarks. We
  anticipate that our milestone will broaden the opportunities for AI researchers
  aiming to train VLMs. VARCO-VISION is available at
  https://huggingface.co/NCSOFT/VARCO-VISION-14B.
paper_authors._id: 674d157b8c28f1a8d0858ac9
paper_authors.name: Jeongho Ju
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-22T17:16:44.659Z
paper_authors._id: 624ceaa38746b2f5773c2d1c
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/624ceaa38746b2f5773c2d1c/UF7TZPXUjJ5izRJainO-Z.png
paper_authors.fullname: jujeongho
paper_authors.type: user
paper_authors.user: jujeongho
paper_authors._id: 674d157b8c28f1a8d0858aca
paper_authors.name: Daeyoung Kim
paper_authors._id: 674d157b8c28f1a8d0858acb
paper_authors.name: SunYoung Park
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-01-23T09:21:34.412Z
paper_authors._id: 670331fe2bf633f68cb03cac
paper_authors.avatarUrl: /avatars/a5bb7c06244f6768b5ca167fa78b8472.svg
paper_authors.fullname: SunYoung Park
paper_authors.type: user
paper_authors.user: sun0park
paper_authors._id: 674d157b8c28f1a8d0858acc
paper_authors.name: Youngjune Kim
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2024-12-05T09:29:03.858Z
paper_authors._id: 672af72944096b60a368116e
paper_authors.avatarUrl: /avatars/dd6aa4b6f6efa771a357e7de0803ae9b.svg
paper_authors.fullname: kimyoungjune
paper_authors.type: user
paper_authors.user: kimyoungjune
paper_title: VARCO-VISION: Expanding Frontiers in Korean Vision-Language Models
paper_summary: In this paper, we introduce an open-source Korean-English vision-language
  model (VLM), VARCO-VISION. We incorporate a step-by-step training strategy that
  allows a model learn both linguistic and visual information while preserving
  the backbone model's knowledge. Our model demonstrates outstanding performance
  in diverse settings requiring bilingual image-text understanding and generation
  abilities compared to models of similar size. VARCO-VISION is also capable of
  grounding, referring, and OCR, expanding its usage and potential applications
  for real-world scenarios. In addition to the model, we release five Korean
  evaluation datasets, including four closed-set and one openset benchmarks. We
  anticipate that our milestone will broaden the opportunities for AI researchers
  aiming to train VLMs. VARCO-VISION is available at
  https://huggingface.co/NCSOFT/VARCO-VISION-14B.
paper_ai_summary: An open-source Korean-English vision-language model, VARCO-VISION, is introduced and demonstrates superior performance in bilingual image-text tasks compared to similar models, incorporating a step-by-step training strategy and supporting grounding, referring, and OCR.
paper_ai_keywords: vision-language model VARCO-VISION step-by-step training strategy linguistic visual information bilingual image-text understanding generation abilities grounding referring OCR evaluation datasets closed-set openset benchmarks