VARCO-VISION: Expanding Frontiers in Korean Vision-Language Models
In this paper, we introduce an open-source Korean-English vision-language
model (VLM), VARCO-VISION. We incorporate a step-by-step training strategy that
allows a model learn both linguistic and visual information while preserving
the backbone model's knowledge. Our model demonstrates outstanding performance
in diverse settings requiring bilingual image-text understanding and generation
abilities compared to models of similar size. VARCO-VISION is also capable of
grounding, referring, and OCR, expanding its usage and potential applications
for real-world scenarios. In addition to the model, we release five Korean
evaluation datasets, including four closed-set and one openset benchmarks. We
anticipate that our milestone will broaden the opportunities for AI researchers
aiming to train VLMs. VARCO-VISION is available at
https://huggingface.co/NCSOFT/VARCO-VISION-14B.
674d157b8c28f1a8d0858ac9
Jeongho Ju
admin_assigned
2025-01-22T17:16:44.659Z
624ceaa38746b2f5773c2d1c
https://cdn-avatars.huggingface.co/v1/production/uploads/624ceaa38746b2f5773c2d1c/UF7TZPXUjJ5izRJainO-Z.png
jujeongho
user
jujeongho
674d157b8c28f1a8d0858aca
Daeyoung Kim
674d157b8c28f1a8d0858acb
SunYoung Park
claimed_verified
2025-01-23T09:21:34.412Z
670331fe2bf633f68cb03cac
/avatars/a5bb7c06244f6768b5ca167fa78b8472.svg
SunYoung Park
user
sun0park
674d157b8c28f1a8d0858acc
Youngjune Kim
claimed_verified
2024-12-05T09:29:03.858Z
672af72944096b60a368116e
/avatars/dd6aa4b6f6efa771a357e7de0803ae9b.svg
kimyoungjune
user
kimyoungjune
VARCO-VISION: Expanding Frontiers in Korean Vision-Language Models
In this paper, we introduce an open-source Korean-English vision-language
model (VLM), VARCO-VISION. We incorporate a step-by-step training strategy that
allows a model learn both linguistic and visual information while preserving
the backbone model's knowledge. Our model demonstrates outstanding performance
in diverse settings requiring bilingual image-text understanding and generation
abilities compared to models of similar size. VARCO-VISION is also capable of
grounding, referring, and OCR, expanding its usage and potential applications
for real-world scenarios. In addition to the model, we release five Korean
evaluation datasets, including four closed-set and one openset benchmarks. We
anticipate that our milestone will broaden the opportunities for AI researchers
aiming to train VLMs. VARCO-VISION is available at
https://huggingface.co/NCSOFT/VARCO-VISION-14B.
An open-source Korean-English vision-language model, VARCO-VISION, is introduced and demonstrates superior performance in bilingual image-text tasks compared to similar models, incorporating a step-by-step training strategy and supporting grounding, referring, and OCR.
vision-language model VARCO-VISION step-by-step training strategy linguistic visual information bilingual image-text understanding generation abilities grounding referring OCR evaluation datasets closed-set openset benchmarks