title: Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
summary: Sailor2 is a family of cutting-edge multilingual language models for
  South-East Asian (SEA) languages, available in 1B, 8B, and 20B sizes to suit
  diverse applications. Building on Qwen2.5, Sailor2 undergoes continuous
  pre-training on 500B tokens (400B SEA-specific and 100B replay tokens) to
  support 13 SEA languages while retaining proficiency in Chinese and English.
  Sailor2-20B model achieves a 50-50 win rate against GPT-4o across SEA
  languages. We also deliver a comprehensive cookbook on how to develop the
  multilingual model in an efficient manner, including five key aspects: data
  curation, pre-training, post-training, model customization and evaluation. We
  hope that Sailor2 model (Apache 2.0 license) will drive language development in
  the SEA region, and Sailor2 cookbook will inspire researchers to build more
  inclusive LLMs for other under-served languages.
paper_authors._id: 67b53f572b2ec6908ffef365
paper_authors.name: Longxu Dou
paper_authors.status: extracted_pending
paper_authors.statusLastChangedAt: 2025-02-19T02:17:59.980Z
paper_authors._id: 6214e4ee1e35c843d42d1f88
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6214e4ee1e35c843d42d1f88/fj-9wuIdPhvogh3BrcXTB.jpeg
paper_authors.fullname: Longxu Dou
paper_authors.type: user
paper_authors.user: dreamerdeo
paper_authors._id: 67b53f572b2ec6908ffef366
paper_authors.name: Qian Liu
paper_authors._id: 67b53f572b2ec6908ffef367
paper_authors.name: Fan Zhou
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-19T09:51:54.538Z
paper_authors._id: 628f6e5ab90dde28ef57d293
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/628f6e5ab90dde28ef57d293/AxNzR2nvrND6Rf3RPkYMk.jpeg
paper_authors.fullname: Fan Zhou
paper_authors.type: user
paper_authors.user: koalazf99
paper_authors._id: 67b53f572b2ec6908ffef368
paper_authors.name: Changyu Chen
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-26T08:39:02.389Z
paper_authors._id: 64e416dc54e18f390ef79ba4
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/5n01J00ZaVRrebsON8iYA.jpeg
paper_authors.fullname: Changyu Chen
paper_authors.type: user
paper_authors.user: Cameron-Chen
paper_authors._id: 67b53f572b2ec6908ffef369
paper_authors.name: Zili Wang
paper_authors._id: 67b53f572b2ec6908ffef36a
paper_authors.name: Ziqi Jin
paper_authors._id: 67b53f572b2ec6908ffef36b
paper_authors.name: Zichen Liu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-27T09:17:58.404Z
paper_authors._id: 65f5392c68b8e0cb3c9977a2
paper_authors.avatarUrl: /avatars/aa64772475098e8a135c13072fde6744.svg
paper_authors.fullname: Zichen
paper_authors.type: user
paper_authors.user: lkevinzc
paper_authors._id: 67b53f572b2ec6908ffef36c
paper_authors.name: Tongyao Zhu
paper_authors._id: 67b53f572b2ec6908ffef36d
paper_authors.name: Cunxiao Du
paper_authors._id: 67b53f572b2ec6908ffef36e
paper_authors.name: Penghui Yang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-19T09:03:36.624Z
paper_authors._id: 6508463c423b46492eec64e2
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6508463c423b46492eec64e2/WSU7NSqjk92Pr2xUIWjCk.png
paper_authors.fullname: Penghui Yang
paper_authors.type: user
paper_authors.user: phyang
paper_authors._id: 67b53f572b2ec6908ffef36f
paper_authors.name: Haonan Wang
paper_authors._id: 67b53f572b2ec6908ffef370
paper_authors.name: Jiaheng Liu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-21T09:59:55.378Z
paper_authors._id: 65377c30e48353201e6fdda0
paper_authors.avatarUrl: /avatars/a8f803b6f2e598eaee9c52c0d2ddfc16.svg
paper_authors.fullname: Jiaheng Liu
paper_authors.type: user
paper_authors.user: CheeryLJH
paper_authors._id: 67b53f572b2ec6908ffef371
paper_authors.name: Yongchi Zhao
paper_authors._id: 67b53f572b2ec6908ffef372
paper_authors.name: Xiachong Feng
paper_authors._id: 67b53f572b2ec6908ffef373
paper_authors.name: Xin Mao
paper_authors._id: 67b53f572b2ec6908ffef374
paper_authors.name: Man Tsung Yeung
paper_authors._id: 67b53f572b2ec6908ffef375
paper_authors.name: Kunat Pipatanakul
paper_authors._id: 67b53f572b2ec6908ffef376
paper_authors.name: Fajri Koto
paper_authors._id: 67b53f572b2ec6908ffef377
paper_authors.name: Min Si Thu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-19T14:37:45.250Z
paper_authors._id: 63ff6038e7767a895335bd48
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1678198534680-63ff6038e7767a895335bd48.jpeg
paper_authors.fullname: Min Si Thu
paper_authors.type: user
paper_authors.user: jojo-ai-mst
paper_authors._id: 67b53f572b2ec6908ffef378
paper_authors.name: Hynek Kydlíček
paper_authors._id: 67b53f572b2ec6908ffef379
paper_authors.name: Zeyi Liu
paper_authors._id: 67b53f572b2ec6908ffef37a
paper_authors.name: Qunshu Lin
paper_authors._id: 67b53f572b2ec6908ffef37b
paper_authors.name: Sittipong Sripaisarnmongkol
paper_authors._id: 67b53f572b2ec6908ffef37c
paper_authors.name: Kridtaphad Sae-Khow
paper_authors._id: 67b53f572b2ec6908ffef37d
paper_authors.name: Nirattisai Thongchim
paper_authors._id: 67b53f572b2ec6908ffef37e
paper_authors.name: Taechawat Konkaew
paper_authors._id: 67b53f572b2ec6908ffef37f
paper_authors.name: Narong Borijindargoon
paper_authors._id: 67b53f572b2ec6908ffef380
paper_authors.name: Anh Dao
paper_authors._id: 67b53f572b2ec6908ffef381
paper_authors.name: Matichon Maneegard
paper_authors._id: 67b53f572b2ec6908ffef382
paper_authors.name: Phakphum Artkaew
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-03T08:07:36.639Z
paper_authors._id: 631a4855300a072a8da70abd
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/631a4855300a072a8da70abd/jRnzdW5JBjICYKCmkUFI-.jpeg
paper_authors.fullname: phakphum artkaew
paper_authors.type: user
paper_authors.user: pakphum
paper_authors._id: 67b53f572b2ec6908ffef383
paper_authors.name: Zheng-Xin Yong
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-20T09:37:30.404Z
paper_authors._id: 61424bf4f0d914a5f606a823
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/61424bf4f0d914a5f606a823/0td8lR4elBaVvJUD9Pojh.png
paper_authors.fullname: Yong Zheng-Xin
paper_authors.type: user
paper_authors.user: yongzx
paper_authors._id: 67b53f572b2ec6908ffef384
paper_authors.name: Quan Nguyen
paper_authors._id: 67b53f572b2ec6908ffef385
paper_authors.name: Wannaphong Phatthiyaphaibun
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-19T14:37:47.061Z
paper_authors._id: 60dc25da6155a8319f008a6f
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1630322686754-60dc25da6155a8319f008a6f.jpeg
paper_authors.fullname: Wannaphong Phatthiyaphaibun
paper_authors.type: user
paper_authors.user: wannaphong
paper_authors._id: 67b53f572b2ec6908ffef386
paper_authors.name: Hoang H. Tran
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-24T09:25:29.514Z
paper_authors._id: 65c19c3172fd754bba256112
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/65c19c3172fd754bba256112/cfgYvKfO36PSTFYKQottM.jpeg
paper_authors.fullname: Ryan Tran
paper_authors.type: user
paper_authors.user: ryanhoangt
paper_authors._id: 67b53f572b2ec6908ffef387
paper_authors.name: Mike Zhang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-19T09:03:21.404Z
paper_authors._id: 60d33fbbd7b174177faabd4f
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/60d33fbbd7b174177faabd4f/pfyv_xj2B2m2N4F4sT9zJ.jpeg
paper_authors.fullname: Mike Zhang
paper_authors.type: user
paper_authors.user: jjzha
paper_authors._id: 67b53f572b2ec6908ffef388
paper_authors.name: Shiqi Chen
paper_authors._id: 67b53f572b2ec6908ffef389
paper_authors.name: Tianyu Pang
paper_authors._id: 67b53f572b2ec6908ffef38a
paper_authors.name: Chao Du
paper_authors._id: 67b53f572b2ec6908ffef38b
paper_authors.name: Xinyi Wan
paper_authors._id: 67b53f572b2ec6908ffef38c
paper_authors.name: Wei Lu
paper_authors._id: 67b53f572b2ec6908ffef38d
paper_authors.name: Min Lin
paper_title: Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
paper_summary: Sailor2 is a family of cutting-edge multilingual language models for
  South-East Asian (SEA) languages, available in 1B, 8B, and 20B sizes to suit
  diverse applications. Building on Qwen2.5, Sailor2 undergoes continuous
  pre-training on 500B tokens (400B SEA-specific and 100B replay tokens) to
  support 13 SEA languages while retaining proficiency in Chinese and English.
  Sailor2-20B model achieves a 50-50 win rate against GPT-4o across SEA
  languages. We also deliver a comprehensive cookbook on how to develop the
  multilingual model in an efficient manner, including five key aspects: data
  curation, pre-training, post-training, model customization and evaluation. We
  hope that Sailor2 model (Apache 2.0 license) will drive language development in
  the SEA region, and Sailor2 cookbook will inspire researchers to build more
  inclusive LLMs for other under-served languages.
paper_ai_keywords: multilingual language models pre-training tokens post-training model customization evaluation GPT-4o