Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
Sailor2 is a family of cutting-edge multilingual language models for
South-East Asian (SEA) languages, available in 1B, 8B, and 20B sizes to suit
diverse applications. Building on Qwen2.5, Sailor2 undergoes continuous
pre-training on 500B tokens (400B SEA-specific and 100B replay tokens) to
support 13 SEA languages while retaining proficiency in Chinese and English.
Sailor2-20B model achieves a 50-50 win rate against GPT-4o across SEA
languages. We also deliver a comprehensive cookbook on how to develop the
multilingual model in an efficient manner, including five key aspects: data
curation, pre-training, post-training, model customization and evaluation. We
hope that Sailor2 model (Apache 2.0 license) will drive language development in
the SEA region, and Sailor2 cookbook will inspire researchers to build more
inclusive LLMs for other under-served languages.
67b53f572b2ec6908ffef365
Longxu Dou
extracted_confirmed
2025-04-16T03:05:22.940Z
6214e4ee1e35c843d42d1f88
https://cdn-avatars.huggingface.co/v1/production/uploads/6214e4ee1e35c843d42d1f88/fj-9wuIdPhvogh3BrcXTB.jpeg
Longxu Dou
user
dreamerdeo
67b53f572b2ec6908ffef366
Qian Liu
claimed_verified
2025-03-27T09:05:27.332Z
612ee6a7b960e78c6d2319d4
https://cdn-avatars.huggingface.co/v1/production/uploads/612ee6a7b960e78c6d2319d4/2Hu9BaAyXbyh1vt0v1Qui.jpeg
Qian Liu
user
SivilTaram
67b53f572b2ec6908ffef367
Fan Zhou
claimed_verified
2025-02-19T09:51:54.538Z
628f6e5ab90dde28ef57d293
https://cdn-avatars.huggingface.co/v1/production/uploads/628f6e5ab90dde28ef57d293/AxNzR2nvrND6Rf3RPkYMk.jpeg
Fan Zhou
user
koalazf99
67b53f572b2ec6908ffef368
Changyu Chen
claimed_verified
2025-02-26T08:39:02.389Z
64e416dc54e18f390ef79ba4
https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/5n01J00ZaVRrebsON8iYA.jpeg
Changyu Chen
user
Cameron-Chen
67b53f572b2ec6908ffef369
Zili Wang
67b53f572b2ec6908ffef36a
Ziqi Jin
67b53f572b2ec6908ffef36b
Zichen Liu
claimed_verified
2025-02-27T09:17:58.404Z
65f5392c68b8e0cb3c9977a2
/avatars/aa64772475098e8a135c13072fde6744.svg
Zichen
user
lkevinzc
67b53f572b2ec6908ffef36c
Tongyao Zhu
claimed_verified
2025-03-25T08:21:48.759Z
647db42711084fb58318b053
/avatars/901a4db8e99f6e0c7e7e596c251b315c.svg
Tongyao
user
tyzhu
67b53f572b2ec6908ffef36d
Cunxiao Du
67b53f572b2ec6908ffef36e
Penghui Yang
claimed_verified
2025-02-19T09:03:36.624Z
6508463c423b46492eec64e2
https://cdn-avatars.huggingface.co/v1/production/uploads/6508463c423b46492eec64e2/WSU7NSqjk92Pr2xUIWjCk.png
Penghui Yang
user
phyang
67b53f572b2ec6908ffef36f
Haonan Wang
67b53f572b2ec6908ffef370
Jiaheng Liu
claimed_verified
2025-02-21T09:59:55.378Z
65377c30e48353201e6fdda0
/avatars/a8f803b6f2e598eaee9c52c0d2ddfc16.svg
Jiaheng Liu
user
CheeryLJH
67b53f572b2ec6908ffef371
Yongchi Zhao
67b53f572b2ec6908ffef372
Xiachong Feng
claimed_verified
2025-05-28T09:02:06.757Z
6776ae0c91b4c75dac91249c
/avatars/a43139f65ad7086426d9757a1bcb7080.svg
Oran Feng
user
xiachongfeng
67b53f572b2ec6908ffef373
Xin Mao
67b53f572b2ec6908ffef374
Man Tsung Yeung
67b53f572b2ec6908ffef375
Kunat Pipatanakul
claimed_verified
2025-07-15T19:14:05.792Z
62d192c2d50433c35eb1b48e
https://cdn-avatars.huggingface.co/v1/production/uploads/62d192c2d50433c35eb1b48e/VjmDu8GOIuLuQNBQdQLLS.png
Kunat Pipatanakul
user
kunato
67b53f572b2ec6908ffef376
Fajri Koto
67b53f572b2ec6908ffef377
Min Si Thu
claimed_verified
2025-02-19T14:37:45.250Z
63ff6038e7767a895335bd48
https://cdn-avatars.huggingface.co/v1/production/uploads/1678198534680-63ff6038e7767a895335bd48.jpeg
Min Si Thu
user
jojo-ai-mst
67b53f572b2ec6908ffef378
Hynek Kydlíček
67b53f572b2ec6908ffef379
Zeyi Liu
67b53f572b2ec6908ffef37a
Qunshu Lin
67b53f572b2ec6908ffef37b
Sittipong Sripaisarnmongkol
67b53f572b2ec6908ffef37c
Kridtaphad Sae-Khow
claimed_verified
2025-05-26T08:42:22.062Z
620a010941aa65c2deea27a3
/avatars/06aa6892b4155f23fc8e73803747fa41.svg
Kridtaphad Sae-khow
user
takipipo
67b53f572b2ec6908ffef37d
Nirattisai Thongchim
67b53f572b2ec6908ffef37e
Taechawat Konkaew
67b53f572b2ec6908ffef37f
Narong Borijindargoon
67b53f572b2ec6908ffef380
Anh Dao
67b53f572b2ec6908ffef381
Matichon Maneegard
67b53f572b2ec6908ffef382
Phakphum Artkaew
claimed_verified
2025-03-03T08:07:36.639Z
631a4855300a072a8da70abd
https://cdn-avatars.huggingface.co/v1/production/uploads/631a4855300a072a8da70abd/jRnzdW5JBjICYKCmkUFI-.jpeg
phakphum artkaew
user
pakphum
67b53f572b2ec6908ffef383
Zheng-Xin Yong
claimed_verified
2025-02-20T09:37:30.404Z
61424bf4f0d914a5f606a823
https://cdn-avatars.huggingface.co/v1/production/uploads/61424bf4f0d914a5f606a823/0td8lR4elBaVvJUD9Pojh.png
Yong Zheng-Xin
user
yongzx
67b53f572b2ec6908ffef384
Quan Nguyen
67b53f572b2ec6908ffef385
Wannaphong Phatthiyaphaibun
claimed_verified
2025-02-19T14:37:47.061Z
60dc25da6155a8319f008a6f
https://cdn-avatars.huggingface.co/v1/production/uploads/1630322686754-60dc25da6155a8319f008a6f.jpeg
Wannaphong Phatthiyaphaibun
user
wannaphong
67b53f572b2ec6908ffef386
Hoang H. Tran
claimed_verified
2025-02-24T09:25:29.514Z
65c19c3172fd754bba256112
https://cdn-avatars.huggingface.co/v1/production/uploads/65c19c3172fd754bba256112/cfgYvKfO36PSTFYKQottM.jpeg
Ryan Tran
user
ryanhoangt
67b53f572b2ec6908ffef387
Mike Zhang
claimed_verified
2025-02-19T09:03:21.404Z
60d33fbbd7b174177faabd4f
https://cdn-avatars.huggingface.co/v1/production/uploads/60d33fbbd7b174177faabd4f/pfyv_xj2B2m2N4F4sT9zJ.jpeg
Mike Zhang
user
jjzha
67b53f572b2ec6908ffef388
Shiqi Chen
claimed_verified
2025-03-21T11:46:50.032Z
62bf99cae140faaa85335ab8
/avatars/bcd2aa1823995b385096e2a68ce3e071.svg
Shiqi Chen
user
ShiqiChen
67b53f572b2ec6908ffef389
Tianyu Pang
claimed_verified
2025-04-20T15:04:22.985Z
63d91b6d255ef6add20e1b38
https://cdn-avatars.huggingface.co/v1/production/uploads/1675921369867-63d91b6d255ef6add20e1b38.jpeg
Tianyu Pang
user
P2333
67b53f572b2ec6908ffef38a
Chao Du
67b53f572b2ec6908ffef38b
Xinyi Wan
67b53f572b2ec6908ffef38c
Wei Lu
67b53f572b2ec6908ffef38d
Min Lin
Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs
Sailor2 is a family of cutting-edge multilingual language models for
South-East Asian (SEA) languages, available in 1B, 8B, and 20B sizes to suit
diverse applications. Building on Qwen2.5, Sailor2 undergoes continuous
pre-training on 500B tokens (400B SEA-specific and 100B replay tokens) to
support 13 SEA languages while retaining proficiency in Chinese and English.
Sailor2-20B model achieves a 50-50 win rate against GPT-4o across SEA
languages. We also deliver a comprehensive cookbook on how to develop the
multilingual model in an efficient manner, including five key aspects: data
curation, pre-training, post-training, model customization and evaluation. We
hope that Sailor2 model (Apache 2.0 license) will drive language development in
the SEA region, and Sailor2 cookbook will inspire researchers to build more
inclusive LLMs for other under-served languages.
Sailor2, a multilingual language model family tailored for Southeast Asian languages, achieves competitive performance against GPT-4 and includes a detailed cookbook for efficient development.
multilingual language models continuous pre-training SEA-specific replay tokens model customization evaluation data curation