content.raw: 🖖 Let me introduce the work I've done over the past three months: 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕 and 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁, now open-sourced on 🤗 Hugging Face.
content.type: text
content.value: 🖖 Let me introduce the work I've done over the past three months: 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕 and 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁, now open-sourced on 🤗 Hugging Face.
content.type: new_line
content.type: new_line
content.raw: 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕: This model is built on top of 𝗺𝗲𝘁𝗮-𝗹𝗹𝗮𝗺𝗮/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝟯𝗕 with continual pretraining. The training dataset consists of a mixture of Traditional Chinese and multilingual texts in specific proportions, including 20B tokens of Traditional Chinese text.
content.type: text
content.value: 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕: This model is built on top of 𝗺𝗲𝘁𝗮-𝗹𝗹𝗮𝗺𝗮/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝟯𝗕 with continual pretraining. The training dataset consists of a mixture of Traditional Chinese and multilingual texts in specific proportions, including 20B tokens of Traditional Chinese text.
content.type: new_line
content.type: new_line
content.raw: 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁: This is a fine-tuned conversational model based on the foundation model.
content.type: text
content.value: 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁: This is a fine-tuned conversational model based on the foundation model.
content.type: new_line
content.type: new_line
content.raw: This Llama-3.2-Taiwan open-source project is currently a one-person effort (yes, I did everything from text preparation — so exhausting!). If you're interested, feel free to join the Discord server for discussions.
content.type: text
content.value: This Llama-3.2-Taiwan open-source project is currently a one-person effort (yes, I did everything from text preparation — so exhausting!). If you're interested, feel free to join the Discord server for discussions.
content.type: new_line
content.type: new_line
content.raw: 🅱🅴🅽🅲🅷🅼🅰🆁🅺🅸🅽🅶
content.type: text
content.value: 🅱🅴🅽🅲🅷🅼🅰🆁🅺🅸🅽🅶
content.type: new_line
content.type: new_line
content.raw: The evaluation was conducted using 
content.type: text
content.value: The evaluation was conducted using 
content.raw: https://huggingface.co/datasets/ikala/tmmluplus
content.id: ikala/tmmluplus
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/ikala/tmmluplus
content.raw: , though the README page does not yet reflect the latest results. The performance is close to the previous versions, indicating that further improvements might require adding more specialized knowledge in the datasets.
content.type: text
content.value: , though the README page does not yet reflect the latest results. The performance is close to the previous versions, indicating that further improvements might require adding more specialized knowledge in the datasets.
content.type: new_line
content.type: new_line
content.raw: 🅰 🅲🅰🅻🅻 🅵🅾🆁 🆂🆄🅿🅿🅾🆁🆃
content.type: text
content.value: 🅰 🅲🅰🅻🅻 🅵🅾🆁 🆂🆄🅿🅿🅾🆁🆃
content.type: new_line
content.type: new_line
content.raw: If anyone is willing to provide compute resources, it would be greatly appreciated to help this project continue and grow. 💪
content.type: text
content.value: If anyone is willing to provide compute resources, it would be greatly appreciated to help this project continue and grow. 💪
content.type: new_line
content.type: new_line
content.raw: ---
content.type: text
content.value: ---
content.type: new_line
content.raw: 🏔️ Foundation model: 
content.type: text
content.value: 🏔️ Foundation model: 
content.raw: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B
content.id: lianghsun/Llama-3.2-Taiwan-3B
content.type: model
content.type: resource
content.url: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B
content.type: new_line
content.raw: 🤖 Instruction model: 
content.type: text
content.value: 🤖 Instruction model: 
content.raw: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct
content.id: lianghsun/Llama-3.2-Taiwan-3B-Instruct
content.type: model
content.type: resource
content.url: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct
content.type: new_line
content.raw: ⚡ GGUF: 
content.type: text
content.value: ⚡ GGUF: 
content.raw: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF
content.id: lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF
content.type: model
content.type: resource
content.url: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF
rawContent: 🖖 Let me introduce the work I've done over the past three months: 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕 and 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁, now open-sourced on 🤗 Hugging Face.
  
  𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕: This model is built on top of 𝗺𝗲𝘁𝗮-𝗹𝗹𝗮𝗺𝗮/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝟯𝗕 with continual pretraining. The training dataset consists of a mixture of Traditional Chinese and multilingual texts in specific proportions, including 20B tokens of Traditional Chinese text.
  
  𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁: This is a fine-tuned conversational model based on the foundation model.
  
  This Llama-3.2-Taiwan open-source project is currently a one-person effort (yes, I did everything from text preparation — so exhausting!). If you're interested, feel free to join the Discord server for discussions.
  
  🅱🅴🅽🅲🅷🅼🅰🆁🅺🅸🅽🅶
  
  The evaluation was conducted using https://huggingface.co/datasets/ikala/tmmluplus, though the README page does not yet reflect the latest results. The performance is close to the previous versions, indicating that further improvements might require adding more specialized knowledge in the datasets.
  
  🅰 🅲🅰🅻🅻 🅵🅾🆁 🆂🆄🅿🅿🅾🆁🆃
  
  If anyone is willing to provide compute resources, it would be greatly appreciated to help this project continue and grow. 💪
  
  ---
  🏔️ Foundation model: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B
  🤖 Instruction model: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct
  ⚡ GGUF: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF
reactions.reaction: 👍
reactions.users: John6666 clem kaisugi abdeljalilELmajjodi
reactions.reaction: ❤️
reactions.users: Tonic
commentators._id: 6758a9850e3fff481964ca6d
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/no-auth/EolfJfjW25hC4Bt_hCPq8.png
commentators.fullname: Jean Louis
commentators.name: JLouisBiz
commentators.type: user
commentators._id: 62a3bb1cd0d8c2c2169f0b88
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/62a3bb1cd0d8c2c2169f0b88/eT2TS0IlQbZtz-F_zHLz9.jpeg
commentators.fullname: Joseph [open/acc] Pollack
commentators.name: Tonic
commentators.type: user