With the most recent workshop on Semantic Evaluation as a part of NAACL-2024, this year delighted to contribute with 🧪 on Chain-of-Thought fine-tuning concepts  to push forward LLMs reasoning capabilities in: 
text
With the most recent workshop on Semantic Evaluation as a part of NAACL-2024, this year delighted to contribute with 🧪 on Chain-of-Thought fine-tuning concepts  to push forward LLMs reasoning capabilities in: 
new_line
new_line
🧪 1. Reading Comprehension of Numerals in texts  🇨🇳 
text
🧪 1. Reading Comprehension of Numerals in texts  🇨🇳 
new_line
⭐ 
text
⭐ 
https://github.com/GavinZhao19/SemEval24-NumAnalysis-CN
https://github.com/GavinZhao19/SemEval24-NumAnalysis-CN
link
new_line
🔒 
text
🔒 
https://huggingface.co/GavinZhao23/NumAnalysis-Chatglm3-6B
https://huggingface.co/GavinZhao23/NumAnalysis-Chatglm3-6B
link
text
new_line
new_line
🧪 2. Extracting Emotion-Causes using Reasoning Revision (RR)
text
🧪 2. Extracting Emotion-Causes using Reasoning Revision (RR)
new_line
⭐ 
text
⭐ 
https://github.com/nicolay-r/THOR-ECAC
https://github.com/nicolay-r/THOR-ECAC
link
new_line
🔓 
text
🔓 
https://huggingface.co/nicolay-r/flan-t5-emotion-cause-thor-base
nicolay-r/flan-t5-emotion-cause-thor-base
model
resource
https://huggingface.co/nicolay-r/flan-t5-emotion-cause-thor-base
new_line
text
nicolay-r at SemEval-2024 Task 3: Using Flan-T5 for Reasoning Emotion
  Cause in Conversations with Chain-of-Thought on Emotion States (2404.03361)
https://huggingface.co/papers/2404.03361
2404.03361
paper
resource
https://huggingface.co/papers/2404.03361
new_line
new_line
🔑 In short, there are three major takeaways:
text
🔑 In short, there are three major takeaways:
new_line
✅ 1. The scale of the backboned LLM for SFT matters (>1.1B is preferable)
text
✅ 1. The scale of the backboned LLM for SFT matters (>1.1B is preferable)
new_line
✅ 2. The language of the input data  matters in LLM reasoning capabilities: transfering data in English and picking English-based LLM is crucial for the most cases!
text
✅ 2. The language of the input data  matters in LLM reasoning capabilities: transfering data in English and picking English-based LLM is crucial for the most cases!
new_line
✅ 3. CoT and RR takes more time ⏳ for inferring and fine-tuning, proportionally to abount of steps in chain / amount of revisions in reasoning 🧠
text
✅ 3. CoT and RR takes more time ⏳ for inferring and fine-tuning, proportionally to abount of steps in chain / amount of revisions in reasoning 🧠
With the most recent workshop on Semantic Evaluation as a part of NAACL-2024, this year delighted to contribute with 🧪 on Chain-of-Thought fine-tuning concepts  to push forward LLMs reasoning capabilities in: 

🧪 1. Reading Comprehension of Numerals in texts  🇨🇳 
⭐ https://github.com/GavinZhao19/SemEval24-NumAnalysis-CN
🔒 https://huggingface.co/GavinZhao23/NumAnalysis-Chatglm3-6B 

🧪 2. Extracting Emotion-Causes using Reasoning Revision (RR)
⭐ https://github.com/nicolay-r/THOR-ECAC
🔓 https://huggingface.co/nicolay-r/flan-t5-emotion-cause-thor-base
 https://huggingface.co/papers/2404.03361

🔑 In short, there are three major takeaways:
✅ 1. The scale of the backboned LLM for SFT matters (>1.1B is preferable)
✅ 2. The language of the input data  matters in LLM reasoning capabilities: transfering data in English and picking English-based LLM is crucial for the most cases!
✅ 3. CoT and RR takes more time ⏳ for inferring and fine-tuning, proportionally to abount of steps in chain / amount of revisions in reasoning 🧠