content.raw: 🎉 Celebrating One Year of #SauerkrautLM with Two Groundbreaking Releases! 
content.type: text
content.value: 🎉 Celebrating One Year of #SauerkrautLM with Two Groundbreaking Releases! 
content.type: new_line
content.type: new_line
content.raw: We're thrilled to announce the release of SauerkrautLM-v2-14b in two specialized versions: 
content.type: text
content.value: We're thrilled to announce the release of SauerkrautLM-v2-14b in two specialized versions: 
content.raw: https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT
content.id: VAGOsolutions/SauerkrautLM-v2-14b-SFT
content.type: model
content.type: resource
content.url: https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT
content.raw:  and 
content.type: text
content.value:  and 
content.raw: https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-DPO
content.id: VAGOsolutions/SauerkrautLM-v2-14b-DPO
content.type: model
content.type: resource
content.url: https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-DPO
content.raw: . Built on the robust Qwen2.5-14B foundation, these models represent a significant leap forward in multilingual AI capabilities.
content.type: text
content.value: . Built on the robust Qwen2.5-14B foundation, these models represent a significant leap forward in multilingual AI capabilities.
content.type: new_line
content.type: new_line
content.raw: 🔬 Technical Breakthroughs:
content.type: text
content.value: 🔬 Technical Breakthroughs:
content.type: new_line
content.raw: 💠 Innovative three-phase Fine-Tuning approach
content.type: text
content.value: 💠 Innovative three-phase Fine-Tuning approach
content.type: new_line
content.raw: 💠 Two-step Spectrum SFT + one-step Spectrum DPO optimization phase for enhanced performance
content.type: text
content.value: 💠 Two-step Spectrum SFT + one-step Spectrum DPO optimization phase for enhanced performance
content.type: new_line
content.raw: 💠 Balance of German and English language capabilities
content.type: text
content.value: 💠 Balance of German and English language capabilities
content.type: new_line
content.raw: 💠 Advanced function calling - almost on par with Claude-3.5-Sonnet-20240620
content.type: text
content.value: 💠 Advanced function calling - almost on par with Claude-3.5-Sonnet-20240620
content.type: new_line
content.type: new_line
content.raw: 🇩🇪 German Language Excellence:
content.type: text
content.value: 🇩🇪 German Language Excellence:
content.type: new_line
content.raw: What sets this release apart is our unique achievement in simultaneously improving both German and English capabilities. Through our specialized training approach with over 1.2B tokens across two phases, we've managed to:
content.type: text
content.value: What sets this release apart is our unique achievement in simultaneously improving both German and English capabilities. Through our specialized training approach with over 1.2B tokens across two phases, we've managed to:
content.type: new_line
content.raw: 💠 Enhance German language understanding and generation (SFT Version > DPO Version)
content.type: text
content.value: 💠 Enhance German language understanding and generation (SFT Version > DPO Version)
content.type: new_line
content.raw: 💠 Maintain authentic German linguistic nuances
content.type: text
content.value: 💠 Maintain authentic German linguistic nuances
content.type: new_line
content.raw: 💠 Improve cross-lingual capabilities
content.type: text
content.value: 💠 Improve cross-lingual capabilities
content.type: new_line
content.raw: 💠 Preserve cultural context awareness
content.type: text
content.value: 💠 Preserve cultural context awareness
content.type: new_line
content.type: new_line
content.raw: 📊 Training Innovation:
content.type: text
content.value: 📊 Training Innovation:
content.type: new_line
content.raw: Our three-phase approach targeted specific layer percentages (15%, 20% and 25%) with carefully curated datasets, including:
content.type: text
content.value: Our three-phase approach targeted specific layer percentages (15%, 20% and 25%) with carefully curated datasets, including:
content.type: new_line
content.raw: 💠 Mathematics-focused content (proprietary classifier-selected)
content.type: text
content.value: 💠 Mathematics-focused content (proprietary classifier-selected)
content.type: new_line
content.raw: 💠 High-quality German training data
content.type: text
content.value: 💠 High-quality German training data
content.type: new_line
content.raw: 💠 Specialized function calling datasets
content.type: text
content.value: 💠 Specialized function calling datasets
content.type: new_line
content.raw: 💠 Premium multilingual content
content.type: text
content.value: 💠 Premium multilingual content
content.type: new_line
content.type: new_line
content.raw: 🎁 Community Contribution:
content.type: text
content.value: 🎁 Community Contribution:
content.type: new_line
content.raw: We're also releasing two new datasets in a few days: 
content.type: text
content.value: We're also releasing two new datasets in a few days: 
content.type: new_line
content.raw: 1️⃣ SauerkrautLM-Fermented-GER-DPO: 3,300 high-quality German training samples
content.type: text
content.value: 1️⃣ SauerkrautLM-Fermented-GER-DPO: 3,300 high-quality German training samples
content.type: new_line
content.raw: 2️⃣ SauerkrautLM-Fermented-Irrelevance-GER-DPO: 2,000 specialized samples for optimized function call  irrelevance handling
content.type: text
content.value: 2️⃣ SauerkrautLM-Fermented-Irrelevance-GER-DPO: 2,000 specialized samples for optimized function call  irrelevance handling
content.type: new_line
content.type: new_line
content.raw: Thank you to our incredible community and partners who have supported us throughout this journey. Here's to another year of AI innovation! 🚀
content.type: text
content.value: Thank you to our incredible community and partners who have supported us throughout this journey. Here's to another year of AI innovation! 🚀
rawContent: 🎉 Celebrating One Year of #SauerkrautLM with Two Groundbreaking Releases! 
  
  We're thrilled to announce the release of SauerkrautLM-v2-14b in two specialized versions: https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-SFT and https://huggingface.co/VAGOsolutions/SauerkrautLM-v2-14b-DPO. Built on the robust Qwen2.5-14B foundation, these models represent a significant leap forward in multilingual AI capabilities.
  
  🔬 Technical Breakthroughs:
  💠 Innovative three-phase Fine-Tuning approach
  💠 Two-step Spectrum SFT + one-step Spectrum DPO optimization phase for enhanced performance
  💠 Balance of German and English language capabilities
  💠 Advanced function calling - almost on par with Claude-3.5-Sonnet-20240620
  
  🇩🇪 German Language Excellence:
  What sets this release apart is our unique achievement in simultaneously improving both German and English capabilities. Through our specialized training approach with over 1.2B tokens across two phases, we've managed to:
  💠 Enhance German language understanding and generation (SFT Version > DPO Version)
  💠 Maintain authentic German linguistic nuances
  💠 Improve cross-lingual capabilities
  💠 Preserve cultural context awareness
  
  📊 Training Innovation:
  Our three-phase approach targeted specific layer percentages (15%, 20% and 25%) with carefully curated datasets, including:
  💠 Mathematics-focused content (proprietary classifier-selected)
  💠 High-quality German training data
  💠 Specialized function calling datasets
  💠 Premium multilingual content
  
  🎁 Community Contribution:
  We're also releasing two new datasets in a few days: 
  1️⃣ SauerkrautLM-Fermented-GER-DPO: 3,300 high-quality German training samples
  2️⃣ SauerkrautLM-Fermented-Irrelevance-GER-DPO: 2,000 specialized samples for optimized function call  irrelevance handling
  
  Thank you to our incredible community and partners who have supported us throughout this journey. Here's to another year of AI innovation! 🚀
reactions.reaction: 🔥
reactions.users: rizky-gumelar ZeroXClem John6666 foscraft djuna not-lain
reactions.reaction: 👍
reactions.users: flozi00 Jason233