What's the best way to fine-tune open LLMs in 2024? Look no further! 👀 I am excited to share “How to Fine-Tune LLMs in 2024 with Hugging Face” using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. 🚀
text
What's the best way to fine-tune open LLMs in 2024? Look no further! 👀 I am excited to share “How to Fine-Tune LLMs in 2024 with Hugging Face” using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. 🚀
new_line
new_line
It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with: 
text
It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with: 
new_line
💡Define and understand use cases for fine-tuning
text
💡Define and understand use cases for fine-tuning
new_line
🧑🏻‍💻 Setup of the development environment
text
🧑🏻‍💻 Setup of the development environment
new_line
🧮 Create and prepare dataset (OpenAI format)
text
🧮 Create and prepare dataset (OpenAI format)
new_line
🏋️‍♀️ Fine-tune LLM using TRL and the SFTTrainer
text
🏋️‍♀️ Fine-tune LLM using TRL and the SFTTrainer
new_line
🥇 Test and evaluate the LLM
text
🥇 Test and evaluate the LLM
new_line
🚀 Deploy for production with TGI
text
🚀 Deploy for production with TGI
new_line
new_line
👉  
text
👉  
https://www.philschmid.de/fine-tune-llms-in-2024-with-trl
https://www.philschmid.de/fine-tune-llms-in-2024-with-trl
link
new_line
new_line
Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. 🔜
text
Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. 🔜
What's the best way to fine-tune open LLMs in 2024? Look no further! 👀 I am excited to share “How to Fine-Tune LLMs in 2024 with Hugging Face” using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. 🚀

It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with: 
💡Define and understand use cases for fine-tuning
🧑🏻‍💻 Setup of the development environment
🧮 Create and prepare dataset (OpenAI format)
🏋️‍♀️ Fine-tune LLM using TRL and the SFTTrainer
🥇 Test and evaluate the LLM
🚀 Deploy for production with TGI

👉  https://www.philschmid.de/fine-tune-llms-in-2024-with-trl

Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. 🔜
❤️
andrewrreed Jofthomas victor stefan-jo s3nh osanseviero luqmanxyz philschmid kramp samusenps Csplk lunarflu julien-c hamedbabaeigiglou harpreetsahota dhuynh95 clem CultriX afrideva brekk andysalerno PriyankSisodia azimuth3d nuatmochoi mathiasn1 ashwinlimaye AdinaY vicgalle pardeep-singh merve adamo1139 madroid mikr omaryshchenko alielfilali01 patchie2 celsowm Luciano santyzenith sbrandeis ramkrish120595 Utkarsh736
👍
BramVanroy clem osanseviero Norod78 hayoungpark azimuth3d mvonwyl pardeep-singh KrishnaKaasyap merve lunarflu madroid zappa2005 Kamaljp mikr vivek37kumar raychen26 gzy02 InvictusRudra ddahlmeier
🤗
littletensor
6141a88b3a0ec78603c9e784
https://cdn-avatars.huggingface.co/v1/production/uploads/6141a88b3a0ec78603c9e784/DJsxSmWV39M33JFheLobC.jpeg
merve
merve
user
6495d5a915d8ef6f01bc75eb
/avatars/245ec3b183919c079f8c5023b3f7ca9f.svg
CultriX
CultriX
user
653246b6d477c43e79acb4c3
/avatars/302fb28d27b64624c37c6755526f9d6f.svg
Zappa
zappa2005
user
6585a41eb378d311dcef0af5
https://cdn-avatars.huggingface.co/v1/production/uploads/6585a41eb378d311dcef0af5/UZrIVxAuf9GkUWUAcgeO1.jpeg
Mark kaave
MarcorpAI
user