Can RLHF with Preference Optimization Techniques Help LLMs Surpass GPT4-Quality Models?
•
2
Vanessa Lopes PRO
Vanessasml
AI & ML interests
ML Engineer with focus on NLP and LLMs research using RLHF techniques.
Recent Activity
upvoted
a
paper
about 1 month ago
Thinking LLMs: General Instruction Following with Thought Generation
published
an
article
about 1 month ago
Can RLHF with Preference Optimization Techniques Help LLMs Surpass GPT4-Quality Models?
Articles
Organizations
None yet
Vanessasml's activity
upvoted
a
paper
about 1 month ago
published
an
article
about 1 month ago
Article
Can RLHF with Preference Optimization Techniques Help LLMs Surpass GPT4-Quality Models?
By
•
•
2
upvoted
a
paper
5 months ago
liked
a
model
8 months ago
updated
3
models
8 months ago
upvoted
an
article
8 months ago
Article
Welcome Llama 3 - Meta's new open LLM
•
281
liked
a
model
8 months ago
liked
a
Space
8 months ago
reacted to
alozowski's
post with 🔥
8 months ago
Post
2546
Do I need to make it a tradition to post here every Friday? Well, here we are again!
This week, I'm happy to share that we have two official Mistral models on the Leaderboard! 🔥 You can check them out: mistralai/Mixtral-8x22B-Instruct-v0.1 and mistralai/Mixtral-8x22B-v0.1
The most exciting thing here? mistralai/Mixtral-8x22B-Instruct-v0.1 model got a first place among pretrained models with an impressive average score of 79.15!🥇 Not far behind is the Mixtral-8x22B-v0.1, achieving second place with an average score of 74.47! Well done, Mistral AI! 👏
Check out my screenshot here or explore it yourself at the https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
The second news is that CohereForAI/c4ai-command-r-plus model in 4-bit quantization got a great average score of 70.08. Cool stuff, Cohere! 😎 (and I also have the screenshot for this, don't miss it)
The last news, which might seem small but is still significant, the Leaderboard frontpage now supports Python 3.12.1. This means we're on our way to speed up the Leaderboard's performance! 🚀
If you have any comments or suggestions, feel free to also tag me on X (Twitter), I'll try to help – [at]ailozovskaya
Have a nice weekend! ✨
This week, I'm happy to share that we have two official Mistral models on the Leaderboard! 🔥 You can check them out: mistralai/Mixtral-8x22B-Instruct-v0.1 and mistralai/Mixtral-8x22B-v0.1
The most exciting thing here? mistralai/Mixtral-8x22B-Instruct-v0.1 model got a first place among pretrained models with an impressive average score of 79.15!🥇 Not far behind is the Mixtral-8x22B-v0.1, achieving second place with an average score of 74.47! Well done, Mistral AI! 👏
Check out my screenshot here or explore it yourself at the https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
The second news is that CohereForAI/c4ai-command-r-plus model in 4-bit quantization got a great average score of 70.08. Cool stuff, Cohere! 😎 (and I also have the screenshot for this, don't miss it)
The last news, which might seem small but is still significant, the Leaderboard frontpage now supports Python 3.12.1. This means we're on our way to speed up the Leaderboard's performance! 🚀
If you have any comments or suggestions, feel free to also tag me on X (Twitter), I'll try to help – [at]ailozovskaya
Have a nice weekend! ✨
- 2 replies
reacted to
HugoLaurencon's
post with ❤️
8 months ago
Post
2835
The Cauldron is a massive collection of 50 high-quality datasets, all converted to the user/assistant format, and ready to use to fine-tune any Vision Language Model.
The Cauldron covers a wide range of tasks, including general visual question answering, counting, captioning, text transcription, document understanding, chart/figure understanding, table understanding, visual reasoning, geometry, spotting differences between 2 images or converting a screenshot to a code.
HuggingFaceM4/the_cauldron
The Cauldron covers a wide range of tasks, including general visual question answering, counting, captioning, text transcription, document understanding, chart/figure understanding, table understanding, visual reasoning, geometry, spotting differences between 2 images or converting a screenshot to a code.
HuggingFaceM4/the_cauldron
updated
2
datasets
8 months ago
liked
a
Space
over 1 year ago
liked
a
model
over 1 year ago
updated
a
dataset
over 1 year ago