fpreiss (Fabian A. Preiß)

upvoted an article 4 months ago

Article

How we leveraged distilabel to create an Argilla 2.0 Chatbot

Jul 16

• 32

upvoted a paper 5 months ago

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Paper • 2406.14491 • Published Jun 20 • 85

upvoted 3 papers 6 months ago

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

Paper • 2404.18796 • Published Apr 29 • 68

ChatQA: Building GPT-4 Level Conversational QA Models

Paper • 2401.10225 • Published Jan 18 • 33

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Paper • 2404.03715 • Published Apr 4 • 60

upvoted 2 papers 7 months ago

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

Paper • 2404.14219 • Published Apr 22 • 251

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

Paper • 2402.14905 • Published Feb 22 • 126

upvoted an article 7 months ago

Article

Fine-tune Llama 3 with ORPO

By

•

Apr 22

• 226

upvoted a collection 7 months ago

fuck quadratic attention

Collection

11 items • Updated Apr 24 • 20

upvoted 5 papers 7 months ago

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Paper • 2310.06770 • Published Oct 10, 2023 • 4

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Paper • 2403.12881 • Published Mar 19 • 16

upvoted a collection 7 months ago

MoEs papers reading list

Collection

60 items • Updated 5 days ago • 134

upvoted a collection 8 months ago

Model Merging

Collection

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12 • 217

upvoted a collection 9 months ago

Leaderboards and benchmarks ✨

Collection

Cool leaderboard spaces collection for models across modalities! Text, vision, audio, ... • 73 items • Updated 4 days ago • 88

upvoted a collection 10 months ago

Tiny Series

Collection

Tiny datasets that empower the foundation of Small Language Model! • 11 items • Updated Jan 26 • 36

Fabian A. Preiß

AI & ML interests

Organizations

fpreiss's activity

How we leveraged distilabel to create an Argilla 2.0 Chatbot

Instruction Pre-Training: Language Models are Supervised Multitask Learners

Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse Models

ChatQA: Building GPT-4 Level Conversational QA Models

Direct Nash Optimization: Teaching Language Models to Self-Improve with General Preferences

Phi-3 Technical Report: A Highly Capable Language Model Locally on Your Phone

MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases

Fine-tune Llama 3 with ORPO

fuck quadratic attention

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

Agent-FLAN: Designing Data and Methods of Effective Agent Tuning for Large Language Models

Advancing LLM Reasoning Generalists with Preference Trees

ReFT: Representation Finetuning for Language Models

Lost in the Middle: How Language Models Use Long Contexts

MoEs papers reading list

Model Merging

Leaderboards and benchmarks ✨

Tiny Series