Nathan Lambert's picture

Nathan Lambert

natolambert

·

https://www.natolambert.com/

AI & ML interests

Reinforcement learning, Ethics, Robotics, Dynamics Models

Recent Activity

liked a model about 17 hours ago

m-a-p/YuE-s1-7B-anneal-en-cot

updated a collection about 17 hours ago

Tulu 3 Datasets

updated a collection 1 day ago

View all activity

Articles

Ethics and Society Newsletter #4: Bias in Text-to-Image Models

Can foundation models label data like humans?

Creating a Coding Assistant with StarCoder

StackLLaMA: A hands-on guide to train LLaMA with RLHF

Red-Teaming Large Language Models

What Makes a Dialog Agent Useful?

Illustrating Reinforcement Learning from Human Feedback (RLHF)

Stable Diffusion with 🧨 Diffusers

Organizations

natolambert's activity

upvoted an article 14 days ago

Article

Putting RL back in RLHF

Jun 12, 2024

• 70

upvoted a collection 24 days ago

2024 Interconnects Artifacts

Models & datasets mentioned in the bottom section of posts! • 280 items • Updated 27 days ago • 6

upvoted a paper about 1 month ago

Apollo: An Exploration of Video Understanding in Large Multimodal Models

Paper • 2412.10360 • Published Dec 13, 2024 • 139

upvoted a collection about 2 months ago

PixMo

A set of vision-language datasets built by Ai2 and used to train the Molmo family of models. Read more at https://molmo.allenai.org/blog • 9 items • Updated 23 days ago • 55

upvoted 3 collections 2 months ago

OLMo 2

Artifacts for the second set of OLMo models. • 22 items • Updated 23 days ago • 76

Tulu 3 Models

All models released with Tulu 3 -- state of the art open post-training recipes. • 7 items • Updated 23 days ago • 33

Tulu 3 Datasets

All datasets released with Tulu 3 -- state of the art open post-training recipes. • 33 items • Updated about 17 hours ago • 64

upvoted 2 collections 4 months ago

Molmo

Artifacts for open multimodal language models. • 5 items • Updated 23 days ago • 292

Qwen2.5

Qwen2.5 language models, including pretrained and instruction-tuned models of 7 sizes, including 0.5B, 1.5B, 3B, 7B, 14B, 32B, and 72B. • 45 items • Updated Nov 28, 2024 • 482

upvoted 2 collections 5 months ago

Skywork-Reward-Data-Collection

Open-source preference datasets used to train the Skywork reward model series • 17 items • Updated Oct 12, 2024 • 13

OLMoE

Artifacts for open mixture-of-experts language models. • 13 items • Updated 23 days ago • 29

upvoted a collection 6 months ago

Hermes 3

The Hermes 3 Series of Models • 10 items • Updated Dec 11, 2024 • 103

upvoted a collection 7 months ago

Aligned Diffusion Model via DPO

18 items • Updated Jul 8, 2024 • 3

upvoted 2 collections 8 months ago

Tulu V2.5 Suite

A suite of models trained using DPO and PPO across a wide variety (up to 14) of preference datasets. See https://arxiv.org/abs/2406.09279 for more! • 44 items • Updated 23 days ago • 15

SciRIFF

Data and models to enhance instruction-following for scientific literature understanding. • 9 items • Updated 23 days ago • 9

upvoted a collection 10 months ago

[lecture artifacts] aligning open language models

artifacts referenced in the talk timeline! Slides: https://docs.google.com/presentation/d/1quMyI4BAx4rvcDfk8jjv063bmHg4RxZd9mhQloXpMn0/edit?usp=sharin • 63 items • Updated Apr 17, 2024 • 56

upvoted 2 collections 11 months ago

Reward Bench

Datasets, spaces, and models for the reward model benchmark! • 5 items • Updated 23 days ago • 9

Gemma release

Groups the Gemma models released by the Google team. • 40 items • Updated Dec 13, 2024 • 329

upvoted 2 collections about 1 year ago

Model Merging

Model Merging is a very popular technique nowadays in LLM. Here is a chronological list of papers on the space that will help you get started with it! • 30 items • Updated Jun 12, 2024 • 226

OLMo Suite

Artifacts for the first set of OLMo models. • 18 items • Updated 23 days ago • 71