Qian Liu's picture

Qian Liu PRO

SivilTaram

·

http://siviltaram.github.io/

AI & ML interests

Cooking cool things

Articles

RegMix: Data Mixture as Regression for Language Model Pre-training

BigCodeBench: Benchmarking Large Language Models on Solving Practical and Challenging Programming Tasks

Efficient Table Pre-training without Real Data: An Introduction to TAPEX

Organizations

SivilTaram's activity

upvoted 2 collections about 17 hours ago

OpenCoder Datasets

OpenCoder datasets! • 2 items • Updated about 20 hours ago • 3

OpenCoder

OpenCoder is an open and reproducible code LLM family which matches the performance of top-tier code LLMs. • 4 items • Updated 1 day ago • 20

upvoted a paper 1 day ago

OpenCoder: The Open Cookbook for Top-Tier Code Large Language Models

Paper • 2411.04905 • Published 2 days ago • 74

upvoted a paper 3 days ago

How Far is Video Generation from World Model: A Physical Law Perspective

Paper • 2411.02385 • Published 5 days ago • 27

upvoted a collection 13 days ago

🫐 ProX Projects

Collection for: "Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale" • 18 items • Updated 17 days ago • 2

upvoted a paper 29 days ago

Cheating Automatic LLM Benchmarks: Null Models Achieve High Win Rates

Paper • 2410.07137 • Published about 1 month ago • 6

upvoted a collection about 1 month ago

ProX Dataset

a collection of pre-training corpora refined by ProX • 5 items • Updated 22 days ago • 5

upvoted a paper about 1 month ago

Programming Every Example: Lifting Pre-training Data Quality like Experts at Scale

Paper • 2409.17115 • Published Sep 25 • 59

upvoted a paper about 2 months ago

Qwen2.5-Coder Technical Report

Paper • 2409.12186 • Published Sep 18 • 125

upvoted a collection about 2 months ago

MagpieLM

Aligning LMs with Fully Open Recipe (data+training configs+logs) • 9 items • Updated Sep 22 • 15

upvoted an article 2 months ago

Article

Meet Yi-Coder: A Small but Mighty LLM for Code

By

•

Sep 4

• 12

upvoted a paper 2 months ago

WildVis: Open Source Visualizer for Million-Scale Chat Logs in the Wild

Paper • 2409.03753 • Published Sep 5 • 18

upvoted a collection 2 months ago

OLMoE

Artifacts for open mixture-of-experts language models. • 13 items • Updated Sep 25 • 25

upvoted 3 papers 2 months ago

LongRecipe: Recipe for Efficient Long Context Generalization in Large Languge Models

Paper • 2409.00509 • Published Aug 31 • 38

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published Sep 3 • 77

The FineWeb Datasets: Decanting the Web for the Finest Text Data at Scale

Paper • 2406.17557 • Published Jun 25 • 86

upvoted 4 papers 3 months ago

LongVILA: Scaling Long-Context Visual Language Models for Long Videos

Paper • 2408.10188 • Published Aug 19 • 51

The AI Scientist: Towards Fully Automated Open-Ended Scientific Discovery

Paper • 2408.06292 • Published Aug 12 • 115

I-SHEEP: Self-Alignment of LLM from Scratch through an Iterative Self-Enhancement Paradigm

Paper • 2408.08072 • Published Aug 15 • 31

MiniCPM-V: A GPT-4V Level MLLM on Your Phone

Paper • 2408.01800 • Published Aug 3 • 76