Efficiently Programming Large Language Models using SGLang
Paper
•
2312.07104
•
Published
•
7
Lianmin
lmzheng
AI & ML interests
Training and serving large models
Recent Activity
published
an
article
2 days ago
Transformers backend integration in SGLang
updated
a model
about 2 months ago
lmsys/sglang-EAGLE3-LLaMA3.1-Instruct-8B
published
a model
about 2 months ago
lmsys/sglang-EAGLE3-LLaMA3.1-Instruct-8B
Organizations
authored
a
paper
over 1 year ago
authored
3
papers
almost 2 years ago
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
Paper
•
2309.11998
•
Published
•
25
FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
Paper
•
2303.06865
•
Published
•
1
H$_2$O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models
Paper
•
2306.14048
•
Published
•
12
authored
a
paper
about 2 years ago