Lemur: Harmonizing Natural Language and Code for Language Agents
We introduce Lemur and Lemur-Chat, openly accessible language models
optimized for both natural language and coding capabilities to serve as the
backbone of versatile language agents. The evolution from language chat models
to functional language agents demands that models not only master human
interaction, reasoning, and planning but also ensure grounding in the relevant
environments. This calls for a harmonious blend of language and coding
capabilities in the models. Lemur and Lemur-Chat are proposed to address this
necessity, demonstrating balanced proficiencies in both domains, unlike
existing open-source models that tend to specialize in either. Through
meticulous pre-training using a code-intensive corpus and instruction
fine-tuning on text and code data, our models achieve state-of-the-art averaged
performance across diverse text and coding benchmarks among open-source models.
Comprehensive experiments demonstrate Lemur's superiority over existing
open-source models and its proficiency across various agent tasks involving
human communication, tool usage, and interaction under fully- and partially-
observable environments. The harmonization between natural and programming
languages enables Lemur-Chat to significantly narrow the gap with proprietary
models on agent abilities, providing key insights into developing advanced
open-source agents adept at reasoning, planning, and operating seamlessly
across environments. https://github.com/OpenLemur/Lemur
652864bf1ddb701dc2cba3ab
Yiheng Xu
claimed_verified
2023-10-13T07:52:25.749Z
601d29ab913ad3afd7b7ddb8
https://cdn-avatars.huggingface.co/v1/production/uploads/1620447944896-601d29ab913ad3afd7b7ddb8.jpeg
Yiheng Xu
user
ranpox
652864bf1ddb701dc2cba3ac
Hongjin Su
admin_assigned
2023-10-13T08:33:10.404Z
632d53951538d4798a73c849
/avatars/b7d0a895e669bcd1303c4716b5401c36.svg
Hongjin SU
user
multi-train
652864bf1ddb701dc2cba3ad
Chen Xing
claimed_verified
2023-10-13T14:43:01.179Z
649e2bfbab373ff26ac20853
/avatars/0df2ada953e4553b773ff064dd86228c.svg
Chen Xing
user
LynetteXing
652864bf1ddb701dc2cba3ae
Boyu Mi
admin_assigned
2023-10-13T08:33:50.091Z
64858110b28e374571bbc550
/avatars/62c169a3149d5a7942c960753df3a673.svg
Mi Boyu
user
miboyu5
652864bf1ddb701dc2cba3af
Qian Liu
claimed_verified
2023-10-13T07:52:22.016Z
612ee6a7b960e78c6d2319d4
https://cdn-avatars.huggingface.co/v1/production/uploads/612ee6a7b960e78c6d2319d4/2Hu9BaAyXbyh1vt0v1Qui.jpeg
Qian Liu
user
SivilTaram
652864bf1ddb701dc2cba3b0
Weijia Shi
admin_assigned
2023-10-13T08:34:18.056Z
6400f2ed568dbe30c9161e47
/avatars/c55938df5bce82b5d96e592a1ec36a8b.svg
Weijia Shi
user
swj0419
652864bf1ddb701dc2cba3b1
Binyuan Hui
admin_assigned
2023-10-13T08:34:25.742Z
61e4c4ca1ab24785ac11ba69
https://cdn-avatars.huggingface.co/v1/production/uploads/61e4c4ca1ab24785ac11ba69/1Q1zhhyGSJ9RJG9MzwxVv.jpeg
Binyuan Hui
user
huybery
652864bf1ddb701dc2cba3b2
Fan Zhou
652864bf1ddb701dc2cba3b3
Yitao Liu
admin_assigned
2023-10-13T08:35:11.354Z
6482a35b93362a0d12172f9a
/avatars/8690151b24da63521de6abf7dd65838d.svg
Yitao Liu
user
YitaoLiu
652864bf1ddb701dc2cba3b4
Tianbao Xie
claimed_verified
2023-10-13T07:52:18.792Z
618767e4238063b4615d042b
https://cdn-avatars.huggingface.co/v1/production/uploads/1636263880877-noauth.jpeg
Tianbao Xie
user
tianbaoxiexxx
652864bf1ddb701dc2cba3b5
Zhoujun Cheng
admin_assigned
2023-10-13T08:35:24.367Z
6083902e1e36b13a64497d91
https://cdn-avatars.huggingface.co/v1/production/uploads/6083902e1e36b13a64497d91/h4rGHMn2c6z5GesF0F6VU.png
cheng
user
zhoujun
652864bf1ddb701dc2cba3b6
Siheng Zhao
admin_assigned
2023-10-13T08:35:32.212Z
642e76a8113b200fd767b3c9
https://cdn-avatars.huggingface.co/v1/production/uploads/642e76a8113b200fd767b3c9/03_CAAr6gy7H_F_iUWx76.png
Siheng Zhao
user
OliverZhao
652864bf1ddb701dc2cba3b7
Lingpeng Kong
652864bf1ddb701dc2cba3b8
Bailin Wang
claimed_verified
2023-10-16T07:24:53.075Z
642f4bfbc953ca48ccd162f2
/avatars/390662485bbf2bbe3454ba9f416d1536.svg
Bailin
user
bailin28
652864bf1ddb701dc2cba3b9
Caiming Xiong
admin_assigned
2023-10-13T08:36:36.549Z
649dbcc4e0fff1ed099dc80a
/avatars/c87c273ca628dbcddccbf1ee19b2ce33.svg
Caiming Xiong
user
cxiong
652864bf1ddb701dc2cba3ba
Tao Yu
Lemur: Harmonizing Natural Language and Code for Language Agents
We introduce Lemur and Lemur-Chat, openly accessible language models
optimized for both natural language and coding capabilities to serve as the
backbone of versatile language agents. The evolution from language chat models
to functional language agents demands that models not only master human
interaction, reasoning, and planning but also ensure grounding in the relevant
environments. This calls for a harmonious blend of language and coding
capabilities in the models. Lemur and Lemur-Chat are proposed to address this
necessity, demonstrating balanced proficiencies in both domains, unlike
existing open-source models that tend to specialize in either. Through
meticulous pre-training using a code-intensive corpus and instruction
fine-tuning on text and code data, our models achieve state-of-the-art averaged
performance across diverse text and coding benchmarks among open-source models.
Comprehensive experiments demonstrate Lemur's superiority over existing
open-source models and its proficiency across various agent tasks involving
human communication, tool usage, and interaction under fully- and partially-
observable environments. The harmonization between natural and programming
languages enables Lemur-Chat to significantly narrow the gap with proprietary
models on agent abilities, providing key insights into developing advanced
open-source agents adept at reasoning, planning, and operating seamlessly
across environments. https://github.com/OpenLemur/Lemur
Lemur and Lemur-Chat are open-source language models combining language and coding capabilities, achieving state-of-the-art performance across various benchmarks and agent tasks.
language models coding capabilities harmonious blend language and coding pre-training code-intensive corpus instruction fine-tuning state-of-the-art diverse text and coding benchmarks agent tasks human communication tool usage interaction fully-observable environments partially-observable environments proprietary models advanced open-source agents