ChemLLM: A Chemical Large Language Model
Large language models (LLMs) have made impressive progress in chemistry
applications, including molecular property prediction, molecular generation,
experimental protocol design, etc. However, the community lacks a
dialogue-based model specifically designed for chemistry. The challenge arises
from the fact that most chemical data and scientific knowledge are primarily
stored in structured databases, and the direct use of these structured data
compromises the model's ability to maintain coherent dialogue. To tackle this
issue, we develop a novel template-based instruction construction method that
transforms structured knowledge into plain dialogue, making it suitable for
language model training. By leveraging this approach, we develop ChemLLM, the
first large language model dedicated to chemistry, capable of performing
various tasks across chemical disciplines with smooth dialogue interaction.
ChemLLM beats GPT-3.5 on all three principal tasks in chemistry, i.e., name
conversion, molecular caption, and reaction prediction, and surpasses GPT-4 on
two of them. Remarkably, ChemLLM also shows exceptional adaptability to related
mathematical and physical tasks despite being trained mainly on
chemical-centric corpora. Furthermore, ChemLLM demonstrates proficiency in
specialized NLP tasks within chemistry, such as literature translation and
cheminformatic programming. ChemLLM opens up a new avenue for exploration
within chemical studies, while our method of integrating structured chemical
knowledge into dialogue systems sets a new frontier for developing LLMs across
various scientific fields. Codes, Datasets, and Model weights are publicly
accessible at hf.co/AI4Chem/ChemLLM-7B-Chat.
65cad646ef77197acfba69ee
Di Zhang
claimed_verified
2024-02-13T11:00:51.400Z
64bce15bafd1e46c5504ad38
https://cdn-avatars.huggingface.co/v1/production/uploads/64bce15bafd1e46c5504ad38/vkEjiu-mIagKlrXzDH75o.png
Di Zhang
user
di-zhang-fdu
65cad646ef77197acfba69ef
Wei Liu
65cad646ef77197acfba69f0
Qian Tan
claimed_verified
2024-02-13T14:38:08.500Z
657496ae827f8fd6669aea85
https://cdn-avatars.huggingface.co/v1/production/uploads/657496ae827f8fd6669aea85/Pp1a0tJax18XXnr_XkPpP.jpeg
笨笨狗
user
bbsjz
65cad646ef77197acfba69f1
Jingdan Chen
admin_assigned
2024-02-13T10:35:25.940Z
6543a8419ce0fa3dfa5142c2
/avatars/0702e74f21f8383b2dcf8242481cfac5.svg
Jingdan Chen
user
ChlorineChem
65cad646ef77197acfba69f2
Hang Yan
65cad646ef77197acfba69f3
Yuliang Yan
admin_assigned
2024-02-13T10:35:54.261Z
6549f5f5c01e5a4e88ae98a7
/avatars/4b44d63621d393fbf5b622d131359f4c.svg
Yuliang Yan
user
Goal-aweiluo
65cad646ef77197acfba69f4
Jiatong Li
claimed_verified
2024-10-09T11:21:09.618Z
6438e55cb2ea24b52ebc45ec
/avatars/e13c7398f77e7e0bd5eed03102aa5c36.svg
Jiatong LI
user
phenixace
65cad646ef77197acfba69f5
Weiran Huang
claimed_verified
2024-02-29T14:36:08.707Z
65e095da35ad8b2fe8c80e71
/avatars/225d4be6411dcec2460047ea1a88a5c3.svg
Weiran Huang
user
weiranhuang
65cad646ef77197acfba69f6
Xiangyu Yue
65cad646ef77197acfba69f7
Dongzhan Zhou
admin_assigned
2024-02-13T10:38:39.224Z
6538b861613fe158bd581e35
/avatars/6817dbfe903675721fd227058b0a91ac.svg
Dongzhan Zhou
user
schrodingers-tiger
65cad646ef77197acfba69f8
Shufei Zhang
65cad646ef77197acfba69f9
Mao Su
65cad646ef77197acfba69fa
Hansen Zhong
65cad646ef77197acfba69fb
Yuqiang Li
claimed_verified
2024-02-13T13:48:37.484Z
65cb61ba0390fce629de99d1
/avatars/9b4b4556ffd8de215dc37b02366d781b.svg
Yuqiang Li
user
yuqiangli
65cad646ef77197acfba69fc
Wanli Ouyang
ChemLLM: A Chemical Large Language Model
Large language models (LLMs) have made impressive progress in chemistry
applications, including molecular property prediction, molecular generation,
experimental protocol design, etc. However, the community lacks a
dialogue-based model specifically designed for chemistry. The challenge arises
from the fact that most chemical data and scientific knowledge are primarily
stored in structured databases, and the direct use of these structured data
compromises the model's ability to maintain coherent dialogue. To tackle this
issue, we develop a novel template-based instruction construction method that
transforms structured knowledge into plain dialogue, making it suitable for
language model training. By leveraging this approach, we develop ChemLLM, the
first large language model dedicated to chemistry, capable of performing
various tasks across chemical disciplines with smooth dialogue interaction.
ChemLLM beats GPT-3.5 on all three principal tasks in chemistry, i.e., name
conversion, molecular caption, and reaction prediction, and surpasses GPT-4 on
two of them. Remarkably, ChemLLM also shows exceptional adaptability to related
mathematical and physical tasks despite being trained mainly on
chemical-centric corpora. Furthermore, ChemLLM demonstrates proficiency in
specialized NLP tasks within chemistry, such as literature translation and
cheminformatic programming. ChemLLM opens up a new avenue for exploration
within chemical studies, while our method of integrating structured chemical
knowledge into dialogue systems sets a new frontier for developing LLMs across
various scientific fields. Codes, Datasets, and Model weights are publicly
accessible at hf.co/AI4Chem/ChemLLM-7B-Chat.
A dialogue-based large language model for chemistry, ChemLLM, demonstrates superior performance over existing models across various chemical tasks and shows adaptability to mathematical and physical tasks by transforming structured chemical knowledge into conversational format.
template-based instruction construction dialogue-based model ChemLLM name conversion molecular caption reaction prediction literature translation cheminformatic programming