Artificial Intelligence, Technology, Research, Machine Learning, NLP.
the feasibility of training large language models on proteins and scaling up the language models to larger models with massive data. It was shown that HPC can also successfully expand the scale of protein language models and reduce the gap between large language models and traditional models