Artificial Intelligence, Technology, Research, Machine Learning, NLP.
National Laboratory (ORNL) recently launched the ProtTrans Project, which provides an outstanding model for protein pretraining. ProtTrans was trained on thousands of GPUs and hundreds of Google TPUs using various transformers models. The project has been open-sourced on GitHub and is backed by