Machine Learning, Molecular Design, AI, Transformers, Variational Autoencoder.
the original architecture of transformer described in paper “Attention Is All You Need” from Google for benchmarking. The main advantage of Transformer NLP models is that they are not sequential, which means that unlike RNNs, they can be more easily parallelized, and that bigger and bigger models