Machine Learning, Molecular Design, AI, Transformers, Variational Autoencoder.
the encoder, they are forced to be represented with less features as the channel shrinks. Intuitively, the smaller the channel is, the higher level features are. This technique is lossy, meaning that data loss is inevitable and one of the goal is to contain more useful information in the bottleneck