How does this work?
Currenlty the takes a transformer encoder and decoder and puts a VAE between them.

.1554×742 43.5 KB

The VAE forms a compressed latent code which allows interpolating on the training data.

.1540×926 69 KB

For regulatisation an MMD loss is used instead of KL Divergence which reduces posterior collapse.

.1528×916 60.8 KB