Hey Bram, thank you for your interest! I agree that these models are good since they adapt well to the data. There are two options on the model-side: First, fundamental changes in the neural structure of the net. Second, modification of training schedule. The first option is not reasonable as current models already perform well. For the training schedule, the combination of recently developed self-supervised learning techniques and a new loss function looks promising.