Deep Learning, Artificial Intelligence, Image Classification, Self Supervised Learning, NLP.
Target Feature Type Transformer blocks contain several layers which can each serve as targets. The output of the feed-forward network (FFN) block works best while the output of the self-attention block does not yield a usable model.